00000001:02000400:0.0F:1788521001.407250:0:3299:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg341-server.virtnet: executing set_hostid 00000001:02000400:0.0:1788521021.228433:0:3520:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg341-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1788521023.702103:0:3580:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 709 MB/s 00000001:01000000:3.0:1788521023.953518:0:3580:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 498 MB/s 00000001:01000000:0.0:1788521024.203209:0:3580:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4047 MB/s 00000020:02000000:3.0:1788521024.913086:0:3612:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_g1e70112 00000400:02000000:1.0F:1788521025.957216:0:3627:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.141@tcp [8/256/0/180] 00008000:02000000:2.0F:1788521029.873709:0:3776:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788521097.415326:0:5746:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg341-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788521113.595523:0:6496:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788521113.595531:0:6496:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788521113.595533:0:6496:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788521113.598088:0:6496:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000006b30f12b 00000080:02000400:2.0:1788521113.598109:0:6496:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788521113.610427:0:6496:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788521113.610448:0:6496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788521113.610490:0:6496:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000003cab9210) 00000020:00000080:2.0:1788521113.610515:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788521113.707238:0:6496:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788521113.707347:0:6496:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1788521113.729714:0:6496:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788521113.730039:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788521113.730048:0:6496:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788521113.730061:0:6496:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x411dd0ee4d2d0d9b 00000020:01000004:0.0:1788521113.730069:0:6496:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788521113.730075:0:6496:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788521113.730080:0:6496:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006b30f12b from MGS 00000020:01000004:0.0:1788521113.730085:0:6496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788521113.730113:0:6496:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000030d87c9) 00000020:00000080:0.0:1788521113.730129:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788521113.730619:0:6496:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006b30f12b from MGS, refs=2 00080000:01000000:0.0:1788521113.730627:0:6496:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788521113.730634:0:6496:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x411dd0ee4d2d0da9 00000100:00100000:0.0:1788521113.730752:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788521113.731099:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788521113.731107:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788521113.732071:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788521113.732082:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788521113.740238:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788521113.751167:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788521113.751179:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788521113.753508:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788521113.753529:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788521113.754127:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788521113.754135:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788521113.755464:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521113.755469:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521113.755471:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521113.756099:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521113.756102:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521113.756104:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521113.756746:0:6496:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788521113.768211:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788521114.006059:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4591 MB/s 00000001:01000000:2.0:1788521114.257051:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3509 MB/s 00000001:01000000:2.0:1788521114.509870:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 599 MB/s 00000001:01000000:3.0:1788521114.763077:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 565 MB/s 00080000:10000000:3.0:1788521114.776234:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:0.0:1788521114.798777:0:6496:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788521114.811908:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788521114.814427:0:6496:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788521114.814531:0:6496:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788521114.814793:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788521114.814821:0:6496:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788521114.815269:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521114.815468:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788521114.815476:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788521114.817561:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788521114.817573:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788521114.819326:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788521114.819346:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788521114.824696:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788521114.824729:0:6496:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.141@tcp' 00000020:01000004:1.0:1788521114.824732:0:6496:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788521114.824795:0:6496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.141@tcp (typ=mgc) 00000020:00000080:1.0:1788521114.824818:0:6496:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.141@tcp (0000000034f26742) 00000020:00000080:1.0:1788521114.824838:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788521114.825009:0:6496:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005142450a@MGC192.168.203.141@tcp: add connection 192.168.203.141@tcp at head 00010000:00010000:1.0:1788521114.825216:0:6496:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.141@tcp-0 is initialized 00000040:01000000:1.0:1788521114.825224:0:6496:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.141@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788521114.825654:0:6515:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788521114.828564:0:6517:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788521114.828669:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.141@tcp (uuid 0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf) 00000020:00000080:1.0:1788521114.828696:0:6496:0:(genops.c:1385:class_connect()) connect: client 0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf, cookie 0x411dd0ee4d2d0db7 00000100:00080000:1.0:1788521114.828712:0:6496:0:(import.c:545:import_select_connection()) MGC192.168.203.141@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788521114.828718:0:6496:0:(import.c:665:import_select_connection()) MGC192.168.203.141@tcp: import 000000005142450a using connection 192.168.203.141@tcp/0@lo 00000100:00100000:1.0:1788521114.828769:0:6496:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006d5b4f28 x1875400222310528/t0(0) o250->MGC192.168.203.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788521114.828793:0:6496:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf->MGS 00000020:01000004:1.0:1788521114.828811:0:6496:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788521114.828816:0:6496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788521114.828832:0:6496:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000f31b67d0) 00000020:00000080:1.0:1788521114.828846:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788521114.828999:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006d5b4f28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3642:1875400222310528:0@lo:250: 00000100:00100000:3.0:1788521114.829118:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788521114.829334:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521114.829364:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222310528 00000100:00100000:3.0:1788521114.829384:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222310528 00000100:00100000:3.0:1788521114.829428:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788521114.829436:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000509a5491 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3642:x1875400222310528:12345-0@lo:250: 00010000:00080000:3.0:1788521114.829463:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:3.0:1788521114.829491:0:6512:0:(genops.c:1385:class_connect()) connect: client 0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf, cookie 0x411dd0ee4d2d0dc5 00000100:00080000:3.0:1788521114.830596:0:6512:0:(import.c:65:import_set_state_nolock()) 00000000ed7b8340 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788521114.830691:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000509a5491 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+5:3642:x1875400222310528:12345-0@lo:250: Request processed in 1253us (1571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521114.830701:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788521114.830774:0:3642:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.141@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788521114.830785:0:3642:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.141@tcp: connect to target with instance 0 00000100:00080000:3.0:1788521114.830793:0:3642:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.141@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788521114.830798:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788521114.830801:0:3642:0:(import.c:65:import_set_state_nolock()) 000000005142450a MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788521114.830803:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788521114.830815:0:3642:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788521114.830821:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006d5b4f28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3642:1875400222310528:0@lo:250: 00000100:00100000:1.0:1788521114.856910:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788521114.863635:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788521114.863659:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788521114.873301:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788521114.873319:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788521114.873763:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788521114.873773:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788521114.874823:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788521114.875215:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788521114.875229:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788521114.875980:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788521114.875990:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788521114.918554:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788521114.918800:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788521114.918808:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788521114.920353:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788521114.920376:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788521114.921284:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788521114.921539:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788521114.921546:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788521114.922289:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788521114.922298:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788521114.923353:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788521114.923552:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788521114.923558:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788521114.925509:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788521114.925526:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788521114.935443:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788521114.935707:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788521114.935714:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788521114.937259:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788521114.937271:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788521114.963020:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788521114.964033:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788521114.964043:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788521114.967824:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788521114.967851:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788521114.971221:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788521114.971245:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788521114.972494:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788521114.972533:0:6496:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788521114.972541:0:6496:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.141@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788521114.972684:0:6496:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.141@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788521114.972724:0:6496:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.141@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788521114.972730:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788521114.972731:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788521114.972733:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788521114.972734:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788521114.972735:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788521114.972736:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788521114.972737:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788521114.972739:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788521114.972740:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788521114.972742:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788521114.972744:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788521114.972745:0:6496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788521114.972752:0:6496:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788521114.972754:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788521114.972760:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788521114.972761:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788521114.972761:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788521114.972762:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788521114.972763:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788521114.972764:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788521114.972765:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788521114.972766:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788521114.972766:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788521114.972767:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788521114.972768:0:6496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788521114.972828:0:6496:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788521114.972860:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000118f3935 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222310656:0@lo:253: 00000100:00100000:3.0:1788521114.972993:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521114.973050:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 000000009af13f73 going to sleep for 11 seconds 00000100:00100000:1.0:1788521114.973675:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222310656 00000100:00100000:1.0:1788521114.973756:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222310656 00000100:00100000:1.0:1788521114.974520:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788521114.974536:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d652ef2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+5:6496:x1875400222310656:12345-0@lo:253: 20000000:01000000:1.0:1788521114.974621:0:6514:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788521114.974624:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788521114.977152:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788521114.977603:0:6514:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788521114.978023:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788521114.985237:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788521114.989421:0:6514:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788521114.989431:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788521114.989439:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788521114.989443:0:6514:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788521114.989458:0:6514:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788521114.989814:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788521114.990093:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788521114.990110:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788521114.990130:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788521114.990149:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788521114.990163:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788521114.990228:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788521114.990235:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788521114.990247:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788521114.990253:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788521114.990264:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788521114.990268:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788521114.990281:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788521114.990297:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788521114.990335:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788521114.990340:0:6514:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788521114.990347:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788521114.990472:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788521114.990481:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788521114.990495:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788521114.990507:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788521114.990521:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788521114.990531:0:6514:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788521114.990555:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788521114.990562:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788521114.990574:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788521114.990589:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788521114.990602:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788521114.990611:0:6514:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788521114.990632:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788521114.990639:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788521114.990650:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788521114.990663:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788521114.990726:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788521114.990749:0:6514:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788521114.990756:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1788521114.992440:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788521114.992758:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788521114.992792:0:6514:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.141@tcp for mdt 20000000:01000000:0.0:1788521114.992795:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.141@tcp (null) (null) (null) 00000040:00080000:0.0:1788521114.992812:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788521114.992818:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788521114.992831:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788521114.992837:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.141@tcp (null) (null) 00000040:00080000:0.0:1788521114.992850:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788521114.992859:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788521114.992871:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788521114.992930:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788521114.992975:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788521114.992979:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788521114.992984:0:6514:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788521114.993042:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788521114.993045:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788521114.994052:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1788521114.994315:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1788521114.994345:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1788521114.994360:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1788521114.994373:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788521114.994375:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788521114.994689:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1788521114.995083:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788521114.995106:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1788521114.995121:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1788521114.995145:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788521114.995149:0:6514:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1788521114.995155:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788521114.995158:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788521114.995164:0:6514:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788521114.995174:0:6514:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788521114.996758:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1788521114.997023:0:6514:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788521115.009201:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1788521115.009251:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1788521115.009267:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1788521115.009294:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788521115.009322:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000045134775/0x411dd0ee4d2d0dcc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521115.009344:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000045134775/0x411dd0ee4d2d0dcc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521115.009355:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000045134775/0x411dd0ee4d2d0dcc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521115.009362:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000045134775/0x411dd0ee4d2d0dcc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521115.009368:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000045134775/0x411dd0ee4d2d0dcc lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521115.009374:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000045134775/0x411dd0ee4d2d0dcc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521115.009381:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000045134775 already unused, calling callback (0000000099446ad8) 00010000:00010000:1.0:1788521115.009385:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000045134775/0x411dd0ee4d2d0dcc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521115.009414:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000045134775/0x411dd0ee4d2d0dcc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521115.009430:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000045134775/0x411dd0ee4d2d0dcc lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521115.009439:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000045134775/0x411dd0ee4d2d0dcc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521115.009445:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000045134775/0x411dd0ee4d2d0dcc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788521115.009469:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788521115.040386:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d652ef2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+5:6496:x1875400222310656:12345-0@lo:253: Request processed in 65843us (67379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521115.040433:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788521115.040599:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000118f3935 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222310656:0@lo:253: 10000000:01000000:3.0:1788521115.040619:0:6496:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788521115.040622:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788521115.040624:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788521115.040626:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788521115.040626:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788521115.040627:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788521115.040629:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788521115.040630:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788521115.040632:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788521115.040633:0:6496:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788521115.040635:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788521115.040637:0:6496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788521115.040663:0:6496:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006b30f12b from lustre-MDT0000 10000000:01000000:3.0:1788521115.040727:0:6496:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788521115.040731:0:6496:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788521115.040735:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8fef4e780000 10000000:01000000:3.0:1788521115.040740:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788521115.040751:0:6496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8fef4e780000 from 1 10000000:01000000:3.0:1788521115.040754:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788521115.045482:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: 00000000e4943218/0x411dd0ee4d2d0dd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521115.045527:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: 00000000e4943218/0x411dd0ee4d2d0dd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521115.045542:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: 00000000e4943218/0x411dd0ee4d2d0dd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521115.045577:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000118f3935 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222310784:0@lo:101: 00000100:00100000:3.0:1788521115.045670:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521115.045765:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b500a577 going to sleep for 11 seconds 00000100:00100000:0.0:1788521115.046098:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222310784 00000100:00100000:0.0:1788521115.046109:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222310784 00000100:00100000:0.0:1788521115.046170:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521115.046180:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d70ab8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+5:6496:x1875400222310784:12345-0@lo:101: 00010000:00010000:0.0:1788521115.046198:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521115.046218:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f95e50c5/0x411dd0ee4d2d0dda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d0dd3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521115.046250:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f95e50c5/0x411dd0ee4d2d0dda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0dd3 expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521115.046262:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f95e50c5/0x411dd0ee4d2d0dda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0dd3 expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521115.046272:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f95e50c5, rc 0) 00000100:00100000:0.0:1788521115.046421:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d70ab8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+6:6496:x1875400222310784:12345-0@lo:101: Request processed in 242us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521115.046428:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788521115.051615:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000118f3935 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222310784:0@lo:101: 00010000:00010000:2.0:1788521115.051659:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: 00000000e4943218/0x411dd0ee4d2d0dd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0dda expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521115.051673:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: 00000000e4943218/0x411dd0ee4d2d0dd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d0dda expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521115.052225:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a886658 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222310912:0@lo:501: 00000100:00100000:2.0:1788521115.052325:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521115.052624:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 0000000028cd9c34 going to sleep for 11 seconds 00000100:00100000:0.0:1788521115.053954:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222310912 00000100:00100000:0.0:1788521115.053970:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222310912 00000100:00100000:0.0:1788521115.054101:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521115.054112:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a450354c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+6:6496:x1875400222310912:12345-0@lo:501: 00000100:00100000:0.0:1788521115.054272:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a450354c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+6:6496:x1875400222310912:12345-0@lo:501: Request processed in 162us (1948us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788521115.054280:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788521115.054385:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a886658 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222310912:0@lo:501: 10000000:01000000:2.0:1788521115.054438:0:6496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788521115.054466:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: 00000000e4943218/0x411dd0ee4d2d0dd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0dda expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521115.054477:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: 00000000e4943218/0x411dd0ee4d2d0dd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0dda expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521115.054487:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8fef58328000 10000000:01000000:2.0:1788521115.054492:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788521115.054498:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8fef58328000 10000000:01000000:2.0:1788521115.054501:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788521115.054504:0:6496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8fef58328000 from 1 10000000:01000000:2.0:1788521115.054507:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788521115.054547:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: 0000000044f479e5/0x411dd0ee4d2d0de1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521115.054555:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: 0000000044f479e5/0x411dd0ee4d2d0de1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521115.054564:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: 0000000044f479e5/0x411dd0ee4d2d0de1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521115.054585:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a886658 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222311040:0@lo:101: 00000100:00100000:2.0:1788521115.054637:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521115.060194:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222311040 00000100:00100000:3.0:1788521115.060217:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222311040 00000100:00100000:2.0:1788521115.060279:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 0000000028cd9c34 going to sleep for 11 seconds 00000100:00100000:3.0:1788521115.060290:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788521115.060303:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000084f293c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+6:6496:x1875400222311040:12345-0@lo:101: 00010000:00010000:3.0:1788521115.060325:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521115.060355:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007b179044/0x411dd0ee4d2d0de8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d0de1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521115.060389:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007b179044/0x411dd0ee4d2d0de8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0de1 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521115.060401:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007b179044/0x411dd0ee4d2d0de8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0de1 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521115.060528:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007b179044, rc 0) 00000100:00100000:3.0:1788521115.060608:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000084f293c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+7:6496:x1875400222311040:12345-0@lo:101: Request processed in 308us (5970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521115.060616:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788521115.066490:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a886658 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222311040:0@lo:101: 00010000:00010000:2.0:1788521115.066532:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: 0000000044f479e5/0x411dd0ee4d2d0de1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0de8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521115.066547:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: 0000000044f479e5/0x411dd0ee4d2d0de1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d0de8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521115.066572:0:6496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788521115.066587:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: 0000000044f479e5/0x411dd0ee4d2d0de1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0de8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521115.066593:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: 0000000044f479e5/0x411dd0ee4d2d0de1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0de8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521115.066601:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788521115.066611:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788521115.066617:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8fef58328000 10000000:01000000:2.0:1788521115.066620:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788521115.066624:0:6496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788521115.066627:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788521115.066664:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: 0000000088ad40b3/0x411dd0ee4d2d0def lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521115.066671:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: 0000000088ad40b3/0x411dd0ee4d2d0def lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521115.066692:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: 0000000088ad40b3/0x411dd0ee4d2d0def lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521115.066730:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a886658 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222311168:0@lo:101: 00000100:00100000:2.0:1788521115.066811:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521115.066857:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 0000000028cd9c34 going to sleep for 11 seconds 00000100:00100000:0.0:1788521115.067165:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222311168 00000100:00100000:0.0:1788521115.067175:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222311168 00000100:00100000:1.0:1788521115.073945:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788521115.073963:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041d56816 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+7:6496:x1875400222311168:12345-0@lo:101: 00010000:00010000:1.0:1788521115.073989:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521115.074014:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000045134775/0x411dd0ee4d2d0df6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d0def expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521115.074052:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000045134775/0x411dd0ee4d2d0df6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0def expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521115.074065:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000045134775/0x411dd0ee4d2d0df6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0def expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521115.074076:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000045134775, rc 0) 00000100:00100000:1.0:1788521115.074219:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041d56816 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+8:6496:x1875400222311168:12345-0@lo:101: Request processed in 260us (7408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521115.074226:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788521115.074364:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a886658 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222311168:0@lo:101: 00010000:00010000:2.0:1788521115.074389:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: 0000000088ad40b3/0x411dd0ee4d2d0def lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0df6 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521115.074398:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: 0000000088ad40b3/0x411dd0ee4d2d0def lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d0df6 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521115.074494:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a886658 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222311296:0@lo:501: 00000100:00100000:2.0:1788521115.074530:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521115.074585:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 0000000028cd9c34 going to sleep for 11 seconds 00000100:00100000:1.0:1788521115.074689:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222311296 00000100:00100000:1.0:1788521115.074696:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222311296 00000100:00100000:1.0:1788521115.074724:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788521115.074730:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6d515db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+8:6496:x1875400222311296:12345-0@lo:501: 00000100:00100000:1.0:1788521115.074870:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6d515db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+9:6496:x1875400222311296:12345-0@lo:501: Request processed in 140us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521115.074878:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788521115.075098:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a886658 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222311296:0@lo:501: 00000100:00100000:2.0:1788521115.075129:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a886658 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222311424:0@lo:503: 00000100:00100000:2.0:1788521115.075169:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521115.075195:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 0000000028cd9c34 going to sleep for 11 seconds 00000100:00100000:1.0:1788521115.076815:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222311424 00000100:00100000:1.0:1788521115.076829:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222311424 00000100:00100000:1.0:1788521115.076942:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788521115.076952:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016af9256 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+9:6496:x1875400222311424:12345-0@lo:503: 00000100:00100000:1.0:1788521115.077139:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016af9256 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+9:6496:x1875400222311424:12345-0@lo:503: Request processed in 188us (1970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521115.077147:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788521115.077296:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a886658 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222311424:0@lo:503: 00000100:00100000:1.0:1788521115.077949:0:6541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bfe38621 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6541:1875400222311552:0@lo:502: 00000100:00100000:1.0:1788521115.078013:0:6541:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521115.078049:0:6541:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d5a5e30 going to sleep for 11 seconds 00000100:00100000:0.0:1788521115.078113:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222311552 00000100:00100000:0.0:1788521115.078119:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222311552 00000100:00100000:0.0:1788521115.078159:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788521115.078166:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d237875 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+9:6541:x1875400222311552:12345-0@lo:502: 00000100:00100000:0.0:1788521115.078288:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d237875 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+9:6541:x1875400222311552:12345-0@lo:502: Request processed in 123us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521115.078296:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788521115.078384:0:6541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bfe38621 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6541:1875400222311552:0@lo:502: 00000020:01000000:2.0:1788521115.078409:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521115.078422:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521115.078426:0:6541:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788521115.078432:0:6541:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788521115.078435:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788521115.078459:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000009330ccf5) 00000020:00000080:2.0:1788521115.078478:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788521115.078484:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788521115.078585:0:6541:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788521115.078594:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x411dd0ee4d2d0e04 00000020:00000080:2.0:1788521115.078881:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788521115.078941:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521115.078944:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521115.078946:0:6541:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788521115.078949:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521115.078952:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521115.078954:0:6541:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788521115.078957:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788521115.078966:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000002d3bae30) 00000020:00000080:2.0:1788521115.078978:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788521115.078982:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788521115.078984:0:6541:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788521115.078987:0:6541:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788521115.078994:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788521115.079052:0:6541:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006b30f12b from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788521115.079068:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000fb13863e) 00000020:00000080:2.0:1788521115.079076:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788521115.079131:0:6541:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788521115.079136:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x411dd0ee4d2d0e19 00000020:00000080:2.0:1788521115.079248:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788521115.079254:0:6541:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788521115.079258:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x411dd0ee4d2d0e20 00080000:01000000:2.0:1788521115.079263:0:6541:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788521115.079265:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x411dd0ee4d2d0e27 00080000:10000000:2.0:1788521115.079745:0:6541:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1788521115.079977:0:6541:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788521115.093784:0:6541:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1788521115.215650:0:6541:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1788521115.216371:0:6541:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1788521115.223959:0:6541:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788521115.224706:0:6541:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788521115.233202:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000b6917c56) 00000020:00000080:0.0:1788521115.233224:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788521115.233321:0:6541:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788521115.233331:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x411dd0ee4d2d0e35 00000020:00000080:1.0:1788521115.234182:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788521115.237492:0:6541:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1788521115.245945:0:6541:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1788521115.258192:0:6541:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1788521115.264335:0:6541:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1788521115.267640:0:6541:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1788521115.270878:0:6541:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1788521115.275190:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x411dd0ee4d2d0e3c 00000020:00000080:0.0:1788521115.276190:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788521115.276207:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521115.276215:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521115.276218:0:6541:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788521115.276221:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521115.276227:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521115.276228:0:6541:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788521115.276231:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788521115.276233:0:6541:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788521115.276235:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521115.276238:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521115.276239:0:6541:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788521115.276241:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521115.276245:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521115.276247:0:6541:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788521115.276252:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788521115.276324:0:6541:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1788521115.276417:0:6541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cae20e3a pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6541:1875400222311680:0@lo:502: 00000100:00100000:2.0:1788521115.277220:0:6541:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521115.277346:0:6541:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c6ba1b0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521115.277426:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222311680 00000100:00100000:3.0:1788521115.277435:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222311680 00000100:00100000:3.0:1788521115.277660:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788521115.277672:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007288039b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+9:6541:x1875400222311680:12345-0@lo:502: 00000100:00100000:3.0:1788521115.277856:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007288039b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+9:6541:x1875400222311680:12345-0@lo:502: Request processed in 186us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521115.277865:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788521115.278092:0:6541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cae20e3a pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6541:1875400222311680:0@lo:502: 00000020:01000000:2.0:1788521115.278129:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521115.278137:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521115.278139:0:6541:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1788521115.278144:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1788521115.278474:0:6496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1788521115.278507:0:6496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788521115.278531:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: 0000000088ad40b3/0x411dd0ee4d2d0def lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0df6 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521115.278553:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: 0000000088ad40b3/0x411dd0ee4d2d0def lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0df6 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521115.278563:0:6496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fef58328000 from 1 10000000:01000000:1.0:1788521115.278566:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788521115.278609:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: 000000004701b9f7/0x411dd0ee4d2d0e43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521115.278617:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: 000000004701b9f7/0x411dd0ee4d2d0e43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521115.278625:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: 000000004701b9f7/0x411dd0ee4d2d0e43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521115.278645:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002f6d8b65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222311808:0@lo:101: 00000100:00100000:1.0:1788521115.278702:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521115.279229:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 000000001e31a0a9 going to sleep for 11 seconds 00000100:00100000:0.0:1788521115.279572:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222311808 00000100:00100000:0.0:1788521115.279582:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222311808 00000100:00100000:0.0:1788521115.279627:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788521115.279636:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac1386fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+9:6496:x1875400222311808:12345-0@lo:101: 00010000:00010000:0.0:1788521115.279652:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521115.279673:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007ab5ba49/0x411dd0ee4d2d0e4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d0e43 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521115.279716:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007ab5ba49/0x411dd0ee4d2d0e4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0e43 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521115.279729:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007ab5ba49/0x411dd0ee4d2d0e4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0e43 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521115.279739:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007ab5ba49, rc 0) 00000100:00100000:0.0:1788521115.279809:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac1386fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+10:6496:x1875400222311808:12345-0@lo:101: Request processed in 174us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521115.279816:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788521115.280144:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002f6d8b65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222311808:0@lo:101: 00010000:00010000:1.0:1788521115.280164:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: 000000004701b9f7/0x411dd0ee4d2d0e43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0e4a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521115.280174:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: 000000004701b9f7/0x411dd0ee4d2d0e43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d0e4a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521115.280781:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002f6d8b65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222311936:0@lo:256: 00000100:00100000:1.0:1788521115.280845:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521115.281055:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 000000001e31a0a9 going to sleep for 11 seconds 00000100:00100000:0.0:1788521115.281279:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222311936 00000100:00100000:0.0:1788521115.281287:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222311936 00000100:00100000:0.0:1788521115.281326:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788521115.281333:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d040b6fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+10:6496:x1875400222311936:12345-0@lo:256: 20000000:01000000:0.0:1788521115.281354:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788521115.281361:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788521115.281465:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d040b6fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+10:6496:x1875400222311936:12345-0@lo:256: Request processed in 132us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521115.281481:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788521115.281660:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002f6d8b65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222311936:0@lo:256: 10000000:01000000:1.0:1788521115.282382:0:6496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788521115.282415:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: 000000004701b9f7/0x411dd0ee4d2d0e43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0e4a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521115.282428:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: 000000004701b9f7/0x411dd0ee4d2d0e43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0e4a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521115.282437:0:6496:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fef58328000 from 1 10000000:01000000:1.0:1788521115.282637:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788521115.282679:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: 000000000a6c2f7b/0x411dd0ee4d2d0e51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521115.282687:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: 000000000a6c2f7b/0x411dd0ee4d2d0e51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521115.282696:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: 000000000a6c2f7b/0x411dd0ee4d2d0e51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521115.282716:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002f6d8b65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222312064:0@lo:101: 00000100:00100000:1.0:1788521115.282770:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521115.282809:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 000000001e31a0a9 going to sleep for 11 seconds 00000100:00100000:0.0:1788521115.282993:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222312064 00000100:00100000:0.0:1788521115.283002:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222312064 00000100:00100000:0.0:1788521115.283040:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788521115.283048:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032a8565b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+10:6496:x1875400222312064:12345-0@lo:101: 00010000:00010000:0.0:1788521115.283060:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521115.283076:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a3e1913a/0x411dd0ee4d2d0e58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d0e51 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521115.283101:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a3e1913a/0x411dd0ee4d2d0e58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0e51 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521115.283112:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a3e1913a/0x411dd0ee4d2d0e58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0e51 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521115.283121:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a3e1913a, rc 0) 00000100:00100000:0.0:1788521115.283166:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032a8565b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+11:6496:x1875400222312064:12345-0@lo:101: Request processed in 118us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521115.283173:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788521115.283265:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002f6d8b65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222312064:0@lo:101: 00010000:00010000:1.0:1788521115.283280:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: 000000000a6c2f7b/0x411dd0ee4d2d0e51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0e58 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521115.283289:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: 000000000a6c2f7b/0x411dd0ee4d2d0e51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d0e58 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521115.283378:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002f6d8b65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222312192:0@lo:501: 00000100:00100000:1.0:1788521115.283407:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521115.283565:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 000000001e31a0a9 going to sleep for 11 seconds 00000100:00100000:3.0:1788521115.283652:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222312192 00000100:00100000:3.0:1788521115.283659:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222312192 00000100:00100000:2.0:1788521115.283798:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788521115.283810:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb30e4c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+11:6496:x1875400222312192:12345-0@lo:501: 00000100:00100000:2.0:1788521115.284045:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb30e4c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+11:6496:x1875400222312192:12345-0@lo:501: Request processed in 239us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521115.284054:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788521115.284135:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002f6d8b65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222312192:0@lo:501: 00000100:00100000:1.0:1788521115.284173:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002f6d8b65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222312320:0@lo:503: 00000100:00100000:1.0:1788521115.284222:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521115.284472:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 000000001e31a0a9 going to sleep for 11 seconds 00000100:00100000:0.0:1788521115.284568:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222312320 00000100:00100000:0.0:1788521115.284575:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222312320 00000100:00100000:1.0:1788521115.284833:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788521115.284841:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af50e291 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+11:6496:x1875400222312320:12345-0@lo:503: 00000040:00080000:1.0:1788521115.284995:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788521115.285055:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af50e291 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+11:6496:x1875400222312320:12345-0@lo:503: Request processed in 216us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521115.285062:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788521115.285147:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002f6d8b65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222312320:0@lo:503: 00000040:00080000:2.0:1788521115.286145:0:6545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788521115.286374:0:6496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788521115.286401:0:6496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788521115.286427:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: 000000000a6c2f7b/0x411dd0ee4d2d0e51 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0e58 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521115.286449:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: 000000000a6c2f7b/0x411dd0ee4d2d0e51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0e58 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521115.286530:0:6496:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788521115.286534:0:6496:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8fef58328000 10000000:01000000:0.0:1788521115.286537:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8fef58328000 10000000:01000000:0.0:1788521115.286541:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788521115.286548:0:6496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fef58328000 from 1 10000000:01000000:0.0:1788521115.286551:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788521115.286591:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: 000000003b108ba2/0x411dd0ee4d2d0e5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521115.286599:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: 000000003b108ba2/0x411dd0ee4d2d0e5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521115.286610:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: 000000003b108ba2/0x411dd0ee4d2d0e5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521115.286635:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063596f98 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222312448:0@lo:101: 00000100:00100000:0.0:1788521115.286707:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521115.287221:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 000000001ee91881 going to sleep for 11 seconds 00000100:00100000:3.0:1788521115.287300:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222312448 00000100:00100000:3.0:1788521115.287310:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222312448 00000100:00100000:3.0:1788521115.287358:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788521115.287366:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005bae98af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+11:6496:x1875400222312448:12345-0@lo:101: 00010000:00010000:3.0:1788521115.287382:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521115.287399:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005e41df99/0x411dd0ee4d2d0e66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d0e5f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521115.287428:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005e41df99/0x411dd0ee4d2d0e66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0e5f expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521115.287439:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005e41df99/0x411dd0ee4d2d0e66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0e5f expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521115.287448:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005e41df99, rc 0) 00000100:00100000:3.0:1788521115.287506:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005bae98af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:6496:x1875400222312448:12345-0@lo:101: Request processed in 141us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521115.287513:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788521115.287618:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063596f98 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222312448:0@lo:101: 00010000:00010000:0.0:1788521115.287635:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: 000000003b108ba2/0x411dd0ee4d2d0e5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0e66 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521115.287647:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: 000000003b108ba2/0x411dd0ee4d2d0e5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d0e66 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521115.287744:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063596f98 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222312576:0@lo:501: 00000100:00100000:0.0:1788521115.287778:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521115.287810:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 000000001ee91881 going to sleep for 11 seconds 00000100:00100000:3.0:1788521115.287866:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222312576 00000100:00100000:3.0:1788521115.287871:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222312576 00000100:00100000:3.0:1788521115.288003:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788521115.288012:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000638f418c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:6496:x1875400222312576:12345-0@lo:501: 00000100:00100000:3.0:1788521115.288164:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000638f418c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:6496:x1875400222312576:12345-0@lo:501: Request processed in 154us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521115.288171:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788521115.288260:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063596f98 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222312576:0@lo:501: 00000100:00100000:0.0:1788521115.288293:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063596f98 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222312704:0@lo:503: 00000100:00100000:0.0:1788521115.288330:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521115.288359:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 000000001ee91881 going to sleep for 11 seconds 00000100:00100000:1.0:1788521115.288422:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222312704 00000100:00100000:1.0:1788521115.288428:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222312704 00000100:00100000:1.0:1788521115.288452:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788521115.288458:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ae05dbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:6496:x1875400222312704:12345-0@lo:503: 00000100:00100000:1.0:1788521115.288544:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ae05dbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:6496:x1875400222312704:12345-0@lo:503: Request processed in 87us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521115.288552:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788521115.288657:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063596f98 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222312704:0@lo:503: 00000100:00100000:0.0:1788521115.289221:0:6546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063596f98 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6546:1875400222312832:0@lo:502: 00000100:00100000:0.0:1788521115.289270:0:6546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521115.289302:0:6546:0:(client.c:2716:ptlrpc_set_wait()) set 000000005a7c6ba5 going to sleep for 11 seconds 00000100:00100000:1.0:1788521115.289351:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222312832 00000100:00100000:1.0:1788521115.289357:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222312832 00000100:00100000:1.0:1788521115.289433:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788521115.289441:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b396b410 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:6546:x1875400222312832:12345-0@lo:502: 00000100:00100000:1.0:1788521115.289547:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b396b410 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:6546:x1875400222312832:12345-0@lo:502: Request processed in 107us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521115.289560:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788521115.289629:0:6546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063596f98 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6546:1875400222312832:0@lo:502: 00000020:01000004:0.0:1788521115.289692:0:6546:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788521115.289709:0:6546:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000000d5ba215) 00000020:00000080:0.0:1788521115.289733:0:6546:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788521115.289838:0:6546:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006b30f12b from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788521115.289844:0:6546:0:(tgt_mount.c:187:server_put_mount()) put mount 000000006b30f12b from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788521115.289847:0:6546:0:(obd_mount.c:710:lustre_put_lsi()) put 000000006b30f12b 4 00010000:00080000:0.0:1788521115.289910:0:6546:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002e69490a@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.141@tcp at head 00010000:00010000:0.0:1788521115.293783:0:6546:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788521115.294245:0:6546:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788521115.294296:0:6546:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788521115.294313:0:6546:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x411dd0ee4d2d0e74 00000100:00080000:0.0:1788521115.294326:0:6546:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788521115.294332:0:6546:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000002e69490a using connection 192.168.203.141@tcp/0@lo 00000100:00100000:0.0:1788521115.294380:0:6546:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000063596f98 x1875400222312960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788521115.294402:0:6546:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788521115.294533:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063596f98 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875400222312960:0@lo:38: 00000100:00100000:3.0:1788521115.294625:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521115.294828:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222312960 00000100:00100000:0.0:1788521115.294838:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222312960 00000100:00100000:0.0:1788521115.294905:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788521115.295030:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a86a84e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875400222312960:12345-0@lo:38: 00000100:00100000:0.0:1788521115.296030:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a86a84e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875400222312960:12345-0@lo:38: Request processed in 1112us (1402us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788521115.296041:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788521115.300828:0:6546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003d96bc4a pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6546:1875400222313088:0@lo:502: 00000100:00100000:1.0:1788521115.300986:0:6546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521115.301046:0:6546:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b36da4a3 going to sleep for 11 seconds 00000100:00100000:3.0:1788521115.301489:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788521115.301500:0:3642:0:(import.c:65:import_set_state_nolock()) 000000002e69490a lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788521115.301505:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788521115.301509:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063596f98 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875400222312960:0@lo:38: 00000100:00100000:0.0:1788521115.301613:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222313088 00000100:00100000:0.0:1788521115.301622:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222313088 00000100:00100000:0.0:1788521115.301678:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788521115.301686:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000498660f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:6546:x1875400222313088:12345-0@lo:502: 00000100:00100000:0.0:1788521115.301835:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000498660f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:6546:x1875400222313088:12345-0@lo:502: Request processed in 150us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521115.301843:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788521115.302899:0:6546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003d96bc4a pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6546:1875400222313088:0@lo:502: 00000040:00080000:1.0:1788521115.303070:0:6546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1788521115.303280:0:6496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1788521115.303306:0:6496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788521115.303334:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: 000000003b108ba2/0x411dd0ee4d2d0e5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0e66 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521115.303347:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: 000000003b108ba2/0x411dd0ee4d2d0e5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0e66 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788521115.303410:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788521115.303412:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788521115.303414:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788521115.303415:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788521115.303416:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788521115.303417:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788521115.303419:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788521115.303421:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788521115.303422:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788521115.303424:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788521115.303425:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788521115.303427:0:6496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788521115.303436:0:6496:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1788521115.303438:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788521115.303440:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788521115.303440:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788521115.303441:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788521115.303442:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788521115.303443:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788521115.303444:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788521115.303445:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788521115.303446:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788521115.303446:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788521115.303447:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788521115.303448:0:6496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788521115.303480:0:6496:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788521115.303499:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014a721bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222313216:0@lo:253: 00000100:00100000:3.0:1788521115.303569:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521115.303608:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 00000000434a2c83 going to sleep for 11 seconds 00000100:00100000:3.0:1788521115.307447:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222313216 00000100:00100000:3.0:1788521115.307470:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222313216 00000100:00100000:3.0:1788521115.307556:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788521115.307567:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027bf5e7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:6496:x1875400222313216:12345-0@lo:253: 20000000:01000000:3.0:1788521115.307615:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788521115.307632:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788521115.315394:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788521115.315419:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788521115.315849:0:6535:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788521115.315856:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788521115.315903:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ad16ccfe/0x411dd0ee4d2d0e7b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521115.316111:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027bf5e7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:6496:x1875400222313216:12345-0@lo:253: Request processed in 8540us (12536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521115.316125:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1788521115.316846:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007ab5ba49/0x411dd0ee4d2d0e4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0e43 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521115.316858:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ad16ccfe/0x411dd0ee4d2d0e7b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521115.317866:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007ab5ba49/0x411dd0ee4d2d0e4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d0e43 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521115.317992:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007ab5ba49/0x411dd0ee4d2d0e4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0e43 expref: 11 pid: 6513 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521115.318038:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001beae098 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1875400222313344:0@lo:104: 00000100:00100000:2.0:1788521115.318060:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014a721bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6496:1875400222313216:0@lo:253: 10000000:01000000:2.0:1788521115.318079:0:6496:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000100:00100000:0.0:1788521115.318115:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1788521115.318160:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788521115.318162:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788521115.318164:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521115.318166:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521115.318167:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521115.318169:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521115.318170:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788521115.318172:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000100:00100000:0.0:1788521115.318173:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set 00000000503ad32e going to sleep for 11 seconds 00000020:01000004:2.0:1788521115.318174:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788521115.318177:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788521115.318187:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521115.318188:0:6496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788521115.318208:0:6496:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788521115.320452:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222313344 00000100:00100000:3.0:1788521115.320471:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222313344 00000100:00100000:3.0:1788521115.320551:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788521115.320561:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b023fa20 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:6535:x1875400222313344:12345-0@lo:104: 00010000:00010000:3.0:1788521115.320585:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: 000000004701b9f7/0x411dd0ee4d2d0e43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0e4a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521115.322365:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788521115.322385:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b023fa20 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:6535:x1875400222313344:12345-0@lo:104: Request processed in 1821us (4266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521115.322425:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788521115.322494:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521115.322502:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: 000000004701b9f7/0x411dd0ee4d2d0e43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0e4a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521115.322514:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004701b9f7 already unused, calling callback (000000003f0cc38c) 10000000:00010000:3.0:1788521115.322519:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: 000000004701b9f7/0x411dd0ee4d2d0e43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d0e4a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521115.322530:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: 000000004701b9f7/0x411dd0ee4d2d0e43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d0e4a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521115.322539:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: 000000004701b9f7/0x411dd0ee4d2d0e43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d0e4a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521115.322545:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788521115.322600:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: 000000004701b9f7/0x411dd0ee4d2d0e43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0e4a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521115.322608:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521115.322630:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: 000000004701b9f7/0x411dd0ee4d2d0e43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0e4a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521115.322637:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: 000000004701b9f7/0x411dd0ee4d2d0e43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0e4a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521115.322674:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521115.322683:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521115.322685:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521115.322785:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd16cab7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222313472:0@lo:103: 00000100:00100000:1.0:1788521115.324117:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001beae098 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1875400222313344:0@lo:104: 00010000:00010000:1.0:1788521115.324155:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ad16ccfe/0x411dd0ee4d2d0e7b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521115.324647:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521115.325811:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222313472 00000100:00100000:3.0:1788521115.325824:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222313472 00010000:00010000:3.0:1788521115.325870:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007ab5ba49/0x411dd0ee4d2d0e4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0e43 expref: 12 pid: 6513 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521115.325944:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788521115.325956:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d53f6756 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:3644:x1875400222313472:12345-0@lo:103: 00010000:00010000:3.0:1788521115.325974:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521115.325980:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007ab5ba49/0x411dd0ee4d2d0e4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0e43 expref: 12 pid: 6513 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521115.325994:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007ab5ba49/0x411dd0ee4d2d0e4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0e43 expref: 12 pid: 6513 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521115.326016:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007ab5ba49/0x411dd0ee4d2d0e4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d0e43 expref: 12 pid: 6513 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521115.326034:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ad16ccfe/0x411dd0ee4d2d0e7b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521115.326043:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ad16ccfe/0x411dd0ee4d2d0e7b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788521115.326061:0:6504:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010206398s 00010000:00010000:3.0:1788521115.326066:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ad16ccfe/0x411dd0ee4d2d0e7b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521115.326073:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ad16ccfe/0x411dd0ee4d2d0e7b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521115.326097:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ad16ccfe/0x411dd0ee4d2d0e7b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521115.326104:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ad16ccfe/0x411dd0ee4d2d0e7b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521115.326110:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ad16ccfe already unused, calling callback (0000000099446ad8) 00010000:00010000:3.0:1788521115.326115:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ad16ccfe/0x411dd0ee4d2d0e7b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521115.326124:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ad16ccfe/0x411dd0ee4d2d0e7b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521115.326149:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ad16ccfe/0x411dd0ee4d2d0e7b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521115.326163:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788521115.326169:0:6535:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ad16ccfe/0x411dd0ee4d2d0e7b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521115.326181:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ad16ccfe/0x411dd0ee4d2d0e7b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521115.326188:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ad16ccfe/0x411dd0ee4d2d0e7b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521115.326240:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d53f6756 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+11:3644:x1875400222313472:12345-0@lo:103: Request processed in 287us (1594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521115.326248:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788521115.327776:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd16cab7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222313472:0@lo:103: 00080000:10000000:2.0:1788521115.336415:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1788521115.339959:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788521115.343503:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1788521115.344009:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788521115.344247:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1788521115.344414:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1788521115.348511:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1788521115.348706:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1788521115.349228:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1788521115.349395:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1788521115.349973:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1788521115.350154:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1788521115.358482:0:6496:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788521115.373046:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788521115.373309:0:6551:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788521115.373314:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788521115.373455:0:6552:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788521115.375141:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788521115.375311:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788521115.375739:0:6496:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788521115.375748:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788521115.375853:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788521115.376860:0:6496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788521115.378265:0:6496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788521115.378340:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788521115.378644:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788521115.378974:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1788521115.379765:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788521115.379954:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788521115.380155:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788521115.380286:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788521115.380424:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788521115.380558:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788521115.380744:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788521115.382145:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788521115.386848:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788521115.387102:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788521115.387269:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788521115.391773:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788521115.392008:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788521115.392150:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788521115.392282:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788521115.396908:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788521115.397288:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788521115.397448:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788521115.397585:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788521115.397715:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788521115.397856:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788521115.398043:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788521115.398170:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788521115.398313:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788521115.398459:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788521115.398604:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788521115.398739:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00000040:00080000:2.0:1788521115.398746:0:6552:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:0.0:1788521115.398863:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788521115.399042:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788521115.403645:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788521115.404025:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788521115.404212:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788521115.404451:0:6496:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788521115.411297:0:6552:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788521115.411413:0:6552:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788521115.411688:0:6552:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:0.0:1788521115.423173:0:6496:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788521115.423227:0:6496:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa9e3419d3988 00100000:10000000:0.0:1788521115.423238:0:6496:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788521115.424198:0:6496:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788521115.424223:0:6496:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.141@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788521115.424251:0:6496:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788521115.424275:0:6496:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788521115.425212:0:6496:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788521115.425400:0:6496:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788521115.853111:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521116.877014:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521117.905024:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521118.933196:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521119.949057:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788521120.385015:0:6797:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg341-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1788521120.405331:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788521120.405343:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788521120.405347:0:38:0:(import.c:65:import_set_state_nolock()) 000000002e69490a lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788521120.405365:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000002e69490a using connection 192.168.203.141@tcp/0@lo 00000100:00100000:2.0:1788521120.405390:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009f15b834 x1875400222313728/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788521120.405641:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a886658 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222313600:0@lo:400: 00000100:00100000:1.0:1788521120.405739:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521120.405848:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222313600 00000100:00100000:1.0:1788521120.405873:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222313600 00000100:00100000:1.0:1788521120.406374:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788521120.406387:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000957d70e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+11:3645:x1875400222313600:12345-0@lo:400: 00000100:00100000:1.0:1788521120.406483:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000957d70e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+11:3645:x1875400222313600:12345-0@lo:400: Request processed in 99us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521120.406492:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788521120.406734:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a886658 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222313600:0@lo:400: 00000100:00100000:2.0:1788521120.406860:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009f15b834 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875400222313728:0@lo:38: 00000100:00100000:2.0:1788521120.407025:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521120.410090:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222313728 00000100:00100000:1.0:1788521120.410115:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222313728 00000100:00100000:1.0:1788521120.410367:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788521120.410376:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000feae5ef1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875400222313728:12345-0@lo:38: 00010000:00080000:1.0:1788521120.410419:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:1.0:1788521120.410671:0:6521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x411dd0ee4d2d0e82 00000004:00100000:1.0:1788521120.410737:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788521120.410973:0:6521:0:(import.c:65:import_set_state_nolock()) 000000005b9c082a : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788521120.411100:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000feae5ef1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875400222313728:12345-0@lo:38: Request processed in 721us (4074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521120.411110:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788521120.411133:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009f15b834 x1875400222313728/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788521130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788521120.411153:0:3642:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788521120.411162:0:3642:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788521120.411168:0:3642:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788521120.411170:0:3642:0:(import.c:65:import_set_state_nolock()) 000000002e69490a lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788521120.411177:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009f15b834 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875400222313728:0@lo:38: 00010000:00010000:3.0:1788521120.981564:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788521121.415395:0:6849:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788521121.415625:0:6849:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788521121.998539:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788521122.957214:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788521122.957225:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fef58328000 from 3 10000000:01000000:1.0:1788521122.957232:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788521122.957297:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: 000000009a8f2ee6/0x411dd0ee4d2d0e89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521122.957311:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: 000000009a8f2ee6/0x411dd0ee4d2d0e89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521122.957323:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: 000000009a8f2ee6/0x411dd0ee4d2d0e89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521122.957374:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003d96bc4a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222313856:0@lo:101: 00000100:00100000:1.0:1788521122.957485:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521122.957582:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a94c6b1f going to sleep for 11 seconds 00000100:00100000:2.0:1788521122.960989:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222313856 00000100:00100000:2.0:1788521122.961014:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222313856 00000100:00100000:2.0:1788521122.961116:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788521122.961130:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca34320b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+11:6517:x1875400222313856:12345-0@lo:101: 00010000:00010000:2.0:1788521122.961155:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521122.961188:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008b28f129/0x411dd0ee4d2d0e90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d0e89 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521122.961254:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008b28f129/0x411dd0ee4d2d0e90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0e89 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521122.961268:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008b28f129/0x411dd0ee4d2d0e90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0e89 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521122.961280:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008b28f129, rc 0) 00000100:00100000:2.0:1788521122.961401:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca34320b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:6517:x1875400222313856:12345-0@lo:101: Request processed in 274us (3916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521122.961409:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788521122.966060:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003d96bc4a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222313856:0@lo:101: 00010000:00010000:1.0:1788521122.966107:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: 000000009a8f2ee6/0x411dd0ee4d2d0e89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0e90 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521122.966123:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: 000000009a8f2ee6/0x411dd0ee4d2d0e89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d0e90 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521122.966228:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003d96bc4a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222313984:0@lo:256: 00000100:00100000:1.0:1788521122.966315:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521122.966386:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a94c6b1f going to sleep for 11 seconds 00000100:00100000:3.0:1788521122.970243:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222313984 00000100:00100000:3.0:1788521122.970272:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222313984 00000100:00100000:3.0:1788521122.970391:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788521122.970402:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8935fbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:6517:x1875400222313984:12345-0@lo:256: 20000000:01000000:3.0:1788521122.970438:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788521122.970457:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788521122.970461:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788521122.970634:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8935fbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:6517:x1875400222313984:12345-0@lo:256: Request processed in 234us (4319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521122.970643:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788521122.970916:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003d96bc4a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222313984:0@lo:256: 10000000:01000000:1.0:1788521122.970985:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788521122.970996:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: 000000009a8f2ee6/0x411dd0ee4d2d0e89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0e90 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521122.971009:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: 000000009a8f2ee6/0x411dd0ee4d2d0e89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0e90 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521123.021241:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521124.048291:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788521124.552789:0:6951:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788521124.553471:0:6951:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788521125.070782:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521125.523952:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788521125.523993:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eeecb731 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222314112:0@lo:400: 00000100:00100000:3.0:1788521125.524090:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521125.524154:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000037e7c635 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222314240:0@lo:400: 00000100:00100000:3.0:1788521125.524183:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521125.524450:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222314112 00000100:00100000:3.0:1788521125.524460:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222314112 00000100:00100000:3.0:1788521125.524526:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788521125.524535:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037011cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:3645:x1875400222314112:12345-0@lo:400: 00000100:00100000:3.0:1788521125.524601:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037011cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:3645:x1875400222314112:12345-0@lo:400: Request processed in 67us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521125.524608:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788521125.524655:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222314240 00000100:00100000:3.0:1788521125.524659:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222314240 00000100:00100000:3.0:1788521125.524696:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788521125.524702:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000893691be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222314240:12345-0@lo:400: 00000100:00100000:3.0:1788521125.524738:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000893691be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222314240:12345-0@lo:400: Request processed in 37us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521125.524754:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788521125.524790:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eeecb731 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222314112:0@lo:400: 00010000:00080000:3.0:1788521125.524818:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000037e7c635 x1875400222314240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521125.524831:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000037e7c635 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222314240:0@lo:400: 00010000:00010000:0.0:1788521126.103200:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521127.117154:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521128.142611:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521129.166353:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521130.191471:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521130.639215:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521130.639239:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009f15b834 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222314368:0@lo:400: 00000100:00100000:2.0:1788521130.639309:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521130.639362:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000038b58c7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222314496:0@lo:400: 00000100:00100000:2.0:1788521130.639389:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521130.639428:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222314368 00000100:00100000:2.0:1788521130.639435:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222314368 00000100:00100000:2.0:1788521130.639480:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788521130.639487:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1a37ff3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:3643:x1875400222314368:12345-0@lo:400: 00000100:00100000:2.0:1788521130.639533:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1a37ff3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:3643:x1875400222314368:12345-0@lo:400: Request processed in 46us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521130.639539:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788521130.639576:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222314496 00000100:00100000:2.0:1788521130.639579:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222314496 00000100:00100000:2.0:1788521130.639607:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788521130.639622:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5eb4211 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222314496:12345-0@lo:400: 00000100:00100000:2.0:1788521130.639656:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5eb4211 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222314496:12345-0@lo:400: Request processed in 35us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521130.639663:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788521130.639699:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000038b58c7a x1875400222314496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521130.639712:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000038b58c7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222314496:0@lo:400: 00000100:00100000:2.0:1788521130.639735:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009f15b834 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222314368:0@lo:400: 00010000:00010000:2.0:1788521131.218481:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521132.237127:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521133.264671:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521134.286365:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521135.309081:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788521135.674740:0:7449:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788521135.674744:0:7449:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788521135.674746:0:7449:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788521135.674942:0:7449:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000074d0882c 00000020:01000004:2.0:1788521135.674959:0:7449:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1788521135.674971:0:7449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788521135.674991:0:7449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000f87eb049) 00000020:00000080:2.0:1788521135.675008:0:7449:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788521135.737859:0:7449:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:0.0:1788521135.737960:0:7449:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00000100:00100000:0.0:1788521135.757756:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a9465373 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222314624:0@lo:400: 00000100:00100000:2.0:1788521135.757815:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c3ec9152 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222314752:0@lo:400: 00000100:00100000:2.0:1788521135.762011:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521135.762102:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222314752 00000100:00100000:2.0:1788521135.762111:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222314752 00000100:00100000:0.0:1788521135.763608:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521135.763751:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222314624 00000100:00100000:0.0:1788521135.763761:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222314624 00000100:00100000:0.0:1788521135.763829:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788521135.763838:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ee5efa7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:3646:x1875400222314624:12345-0@lo:400: 00000100:00100000:0.0:1788521135.763948:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ee5efa7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:3646:x1875400222314624:12345-0@lo:400: Request processed in 110us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521135.763956:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788521135.764027:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a9465373 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222314624:0@lo:400: 00000100:00100000:2.0:1788521135.764806:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788521135.764819:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f15b834 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222314752:12345-0@lo:400: 00000100:00100000:2.0:1788521135.764933:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f15b834 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222314752:12345-0@lo:400: Request processed in 118us (2936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521135.764941:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788521135.765021:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c3ec9152 x1875400222314752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521135.765035:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c3ec9152 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222314752:0@lo:400: 00080000:01000000:0.0:1788521135.787062:0:7449:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788521135.787271:0:7449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1788521135.787282:0:7449:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788521135.787294:0:7449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x411dd0ee4d2d0e9e 00000020:01000004:0.0:1788521135.787301:0:7449:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788521135.787323:0:7449:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.141@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788521135.787326:0:7449:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788521135.787332:0:7449:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1788521135.787361:0:7449:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1788521135.787365:0:7449:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.141@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788521135.807685:0:7449:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.141@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788521135.807722:0:7449:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.141@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1788521135.807727:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788521135.807729:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788521135.807730:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521135.807731:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521135.807732:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521135.807734:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521135.807735:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788521135.807736:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788521135.807737:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788521135.807739:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521135.807740:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788521135.807743:0:7449:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1788521135.807745:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788521135.807746:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788521135.807748:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521135.807749:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521135.807750:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521135.807751:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521135.807752:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788521135.807753:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788521135.807754:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788521135.807755:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521135.807756:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788521135.807793:0:7449:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788521135.807809:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000038b58c7a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222314880:0@lo:253: 00000100:00100000:2.0:1788521135.807878:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521135.807942:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222314880 00000100:00100000:2.0:1788521135.807949:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222314880 00000100:00100000:2.0:1788521135.807996:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788521135.808003:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fad51c77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:7449:x1875400222314880:12345-0@lo:253: 20000000:01000000:2.0:1788521135.808041:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788521135.808045:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1788521135.808050:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1788521135.808053:0:6514:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1788521135.808084:0:6514:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:2.0:1788521135.811733:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788521135.811984:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788521135.812000:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788521135.812019:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1788521135.812035:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1788521135.812051:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1788521135.812119:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:2.0:1788521135.812127:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:2.0:1788521135.812137:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:2.0:1788521135.812142:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:2.0:1788521135.812152:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:2.0:1788521135.812156:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:2.0:1788521135.812168:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1788521135.812182:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1788521135.812289:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:2.0:1788521135.812298:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.141@tcp (null) (null) (null) 00000040:00080000:2.0:1788521135.812312:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:2.0:1788521135.812317:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788521135.812328:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:2.0:1788521135.812333:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.141@tcp (null) (null) 00000040:00080000:2.0:1788521135.812345:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:2.0:1788521135.812350:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788521135.812361:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1788521135.812374:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000100:00100000:3.0:1788521135.812377:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000904a8496 going to sleep for 11 seconds 00000040:00080000:2.0:1788521135.812382:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1788521135.812465:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:2.0:1788521135.812474:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:2.0:1788521135.812489:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1788521135.812503:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1788521135.812519:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:2.0:1788521135.812524:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:2.0:1788521135.812535:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1788521135.812555:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1788521135.812561:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1788521135.812581:0:6514:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788521135.812588:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:1.0:1788521135.813349:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1788521135.813553:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788521135.813577:0:6514:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.141@tcp for mdt 20000000:01000000:3.0:1788521135.813579:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.141@tcp (null) (null) (null) 00000040:00080000:3.0:1788521135.813595:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1788521135.813604:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788521135.813617:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788521135.813623:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.141@tcp (null) (null) 00000040:00080000:3.0:1788521135.813639:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788521135.813647:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1788521135.813659:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1788521135.813674:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1788521135.813722:0:6514:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1788521135.813730:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:1.0:1788521135.816108:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1788521135.816493:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1788521135.816520:0:6514:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.141@tcp for mdt 20000000:01000000:3.0:1788521135.816522:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.141@tcp (null) (null) (null) 00000040:00080000:3.0:1788521135.816539:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1788521135.816559:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788521135.816589:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1788521135.816596:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.141@tcp (null) (null) 00000040:00080000:3.0:1788521135.816610:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1788521135.816618:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1788521135.816631:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1788521135.816647:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1788521135.816669:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788521135.816672:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788521135.816676:0:6514:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788521135.816742:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788521135.816744:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788521135.818326:0:7457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1788521135.818364:0:7457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1788521135.818378:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788521135.819137:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1788521135.819164:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1788521135.819180:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1788521135.819197:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788521135.819199:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788521135.820460:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1788521135.820498:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1788521135.820515:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788521135.821038:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788521135.821063:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788521135.821088:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788521135.821099:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788521135.821100:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788521135.821431:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788521135.821445:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788521135.821465:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:2.0:1788521135.821586:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1788521135.821683:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1788521135.821709:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:2.0:1788521135.821723:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788521135.821725:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788521135.821729:0:6514:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788521135.821735:0:6514:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788521135.822202:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1788521135.822318:0:6514:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788521135.832124:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788521135.832158:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ff501c36/0x411dd0ee4d2d0ea5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521135.832194:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f95e50c5/0x411dd0ee4d2d0dda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0dd3 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521135.832201:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000045134775/0x411dd0ee4d2d0df6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0def expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521135.832206:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005e41df99/0x411dd0ee4d2d0e66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0e5f expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521135.832212:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ff501c36/0x411dd0ee4d2d0ea5 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521135.832256:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005e41df99/0x411dd0ee4d2d0e66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d0e5f expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521135.832270:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005e41df99/0x411dd0ee4d2d0e66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0e5f expref: 12 pid: 6512 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521135.832284:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005e389d81 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1875400222315008:0@lo:104: 00000100:00100000:2.0:1788521135.832347:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788521135.832456:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000045134775/0x411dd0ee4d2d0df6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d0def expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521135.832464:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000045134775/0x411dd0ee4d2d0df6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0def expref: 12 pid: 6514 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521135.832471:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c1620890 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1875400222315136:0@lo:104: 00000100:00100000:2.0:1788521135.832493:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788521135.832515:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f95e50c5/0x411dd0ee4d2d0dda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d0dd3 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521135.832528:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f95e50c5/0x411dd0ee4d2d0dda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0dd3 expref: 12 pid: 6513 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521135.832547:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a49617ea pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1875400222315264:0@lo:104: 00000100:00100000:2.0:1788521135.832570:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521135.832580:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set 00000000441219db going to sleep for 11 seconds 00000100:00100000:3.0:1788521135.832646:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222315008 00000100:00100000:3.0:1788521135.832655:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222315008 00000100:00100000:3.0:1788521135.832695:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222315136 00000100:00100000:3.0:1788521135.832698:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222315136 00000100:00100000:3.0:1788521135.832708:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222315264 00000100:00100000:3.0:1788521135.832710:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222315264 00000100:00100000:3.0:1788521135.832817:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788521135.832843:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098b1f02a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+5:6514:x1875400222315008:12345-0@lo:104: 00010000:00010000:3.0:1788521135.832928:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: 000000003b108ba2/0x411dd0ee4d2d0e5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0e66 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521135.833066:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788521135.833073:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098b1f02a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+5:6514:x1875400222315008:12345-0@lo:104: Request processed in 243us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521135.833081:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788521135.833111:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788521135.833118:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002fc4a9e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+4:6514:x1875400222315136:12345-0@lo:104: 00010000:00010000:3.0:1788521135.833126:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: 0000000088ad40b3/0x411dd0ee4d2d0def lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0df6 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521135.833177:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788521135.833192:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002fc4a9e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+4:6514:x1875400222315136:12345-0@lo:104: Request processed in 76us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521135.833198:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788521135.833212:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788521135.833219:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a6670e3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:6514:x1875400222315264:12345-0@lo:104: 00010000:00010000:3.0:1788521135.833227:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: 00000000e4943218/0x411dd0ee4d2d0dd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0dda expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521135.833256:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788521135.833260:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a6670e3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:6514:x1875400222315264:12345-0@lo:104: Request processed in 43us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521135.833265:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788521135.833289:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788521135.833295:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: 000000003b108ba2/0x411dd0ee4d2d0e5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0e66 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521135.833309:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003b108ba2 already unused, calling callback (000000003f0cc38c) 10000000:00010000:3.0:1788521135.833313:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: 000000003b108ba2/0x411dd0ee4d2d0e5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d0e66 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521135.833321:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: 000000003b108ba2/0x411dd0ee4d2d0e5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d0e66 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521135.833328:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: 000000003b108ba2/0x411dd0ee4d2d0e5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d0e66 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521135.833334:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788521135.833375:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: 000000003b108ba2/0x411dd0ee4d2d0e5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0e66 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521135.833382:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005e389d81 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1875400222315008:0@lo:104: 00010000:00010000:3.0:1788521135.833386:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521135.833408:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: 000000003b108ba2/0x411dd0ee4d2d0e5f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0e66 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521135.833412:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c1620890 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1875400222315136:0@lo:104: 00010000:00010000:3.0:1788521135.833430:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: 000000003b108ba2/0x411dd0ee4d2d0e5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0e66 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521135.833433:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a49617ea pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1875400222315264:0@lo:104: 00010000:00010000:3.0:1788521135.833468:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788521135.833472:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: 0000000088ad40b3/0x411dd0ee4d2d0def lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0df6 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.833475:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ff501c36/0x411dd0ee4d2d0ea5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521135.833502:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000088ad40b3 already unused, calling callback (000000003f0cc38c) 10000000:00010000:3.0:1788521135.833509:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: 0000000088ad40b3/0x411dd0ee4d2d0def lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d0df6 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521135.833529:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: 0000000088ad40b3/0x411dd0ee4d2d0def lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d0df6 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521135.833534:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: 0000000088ad40b3/0x411dd0ee4d2d0def lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d0df6 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521135.833540:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788521135.833556:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: 0000000088ad40b3/0x411dd0ee4d2d0def lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0df6 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521135.833718:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788521135.833753:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521135.833766:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000037e7c635 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222315392:0@lo:103: 00000100:00100000:2.0:1788521135.833815:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521135.834025:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222315392 00000100:00100000:1.0:1788521135.834031:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222315392 00010000:00010000:1.0:1788521135.834054:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005e41df99/0x411dd0ee4d2d0e66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0e5f expref: 13 pid: 6512 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521135.834090:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788521135.834097:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a0975f1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+13:3643:x1875400222315392:12345-0@lo:103: 00010000:00010000:1.0:1788521135.834110:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521135.834114:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005e41df99/0x411dd0ee4d2d0e66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0e5f expref: 13 pid: 6512 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.834125:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005e41df99/0x411dd0ee4d2d0e66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0e5f expref: 13 pid: 6512 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.834141:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005e41df99/0x411dd0ee4d2d0e66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d0e5f expref: 13 pid: 6512 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.834154:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521135.834182:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a0975f1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:3643:x1875400222315392:12345-0@lo:103: Request processed in 86us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521135.834188:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788521135.834754:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521135.834793:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: 0000000088ad40b3/0x411dd0ee4d2d0def lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0df6 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521135.834802:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: 0000000088ad40b3/0x411dd0ee4d2d0def lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0df6 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521135.834815:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521135.834817:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521135.834820:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521135.834896:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eeecb731 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222315520:0@lo:103: 00000100:00100000:2.0:1788521135.835195:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000037e7c635 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222315392:0@lo:103: 00010000:00010000:1.0:1788521135.835292:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521135.835294:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521135.835296:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521135.835327:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: 00000000e4943218/0x411dd0ee4d2d0dd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0dda expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521135.835337:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e4943218 already unused, calling callback (000000003f0cc38c) 10000000:00010000:2.0:1788521135.835340:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: 00000000e4943218/0x411dd0ee4d2d0dd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d0dda expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521135.835349:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: 00000000e4943218/0x411dd0ee4d2d0dd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d0dda expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521135.835355:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: 00000000e4943218/0x411dd0ee4d2d0dd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d0dda expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521135.835361:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788521135.835394:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: 00000000e4943218/0x411dd0ee4d2d0dd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0dda expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521135.835409:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521135.835419:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: 00000000e4943218/0x411dd0ee4d2d0dd3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0dda expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521135.835424:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: 00000000e4943218/0x411dd0ee4d2d0dd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0dda expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521135.835440:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521135.835441:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521135.835442:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521135.835525:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521135.835702:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521135.835708:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c577741d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222315648:0@lo:103: 00000100:00100000:0.0:1788521135.835729:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521135.835852:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222315520 00000100:00100000:1.0:1788521135.835858:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222315520 00010000:00010000:1.0:1788521135.835879:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000045134775/0x411dd0ee4d2d0df6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0def expref: 12 pid: 6514 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521135.835935:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222315648 00000100:00100000:1.0:1788521135.835938:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222315648 00010000:00010000:1.0:1788521135.835960:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f95e50c5/0x411dd0ee4d2d0dda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0dd3 expref: 13 pid: 6513 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521135.835972:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788521135.835978:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9465373 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+13:3645:x1875400222315520:12345-0@lo:103: 00010000:00010000:1.0:1788521135.835989:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521135.835993:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000045134775/0x411dd0ee4d2d0df6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0def expref: 13 pid: 6514 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.836002:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000045134775/0x411dd0ee4d2d0df6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0def expref: 13 pid: 6514 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.836013:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000045134775/0x411dd0ee4d2d0df6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d0def expref: 13 pid: 6514 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.836025:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521135.836060:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9465373 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:3645:x1875400222315520:12345-0@lo:103: Request processed in 82us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521135.836069:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788521135.836214:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788521135.836221:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000586d659f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+11:3645:x1875400222315648:12345-0@lo:103: 00010000:00010000:1.0:1788521135.836229:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521135.836232:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f95e50c5/0x411dd0ee4d2d0dda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0dd3 expref: 11 pid: 6513 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.836248:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f95e50c5/0x411dd0ee4d2d0dda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0dd3 expref: 11 pid: 6513 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.836258:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f95e50c5/0x411dd0ee4d2d0dda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d0dd3 expref: 11 pid: 6513 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.836269:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ff501c36/0x411dd0ee4d2d0ea5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.836277:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ff501c36/0x411dd0ee4d2d0ea5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.836291:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ff501c36/0x411dd0ee4d2d0ea5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.836296:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ff501c36/0x411dd0ee4d2d0ea5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.836302:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ff501c36/0x411dd0ee4d2d0ea5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.836308:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ff501c36/0x411dd0ee4d2d0ea5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.836312:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ff501c36 already unused, calling callback (0000000099446ad8) 00010000:00010000:1.0:1788521135.836315:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ff501c36/0x411dd0ee4d2d0ea5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.836323:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ff501c36/0x411dd0ee4d2d0ea5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.836359:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ff501c36/0x411dd0ee4d2d0ea5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.836370:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521135.836392:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000586d659f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+10:3645:x1875400222315648:12345-0@lo:103: Request processed in 172us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521135.836398:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521135.836481:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c577741d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222315648:0@lo:103: 00000100:00100000:0.0:1788521135.836490:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eeecb731 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222315520:0@lo:103: 00010000:00010000:3.0:1788521135.836665:0:6514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ff501c36/0x411dd0ee4d2d0ea5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521135.836682:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ff501c36/0x411dd0ee4d2d0ea5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521135.836690:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ff501c36/0x411dd0ee4d2d0ea5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788521135.836722:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788521135.846033:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fad51c77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+9:7449:x1875400222314880:12345-0@lo:253: Request processed in 38024us (38149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521135.846048:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788521135.846168:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000038b58c7a pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222314880:0@lo:253: 10000000:01000000:3.0:1788521135.846194:0:7449:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788521135.846198:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788521135.846200:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788521135.846201:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788521135.846203:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:3.0:1788521135.846204:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788521135.846206:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788521135.846207:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788521135.846209:0:7449:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788521135.846210:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788521135.846211:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788521135.846238:0:7449:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000074d0882c from lustre-MDT0001 10000000:01000000:3.0:1788521135.846275:0:7449:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788521135.846278:0:7449:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788521135.846286:0:7449:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8fef4e780000 local copy 10000000:01000000:3.0:1788521135.846290:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788521135.846332:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: 00000000f0ec8767/0x411dd0ee4d2d0eac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521135.846344:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.141@tcp lock: 00000000f0ec8767/0x411dd0ee4d2d0eac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521135.846355:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: 00000000f0ec8767/0x411dd0ee4d2d0eac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521135.846376:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000937a1e68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222315776:0@lo:101: 00000100:00100000:3.0:1788521135.846431:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521135.846500:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000004eb924af going to sleep for 11 seconds 00000100:00100000:0.0:1788521135.846515:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222315776 00000100:00100000:0.0:1788521135.846525:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222315776 00000100:00100000:0.0:1788521135.846803:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788521135.846812:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013a5f94e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+9:7449:x1875400222315776:12345-0@lo:101: 00010000:00010000:0.0:1788521135.846828:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521135.846844:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ce34b8a2/0x411dd0ee4d2d0eb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d0eac expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521135.846869:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ce34b8a2/0x411dd0ee4d2d0eb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0eac expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521135.846879:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ce34b8a2/0x411dd0ee4d2d0eb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0eac expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521135.846918:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ce34b8a2, rc 0) 00000100:00100000:0.0:1788521135.846983:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013a5f94e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+10:7449:x1875400222315776:12345-0@lo:101: Request processed in 173us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521135.846990:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788521135.847070:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000937a1e68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222315776:0@lo:101: 00010000:00010000:3.0:1788521135.847101:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: 00000000f0ec8767/0x411dd0ee4d2d0eac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x411dd0ee4d2d0eb3 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521135.847124:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: 00000000f0ec8767/0x411dd0ee4d2d0eac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x411dd0ee4d2d0eb3 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521135.847237:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000937a1e68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222315904:0@lo:501: 00000100:00100000:3.0:1788521135.847270:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521135.847560:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000004eb924af going to sleep for 11 seconds 00000100:00100000:1.0:1788521135.847744:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222315904 00000100:00100000:1.0:1788521135.847751:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222315904 00000100:00100000:1.0:1788521135.847791:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788521135.847798:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051c693b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+10:7449:x1875400222315904:12345-0@lo:501: 00000100:00100000:1.0:1788521135.847873:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051c693b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+10:7449:x1875400222315904:12345-0@lo:501: Request processed in 76us (602us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788521135.847880:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788521135.848561:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000937a1e68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222315904:0@lo:501: 10000000:01000000:3.0:1788521135.848581:0:7449:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788521135.848618:0:7449:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788521135.848624:0:7449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: 00000000f0ec8767/0x411dd0ee4d2d0eac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x411dd0ee4d2d0eb3 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521135.848633:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: 00000000f0ec8767/0x411dd0ee4d2d0eac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x411dd0ee4d2d0eb3 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521135.848639:0:7449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.141@tcp lock: 00000000f0ec8767/0x411dd0ee4d2d0eac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x411dd0ee4d2d0eb3 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521135.848666:0:7449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788521135.848690:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8fef81580000 10000000:01000000:3.0:1788521135.848696:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788521135.848700:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8fef4e780000 10000000:01000000:3.0:1788521135.848702:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788521135.848706:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8fef4e780000 from 1 10000000:01000000:3.0:1788521135.848708:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788521135.848731:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: 00000000a0f2f346/0x411dd0ee4d2d0eba lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521135.848755:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: 00000000a0f2f346/0x411dd0ee4d2d0eba lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521135.848763:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: 00000000a0f2f346/0x411dd0ee4d2d0eba lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521135.848791:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000937a1e68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222316032:0@lo:101: 00000100:00100000:3.0:1788521135.848830:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521135.848846:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000006cd13adb going to sleep for 11 seconds 00000100:00100000:1.0:1788521135.850269:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222316032 00000100:00100000:1.0:1788521135.850281:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222316032 00000100:00100000:1.0:1788521135.850321:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788521135.850328:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f50c0530 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+10:7449:x1875400222316032:12345-0@lo:101: 00010000:00010000:1.0:1788521135.850343:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521135.850358:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000045134775/0x411dd0ee4d2d0ec1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d0eba expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.850383:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000045134775/0x411dd0ee4d2d0ec1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0eba expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.850410:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000045134775/0x411dd0ee4d2d0ec1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0eba expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.850418:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000045134775, rc 0) 00000100:00100000:1.0:1788521135.850483:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f50c0530 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+11:7449:x1875400222316032:12345-0@lo:101: Request processed in 155us (1653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521135.850489:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:1.0:1788521135.850522:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521135.850528:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: 00000000f0ec8767/0x411dd0ee4d2d0eac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x411dd0ee4d2d0eb3 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.850547:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f0ec8767 already unused, calling callback (000000003f0cc38c) 10000000:00010000:1.0:1788521135.850550:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: 00000000f0ec8767/0x411dd0ee4d2d0eac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x411dd0ee4d2d0eb3 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.850559:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: 00000000f0ec8767/0x411dd0ee4d2d0eac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x411dd0ee4d2d0eb3 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521135.850565:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: 00000000f0ec8767/0x411dd0ee4d2d0eac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x411dd0ee4d2d0eb3 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521135.850570:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788521135.850592:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: 00000000f0ec8767/0x411dd0ee4d2d0eac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x411dd0ee4d2d0eb3 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.850598:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788521135.850637:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: 00000000f0ec8767/0x411dd0ee4d2d0eac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x411dd0ee4d2d0eb3 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.850654:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: 00000000f0ec8767/0x411dd0ee4d2d0eac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x411dd0ee4d2d0eb3 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.850673:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521135.850674:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521135.850676:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521135.851341:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788521135.851358:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003d96bc4a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222316160:0@lo:103: 00000100:00100000:1.0:1788521135.851402:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521135.851445:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222316160 00000100:00100000:1.0:1788521135.851449:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222316160 00000100:00100000:1.0:1788521135.851483:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788521135.851489:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc681e98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+11:3644:x1875400222316160:12345-0@lo:103: 00010000:00010000:1.0:1788521135.851499:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521135.851512:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ce34b8a2/0x411dd0ee4d2d0eb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x411dd0ee4d2d0eac expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.851525:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521135.851564:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc681e98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+10:3644:x1875400222316160:12345-0@lo:103: Request processed in 75us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521135.851571:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788521135.851602:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003d96bc4a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222316160:0@lo:103: 00000100:00100000:3.0:1788521135.851811:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000937a1e68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222316032:0@lo:101: 00010000:00010000:3.0:1788521135.851827:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: 00000000a0f2f346/0x411dd0ee4d2d0eba lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0ec1 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521135.851836:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: 00000000a0f2f346/0x411dd0ee4d2d0eba lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d0ec1 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521135.851852:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788521135.851867:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: 00000000a0f2f346/0x411dd0ee4d2d0eba lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0ec1 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521135.851875:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: 00000000a0f2f346/0x411dd0ee4d2d0eba lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0ec1 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521135.851905:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8fef81580000 10000000:01000000:3.0:1788521135.851911:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788521135.851915:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8fef81580000 from 1 10000000:01000000:3.0:1788521135.851918:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788521135.851935:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: 000000005bb258d8/0x411dd0ee4d2d0ec8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521135.851962:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: 000000005bb258d8/0x411dd0ee4d2d0ec8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521135.851970:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: 000000005bb258d8/0x411dd0ee4d2d0ec8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521135.851984:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000937a1e68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222316288:0@lo:101: 00000100:00100000:3.0:1788521135.852014:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521135.852031:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000006cd13adb going to sleep for 11 seconds 00000100:00100000:1.0:1788521135.852204:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222316288 00000100:00100000:1.0:1788521135.852210:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222316288 00000100:00100000:1.0:1788521135.852231:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788521135.852236:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a85eadaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+10:7449:x1875400222316288:12345-0@lo:101: 00010000:00010000:1.0:1788521135.852254:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521135.852263:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007a07abfa/0x411dd0ee4d2d0ecf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d0ec8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.852279:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007a07abfa/0x411dd0ee4d2d0ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0ec8 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.852287:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007a07abfa/0x411dd0ee4d2d0ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0ec8 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521135.852293:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007a07abfa, rc 0) 00000100:00100000:1.0:1788521135.852331:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a85eadaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+11:7449:x1875400222316288:12345-0@lo:101: Request processed in 94us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521135.852337:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788521135.852405:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000937a1e68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222316288:0@lo:101: 00010000:00010000:3.0:1788521135.852415:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: 000000005bb258d8/0x411dd0ee4d2d0ec8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0ecf expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521135.852422:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: 000000005bb258d8/0x411dd0ee4d2d0ec8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d0ecf expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521135.852431:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788521135.852443:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: 000000005bb258d8/0x411dd0ee4d2d0ec8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0ecf expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521135.852450:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: 000000005bb258d8/0x411dd0ee4d2d0ec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0ecf expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521135.852457:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788521135.852460:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788521135.852464:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8fef81580000 10000000:01000000:3.0:1788521135.852467:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788521135.852469:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788521135.852476:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788521135.852492:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: 000000001caf93f4/0x411dd0ee4d2d0ed6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521135.852498:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: 000000001caf93f4/0x411dd0ee4d2d0ed6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521135.852505:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: 000000001caf93f4/0x411dd0ee4d2d0ed6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521135.852516:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000937a1e68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222316416:0@lo:101: 00000100:00100000:3.0:1788521135.852553:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521135.852569:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000006cd13adb going to sleep for 11 seconds 00000100:00100000:0.0:1788521135.852748:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222316416 00000100:00100000:0.0:1788521135.852753:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222316416 00000100:00100000:0.0:1788521135.852800:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788521135.852805:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df1256f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+11:7449:x1875400222316416:12345-0@lo:101: 00010000:00010000:0.0:1788521135.852812:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521135.852821:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007ab5ba49/0x411dd0ee4d2d0edd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d0ed6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521135.852834:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007ab5ba49/0x411dd0ee4d2d0edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0ed6 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521135.852842:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007ab5ba49/0x411dd0ee4d2d0edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0ed6 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521135.852859:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007ab5ba49, rc 0) 00000100:00100000:0.0:1788521135.852905:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df1256f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:7449:x1875400222316416:12345-0@lo:101: Request processed in 100us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521135.852911:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788521135.853047:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000937a1e68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222316416:0@lo:101: 00010000:00010000:3.0:1788521135.853058:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: 000000001caf93f4/0x411dd0ee4d2d0ed6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0edd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521135.853064:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: 000000001caf93f4/0x411dd0ee4d2d0ed6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d0edd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521135.853219:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000937a1e68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222316544:0@lo:501: 00000100:00100000:3.0:1788521135.853244:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521135.853270:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000006cd13adb going to sleep for 11 seconds 00000100:00100000:1.0:1788521135.853409:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222316544 00000100:00100000:1.0:1788521135.853414:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222316544 00000100:00100000:1.0:1788521135.853433:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788521135.853438:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004683e713 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:7449:x1875400222316544:12345-0@lo:501: 00000100:00100000:1.0:1788521135.853552:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004683e713 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:7449:x1875400222316544:12345-0@lo:501: Request processed in 113us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521135.853559:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788521135.853790:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000937a1e68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222316544:0@lo:501: 00000100:00100000:3.0:1788521135.853820:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000937a1e68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222316672:0@lo:503: 00000100:00100000:3.0:1788521135.853862:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521135.854378:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000006cd13adb going to sleep for 11 seconds 00000100:00100000:2.0:1788521135.857164:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222316672 00000100:00100000:2.0:1788521135.857180:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222316672 00000100:00100000:1.0:1788521135.857316:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788521135.857327:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081b74c87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:7449:x1875400222316672:12345-0@lo:503: 00000100:00100000:1.0:1788521135.857495:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081b74c87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:7449:x1875400222316672:12345-0@lo:503: Request processed in 171us (3632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521135.857504:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788521135.857761:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000937a1e68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222316672:0@lo:503: 00000040:00080000:3.0:1788521135.858060:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788521135.858211:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000937a1e68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222316800:0@lo:502: 00000100:00100000:3.0:1788521135.858259:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521135.858294:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000006cd13adb going to sleep for 11 seconds 00000100:00100000:0.0:1788521135.858367:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222316800 00000100:00100000:0.0:1788521135.858373:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222316800 00000100:00100000:0.0:1788521135.858402:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788521135.858408:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052cb522f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:7449:x1875400222316800:12345-0@lo:502: 00000100:00100000:0.0:1788521135.858497:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052cb522f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:7449:x1875400222316800:12345-0@lo:502: Request processed in 89us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521135.858504:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788521135.858706:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000937a1e68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222316800:0@lo:502: 00000040:00080000:3.0:1788521135.858956:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788521135.858982:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1788521135.858996:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1788521135.859008:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1788521135.859021:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1788521135.859049:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1788521135.859063:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1788521135.859146:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1788521135.859167:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1788521135.859180:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1788521135.859190:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1788521135.859201:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1788521135.859213:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1788521135.859226:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1788521135.859237:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1788521135.859249:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1788521135.859260:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1788521135.859271:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1788521135.859284:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1788521135.859296:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1788521135.859309:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1788521135.859337:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1788521135.859351:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1788521135.859375:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000937a1e68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222316928:0@lo:502: 00000100:00100000:3.0:1788521135.859416:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521135.859447:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000006cd13adb going to sleep for 11 seconds 00000100:00100000:1.0:1788521135.859556:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222316928 00000100:00100000:1.0:1788521135.859562:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222316928 00000100:00100000:1.0:1788521135.859594:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788521135.859600:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076c4ad1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:7449:x1875400222316928:12345-0@lo:502: 00000100:00100000:1.0:1788521135.859834:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076c4ad1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:7449:x1875400222316928:12345-0@lo:502: Request processed in 233us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521135.859841:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788521135.860725:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000937a1e68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222316928:0@lo:502: 00000040:00080000:3.0:1788521135.860811:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1788521135.860823:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:3.0:1788521135.862745:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521135.862761:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521135.862763:0:7462:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788521135.862778:0:7462:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788521135.862781:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788521135.862813:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000f3f1b94d) 00000020:00000080:3.0:1788521135.862834:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1788521135.862843:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788521135.862949:0:7462:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788521135.862956:0:7462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x411dd0ee4d2d0eeb 00000020:00000080:3.0:1788521135.863443:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788521135.863448:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521135.863452:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521135.863453:0:7462:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788521135.863456:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521135.863459:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521135.863460:0:7462:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788521135.863464:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788521135.863471:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000fea8f694) 00000020:00000080:3.0:1788521135.863482:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1788521135.863485:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788521135.863487:0:7462:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788521135.863490:0:7462:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788521135.863495:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788521135.863588:0:7462:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000074d0882c from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788521135.863601:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000b4cc33b9) 00000020:00000080:3.0:1788521135.863610:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1788521135.863671:0:7462:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788521135.863681:0:7462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x411dd0ee4d2d0f00 00000020:00000080:3.0:1788521135.863777:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788521135.863785:0:7462:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788521135.863789:0:7462:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x411dd0ee4d2d0f07 00080000:01000000:3.0:1788521135.863795:0:7462:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788521135.863798:0:7462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x411dd0ee4d2d0f0e 00080000:10000000:3.0:1788521135.868168:0:7462:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1788521135.868807:0:7462:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:0.0:1788521135.972437:0:7462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:0.0:1788521135.973500:0:7462:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:0.0:1788521135.978637:0:7462:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788521135.979239:0:7462:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788521136.006779:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788521136.006799:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521136.006808:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521136.006810:0:7462:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788521136.006814:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521136.006822:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521136.006824:0:7462:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788521136.006826:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788521136.006833:0:7462:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.141@tcp to nid 0x20000c0a8cb8d (192.168.203.141@tcp) 00000020:00000080:3.0:1788521136.006869:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788521136.006911:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000b969ffcd) 00000020:00000080:3.0:1788521136.006940:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788521136.006946:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788521136.007035:0:7462:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788521136.007043:0:7462:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788521136.007054:0:7462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x411dd0ee4d2d0f1c 00010000:00080000:3.0:1788521136.007096:0:7462:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009ad0ad20@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.141@tcp at head 00010000:00010000:0.0:1788521136.017474:0:7462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:0.0:1788521136.022408:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788521136.022431:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788521136.022509:0:7462:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788521136.022538:0:7462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x411dd0ee4d2d0f23 00000100:00080000:0.0:1788521136.022551:0:7462:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788521136.022557:0:7462:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000009ad0ad20 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:0.0:1788521136.022604:0:7462:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000cfba0c3 x1875400222317056/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788521136.022634:0:7462:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1788521136.022717:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521136.022729:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521136.022732:0:7462:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788521136.022736:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788521136.022740:0:7462:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788521136.022742:0:7462:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788521136.022743:0:7462:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788521136.022744:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788521136.022748:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521136.022749:0:7462:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788521136.022754:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521136.022762:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521136.022763:0:7462:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788521136.022781:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788521136.022825:0:7462:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1788521136.022827:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003d96bc4a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222317184:0@lo:400: 00000020:01000000:0.0:1788521136.022845:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521136.022852:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521136.022854:0:7462:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788521136.022857:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521136.022861:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521136.022863:0:7462:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788521136.022867:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788521136.022869:0:7462:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788521136.022934:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1788521136.022946:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521136.022953:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521136.022956:0:7462:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788521136.022961:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:1.0:1788521136.023030:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b079e131 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222317312:0@lo:400: 00000100:00100000:1.0:1788521136.023082:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521136.023140:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222317184 00000100:00100000:1.0:1788521136.023148:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222317184 00000020:01000000:0.0:1788521136.023166:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 00000100:00100000:1.0:1788521136.023203:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 10000000:01000000:0.0:1788521136.023211:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00000100:00100000:1.0:1788521136.023218:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ad64259 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:3644:x1875400222317184:12345-0@lo:400: 00010000:00010000:0.0:1788521136.023237:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: 000000001caf93f4/0x411dd0ee4d2d0ed6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0edd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.023251:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: 000000001caf93f4/0x411dd0ee4d2d0ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0edd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521136.023273:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fef81580000 from 1 00000100:00100000:1.0:1788521136.023279:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ad64259 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:3644:x1875400222317184:12345-0@lo:400: Request processed in 63us (341us total) trans 0 rc 0/0 10000000:01000000:0.0:1788521136.023281:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00100000:1.0:1788521136.023296:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1788521136.023324:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: 0000000047511951/0x411dd0ee4d2d0f2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.023335:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: 0000000047511951/0x411dd0ee4d2d0f2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.023348:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: 0000000047511951/0x411dd0ee4d2d0f2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521136.023349:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222317312 00000100:00100000:1.0:1788521136.023360:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222317312 00000100:00100000:0.0:1788521136.023378:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092c8ccb8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222317440:0@lo:101: 00000100:00100000:1.0:1788521136.023396:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788521136.023406:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4446e6f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222317312:12345-0@lo:400: 00000100:00100000:0.0:1788521136.023448:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521136.023465:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4446e6f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222317312:12345-0@lo:400: Request processed in 59us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521136.023473:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521136.023483:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fee1345f going to sleep for 11 seconds 00000100:00100000:1.0:1788521136.023502:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222317440 00000100:00100000:1.0:1788521136.023509:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222317440 00000100:00100000:1.0:1788521136.023547:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788521136.023554:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001be3f3c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+12:7449:x1875400222317440:12345-0@lo:101: 00010000:00010000:1.0:1788521136.023577:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1788521136.023582:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003d96bc4a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222317184:0@lo:400: 00010000:00010000:1.0:1788521136.023594:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004701b9f7/0x411dd0ee4d2d0f31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d0f2a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521136.023620:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004701b9f7/0x411dd0ee4d2d0f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0f2a expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521136.023631:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004701b9f7/0x411dd0ee4d2d0f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0f2a expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521136.023640:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004701b9f7, rc 0) 00010000:00080000:0.0:1788521136.023653:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b079e131 x1875400222317312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521136.023667:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b079e131 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222317312:0@lo:400: 00000100:00100000:1.0:1788521136.023690:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001be3f3c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+13:7449:x1875400222317440:12345-0@lo:101: Request processed in 133us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521136.023698:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788521136.023740:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092c8ccb8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222317440:0@lo:101: 00010000:00010000:0.0:1788521136.023757:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: 0000000047511951/0x411dd0ee4d2d0f2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0f31 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.023768:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: 0000000047511951/0x411dd0ee4d2d0f2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d0f31 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521136.024380:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092c8ccb8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222317568:0@lo:256: 00000100:00100000:0.0:1788521136.025154:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521136.025203:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fee1345f going to sleep for 11 seconds 00000100:00100000:1.0:1788521136.026143:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222317568 00000100:00100000:1.0:1788521136.026157:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222317568 00000100:00100000:2.0:1788521136.026291:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000cfba0c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222317056:0@lo:38: 00000100:00100000:2.0:1788521136.026371:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521136.026437:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222317056 00000100:00100000:2.0:1788521136.026441:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222317056 00000100:00100000:2.0:1788521136.026470:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788521136.026475:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4e038dd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1875400222317056:12345-0@lo:38: 00010000:00080000:2.0:1788521136.026503:0:6524:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:2.0:1788521136.026534:0:6524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x411dd0ee4d2d0f38 00000004:00100000:2.0:1788521136.026547:0:6524:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788521136.026553:0:6524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1788521136.026649:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788521136.026657:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc4d8c46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+13:7449:x1875400222317568:12345-0@lo:256: 20000000:01000000:1.0:1788521136.026673:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788521136.026695:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788521136.026698:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788521136.026820:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc4d8c46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+13:7449:x1875400222317568:12345-0@lo:256: Request processed in 164us (1666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521136.026828:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788521136.028709:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092c8ccb8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222317568:0@lo:256: 10000000:01000000:2.0:1788521136.029339:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788521136.029364:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: 0000000047511951/0x411dd0ee4d2d0f2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0f31 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521136.029390:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: 0000000047511951/0x411dd0ee4d2d0f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0f31 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521136.029400:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fef81580000 from 1 10000000:01000000:2.0:1788521136.029403:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788521136.029436:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: 000000000900d867/0x411dd0ee4d2d0f3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521136.029444:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: 000000000900d867/0x411dd0ee4d2d0f3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521136.029453:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: 000000000900d867/0x411dd0ee4d2d0f3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521136.029471:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000299629a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222317696:0@lo:101: 00000100:00100000:2.0:1788521136.029523:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521136.030293:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000009bf72894 going to sleep for 11 seconds 00000100:00100000:3.0:1788521136.030406:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222317696 00000100:00100000:3.0:1788521136.030414:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222317696 00000100:00100000:3.0:1788521136.030461:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788521136.030467:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a7f9739 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+13:7449:x1875400222317696:12345-0@lo:101: 00010000:00010000:3.0:1788521136.030480:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521136.030495:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f0ec8767/0x411dd0ee4d2d0f46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d0f3f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521136.030548:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f0ec8767/0x411dd0ee4d2d0f46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0f3f expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521136.030559:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f0ec8767/0x411dd0ee4d2d0f46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0f3f expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521136.030567:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f0ec8767, rc 0) 00000100:00100000:3.0:1788521136.030652:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a7f9739 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:7449:x1875400222317696:12345-0@lo:101: Request processed in 184us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521136.030685:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788521136.030810:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000299629a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222317696:0@lo:101: 00010000:00010000:2.0:1788521136.030831:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: 000000000900d867/0x411dd0ee4d2d0f3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0f46 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521136.030846:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: 000000000900d867/0x411dd0ee4d2d0f3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d0f46 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521136.031023:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000299629a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222317824:0@lo:501: 00000100:00100000:2.0:1788521136.031477:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521136.031545:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000009bf72894 going to sleep for 11 seconds 00000100:00100000:3.0:1788521136.031589:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222317824 00000100:00100000:3.0:1788521136.031594:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222317824 00000100:00100000:3.0:1788521136.031630:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788521136.031636:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff06b1e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:7449:x1875400222317824:12345-0@lo:501: 00000100:00100000:3.0:1788521136.031855:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff06b1e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:7449:x1875400222317824:12345-0@lo:501: Request processed in 219us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521136.031862:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788521136.032445:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000299629a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222317824:0@lo:501: 00000100:00100000:2.0:1788521136.032484:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000299629a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222317952:0@lo:503: 00000100:00100000:2.0:1788521136.032528:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521136.032557:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000009bf72894 going to sleep for 11 seconds 00000100:00100000:0.0:1788521136.032596:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222317952 00000100:00100000:0.0:1788521136.032612:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222317952 00000100:00100000:0.0:1788521136.032678:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788521136.032688:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bea7e406 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:7449:x1875400222317952:12345-0@lo:503: 00000040:00080000:0.0:1788521136.032760:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788521136.032861:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bea7e406 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:7449:x1875400222317952:12345-0@lo:503: Request processed in 175us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521136.032870:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788521136.033001:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000299629a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222317952:0@lo:503: 00000040:00080000:2.0:1788521136.033497:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788521136.033572:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1788521136.033655:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788521136.035948:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1788521136.036241:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788521136.036280:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788521136.036335:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: 000000000900d867/0x411dd0ee4d2d0f3f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0f46 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521136.036349:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: 000000000900d867/0x411dd0ee4d2d0f3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0f46 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521136.036420:0:7449:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788521136.036424:0:7449:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8fef81580000 10000000:01000000:3.0:1788521136.036427:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8fef81580000 10000000:01000000:3.0:1788521136.036446:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788521136.036454:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fef81580000 from 1 10000000:01000000:3.0:1788521136.036457:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788521136.036503:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: 00000000e4943218/0x411dd0ee4d2d0f4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521136.036512:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: 00000000e4943218/0x411dd0ee4d2d0f4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521136.036523:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: 00000000e4943218/0x411dd0ee4d2d0f4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521136.036553:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000937a1e68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222318080:0@lo:101: 00000100:00100000:3.0:1788521136.036636:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521136.036699:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b44ae38f going to sleep for 11 seconds 00000100:00100000:2.0:1788521136.036788:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222318080 00000100:00100000:2.0:1788521136.036798:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222318080 00000100:00100000:2.0:1788521136.036911:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788521136.036921:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066931284 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:7449:x1875400222318080:12345-0@lo:101: 00010000:00010000:2.0:1788521136.036937:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521136.036951:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d52fd3dd/0x411dd0ee4d2d0f54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d0f4d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521136.036977:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d52fd3dd/0x411dd0ee4d2d0f54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0f4d expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521136.036988:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d52fd3dd/0x411dd0ee4d2d0f54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0f4d expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521136.036998:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d52fd3dd, rc 0) 00000100:00100000:2.0:1788521136.037042:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066931284 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:7449:x1875400222318080:12345-0@lo:101: Request processed in 124us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521136.037049:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788521136.037261:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000937a1e68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222318080:0@lo:101: 00010000:00010000:3.0:1788521136.037278:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: 00000000e4943218/0x411dd0ee4d2d0f4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0f54 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521136.037287:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: 00000000e4943218/0x411dd0ee4d2d0f4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d0f54 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521136.037400:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000937a1e68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222318208:0@lo:501: 00000100:00100000:3.0:1788521136.037430:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521136.037452:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b44ae38f going to sleep for 11 seconds 00000100:00100000:0.0:1788521136.037507:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222318208 00000100:00100000:0.0:1788521136.037512:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222318208 00000100:00100000:0.0:1788521136.037551:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788521136.037558:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005611483d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:7449:x1875400222318208:12345-0@lo:501: 00000100:00100000:0.0:1788521136.037677:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005611483d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:7449:x1875400222318208:12345-0@lo:501: Request processed in 120us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521136.037685:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788521136.037737:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000937a1e68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222318208:0@lo:501: 00000100:00100000:0.0:1788521136.037768:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dcaa7534 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222318336:0@lo:503: 00000100:00100000:0.0:1788521136.037827:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521136.037847:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222318336 00000100:00100000:0.0:1788521136.037851:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222318336 00000100:00100000:0.0:1788521136.037867:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788521136.037873:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2db7d79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:7449:x1875400222318336:12345-0@lo:503: 00000100:00100000:0.0:1788521136.038011:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2db7d79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:7449:x1875400222318336:12345-0@lo:503: Request processed in 138us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521136.038025:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788521136.038059:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb619ae1 going to sleep for 11 seconds 00000100:00100000:0.0:1788521136.038072:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dcaa7534 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222318336:0@lo:503: 00000040:00080000:0.0:1788521136.038543:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788521136.038622:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dcaa7534 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222318464:0@lo:502: 00000100:00100000:0.0:1788521136.038668:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521136.038711:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222318464 00000100:00100000:0.0:1788521136.038717:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222318464 00000100:00100000:0.0:1788521136.038757:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788521136.038763:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000239a4b41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:7449:x1875400222318464:12345-0@lo:502: 00000100:00100000:0.0:1788521136.038865:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000239a4b41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:7449:x1875400222318464:12345-0@lo:502: Request processed in 102us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521136.038872:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788521136.038941:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e5edf543 going to sleep for 11 seconds 00000100:00100000:0.0:1788521136.038956:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dcaa7534 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222318464:0@lo:502: 00000040:00080000:0.0:1788521136.039704:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788521136.039743:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788521136.039759:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788521136.039784:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788521136.039800:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788521136.039812:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788521136.039822:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788521136.039833:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788521136.039844:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788521136.039857:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788521136.039871:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788521136.040004:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788521136.040021:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788521136.040051:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788521136.040062:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788521136.040074:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788521136.040086:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788521136.040096:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788521136.040108:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788521136.040120:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788521136.040132:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788521136.040142:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788521136.040153:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788521136.040167:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788521136.040181:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788521136.040196:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788521136.040208:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788521136.040220:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1788521136.040282:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dcaa7534 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222318592:0@lo:502: 00000100:00100000:0.0:1788521136.040362:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521136.040460:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e5edf543 going to sleep for 11 seconds 00000100:00100000:2.0:1788521136.040509:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222318592 00000100:00100000:2.0:1788521136.040518:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222318592 00000100:00100000:2.0:1788521136.040621:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788521136.040630:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011d081df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:7449:x1875400222318592:12345-0@lo:502: 00000100:00100000:2.0:1788521136.040778:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011d081df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:7449:x1875400222318592:12345-0@lo:502: Request processed in 142us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521136.040786:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788521136.040873:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dcaa7534 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222318592:0@lo:502: 00000040:00080000:0.0:1788521136.040944:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788521136.040955:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1788521136.044391:0:7468:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788521136.044416:0:7468:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000a88e016a) 00000020:00000080:2.0:1788521136.044448:0:7468:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788521136.044549:0:7468:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000074d0882c from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788521136.044554:0:7468:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000074d0882c from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788521136.044556:0:7468:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000074d0882c 3 00010000:00080000:2.0:1788521136.044594:0:7468:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000bbe9d4f1@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.141@tcp at head 00000100:00080000:0.0:1788521136.046840:0:6524:0:(import.c:65:import_set_state_nolock()) 00000000a840ff0c : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788521136.046973:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4e038dd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1875400222317056:12345-0@lo:38: Request processed in 20494us (20601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521136.046988:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788521136.047414:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788521136.047424:0:3642:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788521136.047432:0:3642:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788521136.047437:0:3642:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788521136.047440:0:3642:0:(import.c:65:import_set_state_nolock()) 000000009ad0ad20 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788521136.047461:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000cfba0c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222317056:0@lo:38: 00000100:00100000:2.0:1788521136.047670:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788521136.047683:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000013abf6d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222318720:0@lo:41: 00000100:00100000:2.0:1788521136.047721:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521136.048140:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222318720 00000100:00100000:3.0:1788521136.048148:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222318720 00000100:00100000:3.0:1788521136.048229:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788521136.048237:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000299629a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1875400222318720:12345-0@lo:41: 00000004:00000024:3.0:1788521136.048278:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1788521136.048336:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000299629a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1875400222318720:12345-0@lo:41: Request processed in 100us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521136.048343:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788521136.048704:0:7468:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:0.0:1788521136.048932:0:7468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1788521136.048979:0:7468:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788521136.048993:0:7468:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x411dd0ee4d2d0f62 00000100:00080000:0.0:1788521136.049001:0:7468:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788521136.049012:0:7468:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000bbe9d4f1 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:0.0:1788521136.049038:0:7468:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000dcaa7534 x1875400222318848/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788521136.050166:0:7468:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:0.0:1788521136.052468:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:1.0:1788521136.052690:0:7469:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:0.0:1788521136.052803:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788521136.052840:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788521136.052862:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: 00000000e4943218/0x411dd0ee4d2d0f4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0f54 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.052874:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: 00000000e4943218/0x411dd0ee4d2d0f4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0f54 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788521136.052949:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788521136.052952:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788521136.052953:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788521136.052955:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788521136.052956:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788521136.052957:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788521136.052959:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788521136.052960:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788521136.052962:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788521136.052963:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788521136.052964:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788521136.052968:0:7449:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1788521136.052971:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788521136.052972:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788521136.052973:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788521136.052975:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788521136.052976:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788521136.052977:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788521136.052978:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788521136.052979:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788521136.052980:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788521136.052981:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788521136.052986:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788521136.053012:0:7449:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788521136.053029:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5ef1b48 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222318976:0@lo:253: 00000100:00100000:0.0:1788521136.053094:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521136.053134:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000006f8ff6c4 going to sleep for 11 seconds 00000100:00100000:2.0:1788521136.054681:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222318976 00000100:00100000:2.0:1788521136.054695:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222318976 00000100:00100000:2.0:1788521136.054760:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788521136.054778:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000906d6ba9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:7449:x1875400222318976:12345-0@lo:253: 20000000:01000000:2.0:1788521136.054813:0:6513:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788521136.054828:0:6513:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788521136.057212:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000013abf6d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222318720:0@lo:41: 00000001:00100000:0.0:1788521136.059036:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788521136.062594:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dcaa7534 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875400222318848:0@lo:38: 00000100:00100000:3.0:1788521136.062674:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521136.065088:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222318848 00000100:00100000:0.0:1788521136.065101:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222318848 00000100:00100000:0.0:1788521136.065141:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521136.065148:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000527abe19 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875400222318848:12345-0@lo:38: 00010000:00080000:0.0:1788521136.065177:0:6520:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:0.0:1788521136.065212:0:6520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x411dd0ee4d2d0f69 00000004:00100000:0.0:1788521136.065227:0:6520:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788521136.065268:0:6520:0:(import.c:65:import_set_state_nolock()) 000000008b5dc1f2 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788521136.065354:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000527abe19 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875400222318848:12345-0@lo:38: Request processed in 205us (2679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521136.065361:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788521136.065427:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000dcaa7534 x1875400222318848/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788521146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521136.065438:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788521136.065445:0:3642:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788521136.065452:0:3642:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788521136.065456:0:3642:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788521136.065458:0:3642:0:(import.c:65:import_set_state_nolock()) 00000000bbe9d4f1 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788521136.065463:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dcaa7534 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875400222318848:0@lo:38: 20000000:01000000:2.0:1788521136.065916:0:6513:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788521136.065929:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788521136.066225:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000906d6ba9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:7449:x1875400222318976:12345-0@lo:253: Request processed in 11457us (13129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521136.066234:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 20000000:01000000:0.0:1788521136.066378:0:6535:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788521136.066394:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788521136.066410:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ce34b8a2/0x411dd0ee4d2d0f70 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.066426:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008b28f129/0x411dd0ee4d2d0e90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0e89 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.066433:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004701b9f7/0x411dd0ee4d2d0f31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0f2a expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.066440:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ce34b8a2/0x411dd0ee4d2d0f70 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.066469:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004701b9f7/0x411dd0ee4d2d0f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d0f2a expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.066482:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004701b9f7/0x411dd0ee4d2d0f31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0f2a expref: 14 pid: 6514 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521136.066613:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5ef1b48 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7449:1875400222318976:0@lo:253: 10000000:01000000:2.0:1788521136.066626:0:7449:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788521136.066629:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788521136.066631:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788521136.066632:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521136.066633:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521136.066634:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521136.066635:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521136.066636:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788521136.066638:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788521136.066639:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788521136.066640:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521136.066642:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788521136.066651:0:7449:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788521136.067629:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dcaa7534 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1875400222319104:0@lo:104: 00000100:00100000:0.0:1788521136.067676:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788521136.067726:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008b28f129/0x411dd0ee4d2d0e90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d0e89 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.067736:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008b28f129/0x411dd0ee4d2d0e90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0e89 expref: 14 pid: 6514 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521136.067744:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000084551407 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1875400222319232:0@lo:104: 00000100:00100000:0.0:1788521136.067765:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521136.067791:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fee1345f going to sleep for 11 seconds 00000100:00100000:0.0:1788521136.067819:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222319104 00000100:00100000:0.0:1788521136.067833:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222319104 00000100:00100000:0.0:1788521136.067862:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222319232 00000100:00100000:0.0:1788521136.067864:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222319232 00000100:00100000:0.0:1788521136.067876:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521136.068433:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d38e6ab7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+4:6535:x1875400222319104:12345-0@lo:104: 00010000:00010000:0.0:1788521136.068446:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: 0000000047511951/0x411dd0ee4d2d0f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0f31 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.068508:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788521136.068514:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d38e6ab7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+4:6535:x1875400222319104:12345-0@lo:104: Request processed in 632us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521136.068522:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521136.068612:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788521136.068619:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa1082b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:6535:x1875400222319232:12345-0@lo:104: 00010000:00010000:0.0:1788521136.068626:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: 000000009a8f2ee6/0x411dd0ee4d2d0e89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0e90 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.068663:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788521136.068668:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa1082b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:6535:x1875400222319232:12345-0@lo:104: Request processed in 50us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521136.068673:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788521136.068691:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788521136.068696:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: 0000000047511951/0x411dd0ee4d2d0f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0f31 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.068704:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000047511951 already unused, calling callback (000000003f0cc38c) 10000000:00010000:0.0:1788521136.068707:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: 0000000047511951/0x411dd0ee4d2d0f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d0f31 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.068727:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: 0000000047511951/0x411dd0ee4d2d0f2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d0f31 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521136.068734:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: 0000000047511951/0x411dd0ee4d2d0f2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d0f31 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521136.068740:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521136.068763:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: 0000000047511951/0x411dd0ee4d2d0f2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0f31 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.068779:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521136.068794:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: 0000000047511951/0x411dd0ee4d2d0f2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0f31 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.068800:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: 0000000047511951/0x411dd0ee4d2d0f2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0f31 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.068810:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521136.068812:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: 000000009a8f2ee6/0x411dd0ee4d2d0e89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0e90 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.068817:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009a8f2ee6 already unused, calling callback (000000003f0cc38c) 10000000:00010000:0.0:1788521136.068819:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: 000000009a8f2ee6/0x411dd0ee4d2d0e89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d0e90 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.068825:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: 000000009a8f2ee6/0x411dd0ee4d2d0e89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d0e90 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521136.068830:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: 000000009a8f2ee6/0x411dd0ee4d2d0e89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d0e90 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521136.068840:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521136.068851:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: 000000009a8f2ee6/0x411dd0ee4d2d0e89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0e90 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.068856:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521136.068860:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: 000000009a8f2ee6/0x411dd0ee4d2d0e89 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0e90 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.068866:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: 000000009a8f2ee6/0x411dd0ee4d2d0e89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0e90 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.068877:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521136.068879:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521136.068880:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521136.068913:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000057910046 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222319360:0@lo:103: 00000100:00100000:0.0:1788521136.068939:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521136.068958:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788521136.068963:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003cf61139 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222319488:0@lo:103: 00000100:00100000:0.0:1788521136.068984:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521136.069014:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222319360 00000100:00100000:0.0:1788521136.069018:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222319360 00010000:00010000:0.0:1788521136.069035:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004701b9f7/0x411dd0ee4d2d0f31 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0f2a expref: 15 pid: 6514 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521136.069054:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222319488 00000100:00100000:0.0:1788521136.069057:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222319488 00010000:00010000:0.0:1788521136.069066:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008b28f129/0x411dd0ee4d2d0e90 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0e89 expref: 16 pid: 6514 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521136.069092:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521136.069098:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005eee2ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:3643:x1875400222319360:12345-0@lo:103: 00010000:00010000:0.0:1788521136.069108:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521136.069112:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004701b9f7/0x411dd0ee4d2d0f31 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0f2a expref: 16 pid: 6514 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.069121:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004701b9f7/0x411dd0ee4d2d0f31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0f2a expref: 16 pid: 6514 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.069137:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521136.069162:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005eee2ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:3643:x1875400222319360:12345-0@lo:103: Request processed in 65us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521136.069168:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521136.069180:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788521136.069185:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db40ac8d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:3643:x1875400222319488:12345-0@lo:103: 00010000:00010000:0.0:1788521136.069192:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521136.069195:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008b28f129/0x411dd0ee4d2d0e90 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0e89 expref: 15 pid: 6514 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.069203:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008b28f129/0x411dd0ee4d2d0e90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0e89 expref: 15 pid: 6514 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.069213:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ce34b8a2/0x411dd0ee4d2d0f70 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.069220:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ce34b8a2/0x411dd0ee4d2d0f70 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788521136.069241:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010206398s 00010000:00010000:0.0:1788521136.069245:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ce34b8a2/0x411dd0ee4d2d0f70 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.069252:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ce34b8a2/0x411dd0ee4d2d0f70 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.069258:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ce34b8a2/0x411dd0ee4d2d0f70 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521136.069859:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004701b9f7/0x411dd0ee4d2d0f31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d0f2a expref: 15 pid: 6514 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521136.069872:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dcaa7534 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1875400222319104:0@lo:104: 00010000:00010000:1.0:1788521136.069909:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008b28f129/0x411dd0ee4d2d0e90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d0e89 expref: 14 pid: 6514 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521136.069918:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000084551407 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1875400222319232:0@lo:104: 00010000:00010000:0.0:1788521136.072397:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ce34b8a2/0x411dd0ee4d2d0f70 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521136.073999:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521136.074093:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ce34b8a2/0x411dd0ee4d2d0f70 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521136.074117:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: 00000000ce34b8a2/0x411dd0ee4d2d0f70 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521136.074123:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ce34b8a2/0x411dd0ee4d2d0f70 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.074569:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ce34b8a2 already unused, calling callback (0000000099446ad8) 00010000:00010000:0.0:1788521136.074576:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ce34b8a2/0x411dd0ee4d2d0f70 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.074587:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ce34b8a2/0x411dd0ee4d2d0f70 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.074601:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ce34b8a2/0x411dd0ee4d2d0f70 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.074611:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ce34b8a2/0x411dd0ee4d2d0f70 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521136.074632:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521136.074704:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db40ac8d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+13:3643:x1875400222319488:12345-0@lo:103: Request processed in 5516us (5717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521136.074714:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00080000:10000000:2.0:1788521136.076257:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1788521136.076428:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788521136.076641:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788521136.076824:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788521136.077107:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788521136.077292:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:1.0:1788521136.079412:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003cf61139 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222319488:0@lo:103: 00000100:00100000:1.0:1788521136.079425:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000057910046 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222319360:0@lo:103: 00080000:10000000:0.0:1788521136.082595:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788521136.083180:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1788521136.083480:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1788521136.083650:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1788521136.084129:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:0.0:1788521136.084394:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:0.0:1788521136.085924:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1788521136.086195:0:7474:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:0.0:1788521136.086251:0:7474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a9465373 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7474:1875400222319616:0@lo:700: 00000040:01000000:1.0:1788521136.086355:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1788521136.086547:0:7474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521136.086594:0:7474:0:(client.c:2716:ptlrpc_set_wait()) set 0000000055ef189d going to sleep for 11 seconds 00000100:00100000:3.0:1788521136.086646:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222319616 00000100:00100000:3.0:1788521136.086653:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222319616 00000100:00100000:3.0:1788521136.086699:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788521136.086706:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000586d659f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7474:x1875400222319616:12345-0@lo:700: 00000100:00100000:1.0:1788521136.087047:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000090b4bbd0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1875400222319744:0@lo:1000: 00000100:00100000:1.0:1788521136.087081:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521136.087108:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 000000007f05eb4e going to sleep for 11 seconds 00000040:01000000:3.0:1788521136.087524:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1788521136.087622:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788521136.088710:0:7449:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788521136.088723:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:0.0:1788521136.089012:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222319744 00000100:00100000:0.0:1788521136.089022:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222319744 00000100:00100000:0.0:1788521136.089076:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521136.089084:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0c8b587 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1875400222319744:12345-0@lo:1000: 00000100:00100000:0.0:1788521136.089209:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0c8b587 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1875400222319744:12345-0@lo:1000: Request processed in 125us (2127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521136.089217:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521136.089340:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000090b4bbd0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1875400222319744:0@lo:1000: 00000040:01000000:0.0:1788521136.089377:0:7475:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1788521136.089409:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000005eee2ff pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1875400222319872:0@lo:700: 00000100:00100000:0.0:1788521136.089441:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521136.089460:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 0000000049a4ab2b going to sleep for 11 seconds 00000040:00080000:3.0:1788521136.089735:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1788521136.089840:0:7473:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788521136.089844:0:7473:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788521136.089863:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222319872 00000100:00100000:2.0:1788521136.089868:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222319872 00000100:00100000:2.0:1788521136.090071:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788521136.090079:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be6aa122 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7475:x1875400222319872:12345-0@lo:700: 00000100:00100000:2.0:1788521136.090135:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be6aa122 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7475:x1875400222319872:12345-0@lo:700: Request processed in 57us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521136.090149:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:3.0:1788521136.091181:0:7449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788521136.091721:0:7449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788521136.091753:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:0.0:1788521136.092061:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000005eee2ff pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1875400222319872:0@lo:700: 00000100:00100000:0.0:1788521136.092134:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000005eee2ff pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7475:1875400222320000:0@lo:900: 00000100:00100000:0.0:1788521136.092186:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521136.092232:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 0000000049a4ab2b going to sleep for 11 seconds 00000100:00100000:3.0:1788521136.092378:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222320000 00000100:00100000:3.0:1788521136.092385:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222320000 00000100:00100000:3.0:1788521136.092430:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788521136.092438:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057910046 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7475:x1875400222320000:12345-0@lo:900: 00000100:00100000:3.0:1788521136.092488:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057910046 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7475:x1875400222320000:12345-0@lo:900: Request processed in 51us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521136.092494:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:3.0:1788521136.092723:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00080000:0.0:1788521136.092848:0:7475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000005eee2ff x1875400222320000/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788521152 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521136.092864:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000005eee2ff pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7475:1875400222320000:0@lo:900: 00000100:00100000:0.0:1788521136.092977:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000005eee2ff pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1875400222320128:0@lo:1000: 00000100:00100000:0.0:1788521136.093010:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521136.093034:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222320128 00000100:00100000:0.0:1788521136.093037:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222320128 00000100:00100000:0.0:1788521136.093064:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521136.093070:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003cf61139 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1875400222320128:12345-0@lo:1000: 00000100:00100000:0.0:1788521136.093123:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003cf61139 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1875400222320128:12345-0@lo:1000: Request processed in 53us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521136.093129:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521136.093147:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c749d806 going to sleep for 11 seconds 00000100:00100000:0.0:1788521136.093159:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000005eee2ff pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1875400222320128:0@lo:1000: 00000004:00080000:0.0:1788521136.093195:0:7475:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000049a4ab2b with version 0 00000020:00100000:0.0:1788521136.093209:0:7475:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788521136.093214:0:7475:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000005eee2ff x1875400222320384/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788521136.093224:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000005eee2ff pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1875400222320384:0@lo:1000: 00000100:00100000:0.0:1788521136.093245:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521136.093268:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222320384 00000100:00100000:0.0:1788521136.093272:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222320384 00000100:00100000:0.0:1788521136.093292:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521136.093297:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084551407 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1875400222320384:12345-0@lo:1000: 00000100:00100000:0.0:1788521136.093576:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 00000000254728dc going to sleep for 11 seconds 00080000:10000000:3.0:1788521136.097182:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788521136.098269:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788521136.098429:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788521136.098565:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788521136.098720:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788521136.099428:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788521136.099640:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788521136.101151:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788521136.101373:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788521136.101564:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788521136.101709:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788521136.110521:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788521136.110732:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788521136.110943:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788521136.111078:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788521136.111207:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788521136.111337:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788521136.111656:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788521136.111837:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788521136.112004:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788521136.112151:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788521136.112275:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788521136.112408:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788521136.112536:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788521136.112714:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788521136.112858:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788521136.113019:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788521136.113168:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788521136.113309:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788521136.113442:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788521136.113580:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788521136.113714:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788521136.115360:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788521136.115601:0:7449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1788521136.125309:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 40000000:02000000:3.0:1788521136.125722:0:6526:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:1.0:1788521136.127007:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084551407 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1875400222320384:12345-0@lo:1000: Request processed in 33697us (33749us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788521136.127037:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1788521136.128020:0:7475:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1788521136.128030:0:7475:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788521136.128079:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000005eee2ff pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1875400222320384:0@lo:1000: 00000100:00100000:2.0:1788521136.128250:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e99c3b42 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1875400222320512:0@lo:1000: 00000100:00100000:2.0:1788521136.128312:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521136.128371:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ca206ce7 going to sleep for 11 seconds 00000100:00100000:1.0:1788521136.131222:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222320512 00000100:00100000:1.0:1788521136.131247:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222320512 00000100:00100000:1.0:1788521136.131342:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788521136.131354:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d68e8b05 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7475:x1875400222320512:12345-0@lo:1000: 00000100:00100000:1.0:1788521136.131551:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d68e8b05 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7475:x1875400222320512:12345-0@lo:1000: Request processed in 200us (3239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521136.131582:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788521136.131638:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e99c3b42 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1875400222320512:0@lo:1000: 00000040:00080000:2.0:1788521136.131678:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1788521136.131729:0:7475:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000003210d41e with version 1 00000040:00080000:2.0:1788521136.133801:0:7475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788521136.133933:0:7475:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788521136.134103:0:7465:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000d6ba1863 version 1 rpc_version 1 00000020:00100000:0.0:1788521136.134141:0:7465:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788521136.134151:0:7465:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000dcaa7534 x1875400222320768/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788521136.134173:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dcaa7534 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7465:1875400222320768:0@lo:1000: 00000100:00100000:0.0:1788521136.134238:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521136.134286:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 0000000049a4ab2b going to sleep for 11 seconds 00000100:00100000:1.0:1788521136.134332:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222320768 00000100:00100000:1.0:1788521136.134348:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222320768 00000100:00100000:1.0:1788521136.134554:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788521136.134824:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5ef1b48 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7465:x1875400222320768:12345-0@lo:1000: 00000100:00100000:3.0:1788521136.138910:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000586d659f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7474:x1875400222319616:12345-0@lo:700: Request processed in 52172us (52332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521136.138926:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:3.0:1788521136.141112:0:7449:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788521136.141150:0:7449:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa9e341c83988 00100000:10000000:3.0:1788521136.141158:0:7449:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00010000:00080000:1.0:1788521136.143065:0:7474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a9465373 x1875400222319616/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788521152 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521136.143092:0:7474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a9465373 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7474:1875400222319616:0@lo:700: 40000000:02000000:1.0:1788521136.143123:0:7474:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000020:01000004:3.0:1788521136.146245:0:7449:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788521136.146300:0:7449:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.141@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788521136.146321:0:7449:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788521136.146341:0:7449:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788521136.148806:0:7449:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788521136.148993:0:7449:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000001:00080000:2.0:1788521136.150476:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:2.0:1788521136.150611:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5ef1b48 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7465:x1875400222320768:12345-0@lo:1000: Request processed in 16044us (16371us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788521136.150624:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1788521136.163375:0:7465:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1788521136.163383:0:7465:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788521136.163406:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dcaa7534 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7465:1875400222320768:0@lo:1000: 00000040:00080000:0.0:1788521136.202506:0:7474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788521136.210109:0:7474:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788521136.211588:0:7474:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788521136.211609:0:7474:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:1.0:1788521136.334122:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521137.369468:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521138.393186:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521139.406131:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521140.429859:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788521141.311056:0:7720:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg341-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788521141.389176:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c3ec9152 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222321280:0@lo:400: 00000100:00100000:0.0:1788521141.389270:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521141.389352:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788521141.389360:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092c8ccb8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222321152:0@lo:400: 00000100:00100000:0.0:1788521141.389389:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521141.389427:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222321280 00000100:00100000:0.0:1788521141.389438:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222321280 00000100:00100000:0.0:1788521141.389493:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521141.389502:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001beae098 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222321280:12345-0@lo:400: 00000100:00100000:0.0:1788521141.389563:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001beae098 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222321280:12345-0@lo:400: Request processed in 62us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521141.389571:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521141.389614:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222321152 00000100:00100000:0.0:1788521141.389617:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222321152 00000100:00100000:0.0:1788521141.389647:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788521141.389654:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063596f98 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222321152:12345-0@lo:400: 00000100:00100000:0.0:1788521141.389693:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063596f98 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222321152:12345-0@lo:400: Request processed in 40us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521141.389700:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788521141.389756:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092c8ccb8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222321152:0@lo:400: 00010000:00080000:0.0:1788521141.389771:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000c3ec9152 x1875400222321280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521141.389781:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c3ec9152 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222321280:0@lo:400: 00000100:00100000:1.0:1788521141.390096:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dcaa7534 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222320896:0@lo:400: 00000100:00100000:1.0:1788521141.390140:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521141.390170:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009de470e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222321408:0@lo:41: 00000100:00100000:1.0:1788521141.390193:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521141.390211:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788521141.390217:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000cfba0c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222321024:0@lo:400: 00000100:00100000:1.0:1788521141.390239:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521141.390273:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222321024 00000100:00100000:1.0:1788521141.390278:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222321024 00000100:00100000:1.0:1788521141.390310:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788521141.390329:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a792f28b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222321024:12345-0@lo:400: 00000100:00100000:1.0:1788521141.390366:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a792f28b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222321024:12345-0@lo:400: Request processed in 51us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521141.390372:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788521141.390389:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222321408 00000100:00100000:1.0:1788521141.390401:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222321408 00000100:00100000:1.0:1788521141.390416:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788521141.390421:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001cd5716f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222321408:12345-0@lo:41: 00000004:00000024:1.0:1788521141.390449:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1788521141.390479:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001cd5716f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222321408:12345-0@lo:41: Request processed in 58us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521141.390485:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788521141.390509:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000cfba0c3 x1875400222321024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521141.390519:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000cfba0c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222321024:0@lo:400: 00000100:00100000:1.0:1788521141.390531:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009de470e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222321408:0@lo:41: 00000100:00100000:0.0:1788521141.391026:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222320896 00000100:00100000:0.0:1788521141.391032:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222320896 00000100:00100000:0.0:1788521141.391068:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788521141.391075:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f34537e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+13:3645:x1875400222320896:12345-0@lo:400: 00000100:00100000:0.0:1788521141.391122:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f34537e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+13:3645:x1875400222320896:12345-0@lo:400: Request processed in 48us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521141.391128:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788521141.391454:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dcaa7534 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222320896:0@lo:400: 00010000:00010000:2.0:1788521141.454789:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788521141.901142:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788521141.901153:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fef81580000 from 4 10000000:01000000:0.0:1788521141.901160:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788521141.901234:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: 000000006d59d46a/0x411dd0ee4d2d0f77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521141.901249:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: 000000006d59d46a/0x411dd0ee4d2d0f77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521141.901261:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: 000000006d59d46a/0x411dd0ee4d2d0f77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521141.901313:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c3ec9152 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222321536:0@lo:101: 00000100:00100000:0.0:1788521141.901415:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521141.901479:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 0000000064d1bc9d going to sleep for 11 seconds 00000100:00100000:2.0:1788521141.901624:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222321536 00000100:00100000:2.0:1788521141.901635:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222321536 00000100:00100000:2.0:1788521141.901690:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788521141.901699:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019621ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+13:6517:x1875400222321536:12345-0@lo:101: 00010000:00010000:2.0:1788521141.901716:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521141.901743:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ff501c36/0x411dd0ee4d2d0f7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d0f77 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521141.901795:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ff501c36/0x411dd0ee4d2d0f7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0f77 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521141.901808:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ff501c36/0x411dd0ee4d2d0f7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0f77 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521141.901820:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ff501c36, rc 0) 00000100:00100000:2.0:1788521141.901876:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019621ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:6517:x1875400222321536:12345-0@lo:101: Request processed in 177us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521141.901902:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788521141.902022:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c3ec9152 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222321536:0@lo:101: 00010000:00010000:3.0:1788521141.902040:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: 000000006d59d46a/0x411dd0ee4d2d0f77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0f7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521141.902049:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: 000000006d59d46a/0x411dd0ee4d2d0f77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d0f7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521141.902109:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eacb2ca5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222321664:0@lo:256: 00000100:00100000:3.0:1788521141.902150:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521141.902167:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 0000000029df4f60 going to sleep for 11 seconds 00000100:00100000:3.0:1788521141.902183:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222321664 00000100:00100000:3.0:1788521141.902187:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222321664 00000100:00100000:3.0:1788521141.902225:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788521141.902232:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000603fa8fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:6517:x1875400222321664:12345-0@lo:256: 20000000:01000000:3.0:1788521141.902248:0:6512:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788521141.902268:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788521141.902271:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788521141.902349:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000603fa8fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:6517:x1875400222321664:12345-0@lo:256: Request processed in 117us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521141.902357:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788521141.902385:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eacb2ca5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222321664:0@lo:256: 10000000:01000000:3.0:1788521141.902426:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788521141.902432:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: 000000006d59d46a/0x411dd0ee4d2d0f77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0f7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521141.902440:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: 000000006d59d46a/0x411dd0ee4d2d0f77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0f7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521141.902450:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788521141.902452:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fef58328000 from 21 10000000:01000000:3.0:1788521141.902454:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788521141.902472:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: 0000000026f9be1f/0x411dd0ee4d2d0f85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521141.902479:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: 0000000026f9be1f/0x411dd0ee4d2d0f85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521141.902495:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: 0000000026f9be1f/0x411dd0ee4d2d0f85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521141.902506:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eacb2ca5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222321792:0@lo:101: 00000100:00100000:3.0:1788521141.902530:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521141.902542:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 0000000029df4f60 going to sleep for 11 seconds 00000100:00100000:3.0:1788521141.902553:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222321792 00000100:00100000:3.0:1788521141.902557:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222321792 00000100:00100000:3.0:1788521141.902573:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788521141.902578:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e982abf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:6517:x1875400222321792:12345-0@lo:101: 00010000:00010000:3.0:1788521141.902585:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521141.902593:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005e41df99/0x411dd0ee4d2d0f8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d0f85 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521141.902608:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005e41df99/0x411dd0ee4d2d0f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0f85 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521141.902616:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005e41df99/0x411dd0ee4d2d0f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0f85 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521141.902623:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005e41df99, rc 0) 00000100:00100000:3.0:1788521141.902647:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e982abf8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:6517:x1875400222321792:12345-0@lo:101: Request processed in 69us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521141.902654:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788521141.902678:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eacb2ca5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222321792:0@lo:101: 00010000:00010000:3.0:1788521141.902688:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: 0000000026f9be1f/0x411dd0ee4d2d0f85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0f8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521141.902705:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: 0000000026f9be1f/0x411dd0ee4d2d0f85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d0f8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521141.902770:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eacb2ca5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222321920:0@lo:501: 00000100:00100000:3.0:1788521141.902794:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521141.902806:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 0000000029df4f60 going to sleep for 11 seconds 00000100:00100000:3.0:1788521141.902816:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222321920 00000100:00100000:3.0:1788521141.902819:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222321920 00000100:00100000:3.0:1788521141.902835:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788521141.902840:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045d71e5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:6517:x1875400222321920:12345-0@lo:501: 00000100:00100000:3.0:1788521141.903000:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045d71e5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:6517:x1875400222321920:12345-0@lo:501: Request processed in 159us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521141.903007:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788521141.903033:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eacb2ca5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222321920:0@lo:501: 00000100:00100000:3.0:1788521141.903059:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eacb2ca5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222322048:0@lo:503: 00000100:00100000:3.0:1788521141.903102:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521141.903114:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 0000000029df4f60 going to sleep for 11 seconds 00000100:00100000:3.0:1788521141.903123:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222322048 00000100:00100000:3.0:1788521141.903127:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222322048 00000100:00100000:3.0:1788521141.903141:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788521141.903147:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bda8c0bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:6517:x1875400222322048:12345-0@lo:503: 00000100:00100000:3.0:1788521141.903226:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bda8c0bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:6517:x1875400222322048:12345-0@lo:503: Request processed in 79us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521141.903234:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788521141.903269:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eacb2ca5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222322048:0@lo:503: 00000100:00100000:3.0:1788521141.903515:0:7743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eacb2ca5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7743:1875400222322176:0@lo:502: 00000100:00100000:3.0:1788521141.903547:0:7743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521141.903566:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222322176 00000100:00100000:3.0:1788521141.903569:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222322176 00000100:00100000:3.0:1788521141.903586:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788521141.903591:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a2ab81a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:7743:x1875400222322176:12345-0@lo:502: 00000100:00100000:3.0:1788521141.903659:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a2ab81a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:7743:x1875400222322176:12345-0@lo:502: Request processed in 67us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521141.903666:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788521141.903690:0:7743:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a8797373 going to sleep for 11 seconds 00000100:00100000:3.0:1788521141.903701:0:7743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eacb2ca5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7743:1875400222322176:0@lo:502: 00000100:00100000:3.0:1788521141.903752:0:7743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eacb2ca5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7743:1875400222322304:0@lo:502: 00000100:00100000:3.0:1788521141.903782:0:7743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521141.903798:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222322304 00000100:00100000:3.0:1788521141.903802:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222322304 00000100:00100000:3.0:1788521141.903818:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788521141.903823:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000828107b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:7743:x1875400222322304:12345-0@lo:502: 00000100:00100000:3.0:1788521141.903914:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000828107b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:7743:x1875400222322304:12345-0@lo:502: Request processed in 90us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521141.903921:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788521141.903947:0:7743:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a8797373 going to sleep for 11 seconds 00000100:00100000:3.0:1788521141.903957:0:7743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eacb2ca5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7743:1875400222322304:0@lo:502: 00000040:00080000:3.0:1788521141.903974:0:7743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788521141.904032:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788521141.904048:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788521141.904057:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: 0000000026f9be1f/0x411dd0ee4d2d0f85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0f8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521141.904075:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: 0000000026f9be1f/0x411dd0ee4d2d0f85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0f8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521141.904084:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788521141.904086:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fef58328000 from 4 10000000:01000000:3.0:1788521141.904089:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788521141.904125:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: 00000000ca9db97c/0x411dd0ee4d2d0f93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521141.904132:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: 00000000ca9db97c/0x411dd0ee4d2d0f93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521141.904140:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: 00000000ca9db97c/0x411dd0ee4d2d0f93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521141.904152:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eacb2ca5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222322432:0@lo:101: 00000100:00100000:3.0:1788521141.904177:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521141.904190:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a8797373 going to sleep for 11 seconds 00000100:00100000:3.0:1788521141.904201:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222322432 00000100:00100000:3.0:1788521141.904204:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222322432 00000100:00100000:3.0:1788521141.904221:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788521141.904225:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001884bfee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:6517:x1875400222322432:12345-0@lo:101: 00010000:00010000:3.0:1788521141.904233:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521141.904245:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008678e1d9/0x411dd0ee4d2d0f9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d0f93 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521141.904267:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008678e1d9/0x411dd0ee4d2d0f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0f93 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521141.904287:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008678e1d9/0x411dd0ee4d2d0f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0f93 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521141.904297:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008678e1d9, rc 0) 00000100:00100000:3.0:1788521141.904322:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001884bfee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:6517:x1875400222322432:12345-0@lo:101: Request processed in 97us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521141.904328:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788521141.904353:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eacb2ca5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222322432:0@lo:101: 00010000:00010000:3.0:1788521141.904365:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: 00000000ca9db97c/0x411dd0ee4d2d0f93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0f9a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521141.904372:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: 00000000ca9db97c/0x411dd0ee4d2d0f93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d0f9a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521141.904409:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eacb2ca5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222322560:0@lo:256: 00000100:00100000:3.0:1788521141.904438:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521141.904449:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a8797373 going to sleep for 11 seconds 00000100:00100000:3.0:1788521141.904459:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222322560 00000100:00100000:3.0:1788521141.904462:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222322560 00000100:00100000:3.0:1788521141.904476:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788521141.904481:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000000df193 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:6517:x1875400222322560:12345-0@lo:256: 20000000:01000000:3.0:1788521141.904493:0:6512:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788521141.904509:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788521141.904513:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788521141.904577:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000000df193 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:6517:x1875400222322560:12345-0@lo:256: Request processed in 96us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521141.904585:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788521141.904614:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eacb2ca5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222322560:0@lo:256: 10000000:01000000:3.0:1788521141.904652:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788521141.904656:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: 00000000ca9db97c/0x411dd0ee4d2d0f93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0f9a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521141.904664:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: 00000000ca9db97c/0x411dd0ee4d2d0f93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0f9a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521141.904671:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788521141.904673:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788521141.904675:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788521141.904687:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: 00000000ea1ca7e4/0x411dd0ee4d2d0fa1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521141.904694:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: 00000000ea1ca7e4/0x411dd0ee4d2d0fa1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521141.904700:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: 00000000ea1ca7e4/0x411dd0ee4d2d0fa1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521141.904710:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eacb2ca5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222322688:0@lo:101: 00000100:00100000:3.0:1788521141.904748:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521141.904760:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a8797373 going to sleep for 11 seconds 00000100:00100000:3.0:1788521141.904771:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222322688 00000100:00100000:3.0:1788521141.904774:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222322688 00000100:00100000:3.0:1788521141.904789:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788521141.904793:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000739caaea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:6517:x1875400222322688:12345-0@lo:101: 00010000:00010000:3.0:1788521141.904800:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521141.904807:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000acae9c9e/0x411dd0ee4d2d0fa8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d0fa1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521141.904824:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000acae9c9e/0x411dd0ee4d2d0fa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0fa1 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521141.904832:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000acae9c9e/0x411dd0ee4d2d0fa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0fa1 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521141.904838:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000acae9c9e, rc 0) 00000100:00100000:3.0:1788521141.904861:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000739caaea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:6517:x1875400222322688:12345-0@lo:101: Request processed in 68us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521141.904867:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788521141.904917:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eacb2ca5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222322688:0@lo:101: 00010000:00010000:3.0:1788521141.904926:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: 00000000ea1ca7e4/0x411dd0ee4d2d0fa1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0fa8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521141.904932:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: 00000000ea1ca7e4/0x411dd0ee4d2d0fa1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d0fa8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521141.904975:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eacb2ca5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222322816:0@lo:501: 00000100:00100000:3.0:1788521141.905000:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521141.905011:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a8797373 going to sleep for 11 seconds 00000100:00100000:3.0:1788521141.905021:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222322816 00000100:00100000:3.0:1788521141.905024:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222322816 00000100:00100000:3.0:1788521141.905040:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788521141.905044:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a79798a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:6517:x1875400222322816:12345-0@lo:501: 00000100:00100000:3.0:1788521141.905141:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a79798a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:6517:x1875400222322816:12345-0@lo:501: Request processed in 97us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521141.905148:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788521141.905181:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eacb2ca5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222322816:0@lo:501: 00000100:00100000:3.0:1788521141.905204:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eacb2ca5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222322944:0@lo:503: 00000100:00100000:3.0:1788521141.905240:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521141.905252:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a8797373 going to sleep for 11 seconds 00000100:00100000:3.0:1788521141.905262:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222322944 00000100:00100000:3.0:1788521141.905265:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222322944 00000100:00100000:3.0:1788521141.905281:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788521141.905285:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f74bde4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:6517:x1875400222322944:12345-0@lo:503: 00000100:00100000:3.0:1788521141.905358:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f74bde4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:6517:x1875400222322944:12345-0@lo:503: Request processed in 72us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521141.905365:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788521141.905401:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eacb2ca5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222322944:0@lo:503: 00000100:00100000:3.0:1788521141.914544:0:7744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eacb2ca5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7744:1875400222323072:0@lo:502: 00000100:00100000:3.0:1788521141.914742:0:7744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521141.914864:0:7744:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a8797373 going to sleep for 11 seconds 00000100:00100000:0.0:1788521141.929230:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222323072 00000100:00100000:0.0:1788521141.929252:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222323072 00000100:00100000:0.0:1788521141.929346:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788521141.929356:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051d2e3c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:7744:x1875400222323072:12345-0@lo:502: 00000100:00100000:0.0:1788521141.929594:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051d2e3c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:7744:x1875400222323072:12345-0@lo:502: Request processed in 240us (14863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521141.929719:0:7744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eacb2ca5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7744:1875400222323072:0@lo:502: 00000020:01000000:3.0:1788521141.929787:0:7744:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521141.929804:0:7744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521141.929806:0:7744:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788521141.929812:0:7744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788521141.929816:0:7744:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.141@tcp to nid 0x20000c0a8cb8d (192.168.203.141@tcp) 00000020:00000080:3.0:1788521141.929855:0:7744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788521141.929908:0:7744:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000002a3c54bc) 00000020:00000080:3.0:1788521141.929936:0:7744:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1788521141.929944:0:7744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788521141.930045:0:7744:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788521141.930052:0:7744:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788521141.930068:0:7744:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x411dd0ee4d2d0fb6 00010000:00080000:3.0:1788521141.930105:0:7744:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003d5fabd9@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.141@tcp at head 00010000:00010000:3.0:1788521141.931800:0:7744:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000100:00100000:0.0:1788521141.932562:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000020:00000080:0.0:1788521141.936676:0:7744:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788521141.936696:0:7744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788521141.936745:0:7744:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788521141.936775:0:7744:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x411dd0ee4d2d0fbd 00000100:00080000:0.0:1788521141.936800:0:7744:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788521141.936807:0:7744:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000003d5fabd9 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:0.0:1788521141.936857:0:7744:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000092c8ccb8 x1875400222323200/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788521141.936916:0:7744:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:0.0:1788521141.936961:0:7744:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1788521141.937242:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092c8ccb8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222323200:0@lo:38: 00000100:00100000:1.0:1788521141.937338:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521141.937411:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000038b58c7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222323712:0@lo:400: 00000100:00100000:1.0:1788521141.937440:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521141.937464:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788521141.937470:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e99c3b42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222323328:0@lo:400: 00000100:00100000:1.0:1788521141.937500:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521141.937526:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000483cf50f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222323456:0@lo:400: 00000100:00100000:1.0:1788521141.937551:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521141.937569:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788521141.937574:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007a0975f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222323584:0@lo:400: 00000100:00100000:1.0:1788521141.937593:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521141.937624:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222323712 00000100:00100000:1.0:1788521141.937648:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222323712 00000100:00100000:1.0:1788521141.937696:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222323456 00000100:00100000:1.0:1788521141.937699:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222323456 00000100:00100000:1.0:1788521141.937717:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788521141.937724:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005617a428 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222323712:12345-0@lo:400: 00000100:00100000:1.0:1788521141.937791:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005617a428 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222323712:12345-0@lo:400: Request processed in 68us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521141.937799:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788521141.937816:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788521141.937821:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fce0fd3f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222323456:12345-0@lo:400: 00000100:00100000:1.0:1788521141.937847:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fce0fd3f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222323456:12345-0@lo:400: Request processed in 27us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521141.937852:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788521141.937869:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222323328 00000100:00100000:1.0:1788521141.937872:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222323328 00000100:00100000:1.0:1788521141.937926:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788521141.937932:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1e752de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:3645:x1875400222323328:12345-0@lo:400: 00000100:00100000:1.0:1788521141.937960:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1e752de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:3645:x1875400222323328:12345-0@lo:400: Request processed in 30us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521141.937966:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788521141.937996:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222323200 00000100:00100000:1.0:1788521141.937999:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222323200 00000100:00100000:1.0:1788521141.938011:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222323584 00000100:00100000:1.0:1788521141.938013:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222323584 00000100:00100000:1.0:1788521141.938027:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788521141.938032:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a3d62eb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1875400222323200:12345-0@lo:38: 00010000:00080000:1.0:1788521141.938055:0:6524:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:1.0:1788521141.938095:0:6524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x411dd0ee4d2d0fc4 00000004:00100000:1.0:1788521141.938118:0:6524:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788521141.938125:0:6524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00080000:1.0:1788521141.938239:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000483cf50f x1875400222323456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521141.938255:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000483cf50f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222323456:0@lo:400: 00000100:00100000:1.0:1788521141.938286:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e99c3b42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222323328:0@lo:400: 00010000:00080000:1.0:1788521141.938295:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000038b58c7a x1875400222323712/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521141.938302:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000038b58c7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222323712:0@lo:400: 00000100:00080000:2.0:1788521141.938687:0:7748:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000c577741d x1875400222323840/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521141.938698:0:7748:0:(client.c:2716:ptlrpc_set_wait()) set 00000000336df11c going to sleep for 0 seconds 00000020:01000000:0.0:1788521141.938833:0:7744:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521141.938840:0:7744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521141.938842:0:7744:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788521141.938846:0:7744:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521141.938851:0:7744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521141.938852:0:7744:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788521141.938856:0:7744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788521141.938863:0:7744:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788521141.938934:0:7744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cae20e3a pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7744:1875400222323968:0@lo:502: 00000100:00100000:0.0:1788521141.938991:0:7744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521141.939026:0:7744:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fb322576 going to sleep for 11 seconds 00000100:00100000:2.0:1788521141.939091:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222323968 00000100:00100000:2.0:1788521141.939097:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222323968 00000100:00100000:2.0:1788521141.939136:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788521141.939143:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000509a5491 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:7744:x1875400222323968:12345-0@lo:502: 00000100:00100000:2.0:1788521141.939261:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000509a5491 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:7744:x1875400222323968:12345-0@lo:502: Request processed in 119us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521141.939268:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788521141.939417:0:7744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cae20e3a pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7744:1875400222323968:0@lo:502: 00000020:01000000:0.0:1788521141.939444:0:7744:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521141.939449:0:7744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521141.939450:0:7744:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788521141.939455:0:7744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1788521141.939650:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788521141.939671:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788521141.939681:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: 00000000ea1ca7e4/0x411dd0ee4d2d0fa1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0fa8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521141.939692:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: 00000000ea1ca7e4/0x411dd0ee4d2d0fa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0fa8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521141.939715:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788521141.939718:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8fef4e780000 from 1 10000000:01000000:2.0:1788521141.939721:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788521141.939762:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: 0000000088ad40b3/0x411dd0ee4d2d0fcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521141.939769:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: 0000000088ad40b3/0x411dd0ee4d2d0fcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521141.939789:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: 0000000088ad40b3/0x411dd0ee4d2d0fcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521141.939804:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a49617ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222324096:0@lo:101: 00000100:00100000:2.0:1788521141.939838:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521141.939859:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000939fec37 going to sleep for 11 seconds 00000100:00100000:1.0:1788521141.940928:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222324096 00000100:00100000:1.0:1788521141.940942:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222324096 00000100:00100000:1.0:1788521141.941000:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788521141.941010:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d652ef2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:6517:x1875400222324096:12345-0@lo:101: 00010000:00010000:1.0:1788521141.941027:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521141.941046:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004701b9f7/0x411dd0ee4d2d0fd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d0fcb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521141.941077:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004701b9f7/0x411dd0ee4d2d0fd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0fcb expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521141.941089:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004701b9f7/0x411dd0ee4d2d0fd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0fcb expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521141.941099:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004701b9f7, rc 0) 00000100:00100000:1.0:1788521141.941171:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d652ef2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:6517:x1875400222324096:12345-0@lo:101: Request processed in 163us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521141.941187:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788521141.941446:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a49617ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222324096:0@lo:101: 00010000:00010000:0.0:1788521141.941467:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: 0000000088ad40b3/0x411dd0ee4d2d0fcb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0fd2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521141.941477:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: 0000000088ad40b3/0x411dd0ee4d2d0fcb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d0fd2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521141.941557:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cae20e3a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222324224:0@lo:501: 00000100:00100000:0.0:1788521141.941592:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521141.941686:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fb322576 going to sleep for 11 seconds 00000100:00100000:1.0:1788521141.941740:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222324224 00000100:00100000:1.0:1788521141.941746:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222324224 00000100:00100000:1.0:1788521141.941845:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788521141.941853:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d70ab8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:6517:x1875400222324224:12345-0@lo:501: 00000100:00100000:1.0:1788521141.942071:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d70ab8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:6517:x1875400222324224:12345-0@lo:501: Request processed in 219us (479us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788521141.942079:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788521141.943865:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cae20e3a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222324224:0@lo:501: 10000000:01000000:0.0:1788521141.943951:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788521141.943965:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: 0000000088ad40b3/0x411dd0ee4d2d0fcb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0fd2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521141.943977:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: 0000000088ad40b3/0x411dd0ee4d2d0fcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0fd2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788521141.961965:0:6524:0:(import.c:65:import_set_state_nolock()) 000000008c7135c4 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788521141.962116:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a3d62eb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1875400222323200:12345-0@lo:38: Request processed in 24081us (24776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521141.962130:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788521141.962150:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:3.0:1788521141.962177:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788521141.962180:0:3642:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788521141.962192:0:3642:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788521141.962200:0:3642:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788521141.962202:0:3642:0:(import.c:65:import_set_state_nolock()) 000000003d5fabd9 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788521141.962227:0:3642:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000336df11c): req@00000000c577741d x1875400222323840/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521141.962245:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092c8ccb8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222323200:0@lo:38: 00000100:00100000:3.0:1788521141.963315:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034860e45 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222323584:12345-0@lo:400: 00000100:00100000:3.0:1788521141.963448:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034860e45 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222323584:12345-0@lo:400: Request processed in 1262us (25853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521141.963458:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788521141.964378:0:7748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521141.964422:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222323840 00000100:00100000:2.0:1788521141.964431:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222323840 00000100:00100000:2.0:1788521141.964476:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788521141.964483:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1620890 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7748:x1875400222323840:12345-0@lo:1000: 00000100:00100000:2.0:1788521141.964559:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1620890 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7748:x1875400222323840:12345-0@lo:1000: Request processed in 77us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521141.964566:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788521141.964620:0:7748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c577741d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7748:1875400222323840:0@lo:1000: 00000040:01000000:2.0:1788521141.964666:0:7748:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788521141.964714:0:7748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c577741d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7748:1875400222324352:0@lo:1000: 00000100:00100000:2.0:1788521141.964760:0:7748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521141.964793:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222324352 00000100:00100000:2.0:1788521141.964797:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222324352 00000100:00100000:2.0:1788521141.964812:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788521141.964817:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e389d81 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7748:x1875400222324352:12345-0@lo:1000: 00000100:00100000:2.0:1788521141.964931:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e389d81 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7748:x1875400222324352:12345-0@lo:1000: Request processed in 113us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521141.964937:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788521141.964951:0:7748:0:(client.c:2716:ptlrpc_set_wait()) set 00000000336df11c going to sleep for 11 seconds 00000100:00100000:2.0:1788521141.964963:0:7748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c577741d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7748:1875400222324352:0@lo:1000: 00000100:00100000:2.0:1788521141.965001:0:7748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c577741d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7748:1875400222324480:0@lo:700: 00000100:00100000:2.0:1788521141.965026:0:7748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521141.965040:0:7748:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e5ab2935 going to sleep for 11 seconds 00000100:00100000:2.0:1788521141.965083:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788521141.965093:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a49617ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222324608:0@lo:41: 00000100:00100000:2.0:1788521141.965115:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521141.965134:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222324608 00000100:00100000:2.0:1788521141.965137:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222324608 00000100:00100000:2.0:1788521141.965153:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788521141.965157:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038b58c7a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1875400222324608:12345-0@lo:41: 00000004:00000024:2.0:1788521141.965182:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788521141.965216:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038b58c7a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1875400222324608:12345-0@lo:41: Request processed in 59us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521141.965223:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788521141.965250:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a49617ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222324608:0@lo:41: 00000100:00100000:0.0:1788521141.966268:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007a0975f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222323584:0@lo:400: 00000100:00100000:0.0:1788521141.966324:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222324480 00000100:00100000:0.0:1788521141.966331:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222324480 00000100:00100000:0.0:1788521141.966370:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788521141.966379:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a886658 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7748:x1875400222324480:12345-0@lo:700: 00000100:00100000:0.0:1788521141.966458:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a886658 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7748:x1875400222324480:12345-0@lo:700: Request processed in 81us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521141.966480:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788521141.966855:0:7748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c577741d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7748:1875400222324480:0@lo:700: 00000100:00100000:2.0:1788521141.967112:0:7748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c577741d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7748:1875400222324736:0@lo:1000: 00000100:00100000:2.0:1788521141.967172:0:7748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521141.967261:0:7748:0:(client.c:2716:ptlrpc_set_wait()) set 0000000092fc4bd7 going to sleep for 11 seconds 00000100:00100000:3.0:1788521141.971840:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222324736 00000100:00100000:3.0:1788521141.971860:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222324736 00000100:00100000:2.0:1788521141.972051:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788521141.972063:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a49617ea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7748:x1875400222324736:12345-0@lo:1000: 00000100:00100000:2.0:1788521141.972230:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a49617ea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7748:x1875400222324736:12345-0@lo:1000: Request processed in 170us (5060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521141.972239:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788521141.972299:0:7748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c577741d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7748:1875400222324736:0@lo:1000: 00000004:00080000:2.0:1788521141.972385:0:7748:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000e5ab2935 with version 0 00000020:00100000:2.0:1788521141.972415:0:7748:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788521141.972423:0:7748:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000c577741d x1875400222324992/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788521141.972446:0:7748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c577741d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7748:1875400222324992:0@lo:1000: 00000100:00100000:2.0:1788521141.972491:0:7748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521141.972520:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222324992 00000100:00100000:0.0:1788521141.972527:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222324992 00000100:00100000:2.0:1788521141.972530:0:7748:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a9122e6f going to sleep for 11 seconds 00000100:00100000:0.0:1788521141.972567:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788521141.972576:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e99c3b42 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7748:x1875400222324992:12345-0@lo:1000: 00000001:00080000:2.0:1788521141.979791:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1788521141.979809:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788521141.983942:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e99c3b42 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7748:x1875400222324992:12345-0@lo:1000: Request processed in 11355us (11438us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788521141.983962:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1788521141.984280:0:7748:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1788521141.984287:0:7748:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788521141.984307:0:7748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c577741d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7748:1875400222324992:0@lo:1000: 00000100:00100000:2.0:1788521141.984424:0:7748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c577741d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7748:1875400222325120:0@lo:1000: 00000100:00100000:2.0:1788521141.984474:0:7748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521141.984522:0:7748:0:(client.c:2716:ptlrpc_set_wait()) set 00000000336df11c going to sleep for 11 seconds 00000100:00100000:3.0:1788521141.984584:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222325120 00000100:00100000:3.0:1788521141.984593:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222325120 00000100:00100000:3.0:1788521141.984650:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788521141.984659:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000483cf50f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7748:x1875400222325120:12345-0@lo:1000: 00000100:00100000:3.0:1788521141.984766:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000483cf50f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7748:x1875400222325120:12345-0@lo:1000: Request processed in 108us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521141.984772:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788521141.984859:0:7748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c577741d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7748:1875400222325120:0@lo:1000: 00000040:00080000:2.0:1788521141.984879:0:7748:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1788521141.984949:0:7748:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000e5ab2935 with version 1 00000004:00080000:1.0:1788521141.985920:0:7746:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000d50b0689 version 1 rpc_version 1 00000020:00100000:1.0:1788521141.985955:0:7746:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788521141.985968:0:7746:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000c1b9d2fc x1875400222325376/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788521141.985989:0:7746:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c1b9d2fc pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7746:1875400222325376:0@lo:1000: 00000100:00100000:1.0:1788521141.986042:0:7746:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521141.986089:0:7746:0:(client.c:2716:ptlrpc_set_wait()) set 0000000067f8f641 going to sleep for 11 seconds 00000100:00100000:3.0:1788521141.986582:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222325376 00000100:00100000:3.0:1788521141.986592:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222325376 00000100:00100000:3.0:1788521141.986650:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788521141.986659:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005bb905a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7746:x1875400222325376:12345-0@lo:1000: 00000040:00080000:2.0:1788521141.990488:0:7748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788521141.990614:0:7748:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788521141.990621:0:7748:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:1.0:1788521141.992237:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:3.0:1788521141.993107:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005bb905a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7746:x1875400222325376:12345-0@lo:1000: Request processed in 6442us (7057us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788521141.993124:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:1.0:1788521141.993161:0:7746:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1788521141.993168:0:7746:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788521141.993192:0:7746:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c1b9d2fc pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7746:1875400222325376:0@lo:1000: 00000020:00000004:2.0:1788521142.461873:0:7777:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788521142.462330:0:7777:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788521142.480633:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521143.501489:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521144.525685:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521145.549138:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788521145.896165:0:7879:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788521145.897251:0:7879:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788521146.510733:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c1b9d2fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222325504:0@lo:41: 00000100:00100000:0.0:1788521146.510835:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521146.511210:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222325504 00000100:00100000:1.0:1788521146.511220:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222325504 00000100:00100000:1.0:1788521146.511289:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788521146.511298:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000092c8ccb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222325504:12345-0@lo:41: 00000004:00000024:1.0:1788521146.511341:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1788521146.511393:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000092c8ccb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222325504:12345-0@lo:41: Request processed in 97us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521146.511412:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788521146.511974:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c1b9d2fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222325504:0@lo:41: 00010000:00010000:0.0:1788521146.574642:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521147.021319:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c577741d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222325632:0@lo:41: 00000100:00100000:1.0:1788521147.021420:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521147.023735:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004dcf68d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875400222325888:0@lo:400: 00000100:00100000:2.0:1788521147.023825:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521147.023910:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788521147.023917:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eacb2ca5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222325760:0@lo:400: 00000100:00100000:2.0:1788521147.023951:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521147.023998:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222325888 00000100:00100000:2.0:1788521147.024008:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222325888 00000100:00100000:2.0:1788521147.024070:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788521147.024079:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a0975f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875400222325888:12345-0@lo:400: 00000100:00100000:2.0:1788521147.024138:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a0975f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875400222325888:12345-0@lo:400: Request processed in 60us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521147.024146:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788521147.024172:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222325760 00000100:00100000:2.0:1788521147.024175:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222325760 00000100:00100000:2.0:1788521147.024205:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788521147.024212:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a450354c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:3646:x1875400222325760:12345-0@lo:400: 00000100:00100000:2.0:1788521147.024241:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a450354c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:3646:x1875400222325760:12345-0@lo:400: Request processed in 31us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521147.024247:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788521147.024300:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eacb2ca5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222325760:0@lo:400: 00010000:00080000:2.0:1788521147.024332:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000004dcf68d9 x1875400222325888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521147.024346:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004dcf68d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875400222325888:0@lo:400: 00000100:00100000:2.0:1788521147.024381:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd4e6e2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222326016:0@lo:400: 00000100:00100000:2.0:1788521147.024428:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521147.024480:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222325632 00000100:00100000:2.0:1788521147.024484:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222325632 00000100:00100000:2.0:1788521147.024506:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222326016 00000100:00100000:2.0:1788521147.024509:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222326016 00000100:00100000:2.0:1788521147.024522:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788521147.024528:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017cca621 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222325632:12345-0@lo:41: 00000004:00000024:2.0:1788521147.024563:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788521147.030125:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788521147.030151:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031bcc58d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875400222326144:0@lo:400: 00000100:00100000:3.0:1788521147.030241:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521147.030299:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222326144 00000100:00100000:3.0:1788521147.030311:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222326144 00000100:00100000:3.0:1788521147.030375:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788521147.030384:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f583c335 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875400222326144:12345-0@lo:400: 00000100:00100000:3.0:1788521147.030449:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f583c335 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875400222326144:12345-0@lo:400: Request processed in 65us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521147.030456:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788521147.030502:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000031bcc58d x1875400222326144/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521147.030517:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031bcc58d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875400222326144:0@lo:400: 00000100:00100000:2.0:1788521147.030708:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017cca621 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222325632:12345-0@lo:41: Request processed in 6178us (9287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521147.030719:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788521147.030743:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788521147.030751:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0265ed8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222326016:12345-0@lo:400: 00000100:00100000:2.0:1788521147.030790:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0265ed8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222326016:12345-0@lo:400: Request processed in 42us (6363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521147.030795:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788521147.030954:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd4e6e2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222326016:0@lo:400: 00000100:00100000:1.0:1788521147.034974:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c577741d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222325632:0@lo:41: 00000020:00000080:0.0:1788521147.215183:0:7927:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee1a81f40 20000000:00000080:0.0:1788521147.215208:0:7927:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8fef76581c00 uarg=0000000000000000 20000000:01000000:0.0:1788521147.215264:0:7927:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788521147.215279:0:7927:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788521147.215285:0:7927:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788521147.215383:0:7927:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788521147.215401:0:7927:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788521147.226091:0:7927:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788521147.226400:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788521147.226439:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788521147.227857:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788521147.228020:0:7927:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788521147.228049:0:7927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009a8f2ee6/0x411dd0ee4d2d0fd9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521147.228073:0:7927:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a3e1913a/0x411dd0ee4d2d0e58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0e51 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521147.228080:0:7927:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f0ec8767/0x411dd0ee4d2d0f46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0f3f expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521147.228087:0:7927:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000009a8f2ee6/0x411dd0ee4d2d0fd9 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521147.228142:0:7927:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f0ec8767/0x411dd0ee4d2d0f46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d0f3f expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521147.228160:0:7927:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f0ec8767/0x411dd0ee4d2d0f46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0f3f expref: 17 pid: 6512 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521147.228176:0:7927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c1b9d2fc pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1875400222326272:0@lo:104: 00000100:00100000:1.0:1788521147.228266:0:7927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788521147.228412:0:7927:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a3e1913a/0x411dd0ee4d2d0e58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d0e51 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521147.228420:0:7927:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a3e1913a/0x411dd0ee4d2d0e58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0e51 expref: 17 pid: 6513 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521147.228429:0:7927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000090b4bbd0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1875400222326400:0@lo:104: 00000100:00100000:1.0:1788521147.228448:0:7927:0:(client.c:2716:ptlrpc_set_wait()) set 000000001cfebd37 going to sleep for 11 seconds 00000100:00100000:0.0:1788521147.230914:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788521147.230972:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521147.231017:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222326272 00000100:00100000:0.0:1788521147.231029:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222326272 00000100:00100000:0.0:1788521147.231078:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222326400 00000100:00100000:0.0:1788521147.231081:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222326400 00000100:00100000:0.0:1788521147.231095:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788521147.231103:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013ce2a4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+4:7927:x1875400222326272:12345-0@lo:104: 00010000:00010000:0.0:1788521147.231125:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: 000000000900d867/0x411dd0ee4d2d0f3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0f46 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521147.231214:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788521147.231219:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013ce2a4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+4:7927:x1875400222326272:12345-0@lo:104: Request processed in 118us (2955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521147.231227:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788521147.231272:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788521147.231278:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cae20e3a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:7927:x1875400222326400:12345-0@lo:104: 00010000:00010000:0.0:1788521147.231286:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: 000000000a6c2f7b/0x411dd0ee4d2d0e51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0e58 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521147.231319:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788521147.231323:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cae20e3a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:7927:x1875400222326400:12345-0@lo:104: Request processed in 46us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521147.231329:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1788521147.231435:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788521147.231441:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: 000000000900d867/0x411dd0ee4d2d0f3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0f46 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521147.231449:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000900d867 already unused, calling callback (000000003f0cc38c) 10000000:00010000:3.0:1788521147.231453:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: 000000000900d867/0x411dd0ee4d2d0f3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d0f46 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521147.231480:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: 000000000900d867/0x411dd0ee4d2d0f3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d0f46 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521147.231486:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: 000000000900d867/0x411dd0ee4d2d0f3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d0f46 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521147.231492:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788521147.231541:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: 000000000900d867/0x411dd0ee4d2d0f3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0f46 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521147.231549:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521147.231581:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: 000000000900d867/0x411dd0ee4d2d0f3f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0f46 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521147.231588:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: 000000000900d867/0x411dd0ee4d2d0f3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0f46 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521147.231607:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521147.231609:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: 000000000a6c2f7b/0x411dd0ee4d2d0e51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0e58 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521147.231615:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000a6c2f7b already unused, calling callback (000000003f0cc38c) 10000000:00010000:3.0:1788521147.231617:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: 000000000a6c2f7b/0x411dd0ee4d2d0e51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d0e58 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521147.231624:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: 000000000a6c2f7b/0x411dd0ee4d2d0e51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d0e58 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521147.231630:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: 000000000a6c2f7b/0x411dd0ee4d2d0e51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d0e58 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521147.231643:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788521147.231658:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: 000000000a6c2f7b/0x411dd0ee4d2d0e51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0e58 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521147.231664:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521147.231669:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: 000000000a6c2f7b/0x411dd0ee4d2d0e51 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0e58 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521147.231675:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: 000000000a6c2f7b/0x411dd0ee4d2d0e51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0e58 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521147.231703:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521147.231705:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521147.231706:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521147.231714:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521147.231742:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd4e6e2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222326528:0@lo:103: 00000100:00100000:3.0:1788521147.231787:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521147.232199:0:7927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c1b9d2fc pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1875400222326272:0@lo:104: 00000100:00100000:2.0:1788521147.232211:0:7927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000090b4bbd0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1875400222326400:0@lo:104: 00010000:00010000:2.0:1788521147.232238:0:7927:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000009a8f2ee6/0x411dd0ee4d2d0fd9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521147.232329:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788521147.232336:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031bcc58d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222326656:0@lo:103: 00000100:00100000:3.0:1788521147.232368:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521147.232418:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222326528 00000100:00100000:3.0:1788521147.232425:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222326528 00010000:00010000:3.0:1788521147.232452:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f0ec8767/0x411dd0ee4d2d0f46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0f3f expref: 18 pid: 6512 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521147.232520:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222326656 00000100:00100000:3.0:1788521147.232524:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222326656 00010000:00010000:3.0:1788521147.232538:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a3e1913a/0x411dd0ee4d2d0e58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0e51 expref: 19 pid: 6513 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521147.232838:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788521147.232855:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ae374c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+19:3645:x1875400222326528:12345-0@lo:103: 00010000:00010000:2.0:1788521147.232870:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521147.232876:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f0ec8767/0x411dd0ee4d2d0f46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0f3f expref: 19 pid: 6512 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521147.232912:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f0ec8767/0x411dd0ee4d2d0f46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0f3f expref: 19 pid: 6512 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521147.232931:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f0ec8767/0x411dd0ee4d2d0f46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d0f3f expref: 19 pid: 6512 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521147.232947:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521147.232988:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ae374c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:3645:x1875400222326528:12345-0@lo:103: Request processed in 135us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521147.232994:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788521147.233013:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788521147.233018:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004dcf68d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:3645:x1875400222326656:12345-0@lo:103: 00010000:00010000:2.0:1788521147.233026:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521147.233029:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a3e1913a/0x411dd0ee4d2d0e58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0e51 expref: 17 pid: 6513 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521147.233036:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a3e1913a/0x411dd0ee4d2d0e58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0e51 expref: 17 pid: 6513 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521147.233044:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a3e1913a/0x411dd0ee4d2d0e58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d0e51 expref: 17 pid: 6513 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521147.233054:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000009a8f2ee6/0x411dd0ee4d2d0fd9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521147.233071:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009a8f2ee6/0x411dd0ee4d2d0fd9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521147.233087:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009a8f2ee6/0x411dd0ee4d2d0fd9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521147.233094:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009a8f2ee6/0x411dd0ee4d2d0fd9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521147.233100:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009a8f2ee6/0x411dd0ee4d2d0fd9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521147.233106:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009a8f2ee6/0x411dd0ee4d2d0fd9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521147.233112:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009a8f2ee6 already unused, calling callback (0000000099446ad8) 00010000:00010000:2.0:1788521147.233117:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009a8f2ee6/0x411dd0ee4d2d0fd9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521147.233123:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009a8f2ee6/0x411dd0ee4d2d0fd9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521147.233135:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009a8f2ee6/0x411dd0ee4d2d0fd9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521147.233144:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521147.233167:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004dcf68d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:3645:x1875400222326656:12345-0@lo:103: Request processed in 149us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521147.233173:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1788521147.233194:0:7927:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000009a8f2ee6/0x411dd0ee4d2d0fd9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521147.233206:0:7927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009a8f2ee6/0x411dd0ee4d2d0fd9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521147.233211:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009a8f2ee6/0x411dd0ee4d2d0fd9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521147.240004:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031bcc58d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222326656:0@lo:103: 00000100:00100000:3.0:1788521147.240025:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd4e6e2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222326528:0@lo:103: 00010000:00010000:0.0:1788521147.597074:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788521148.052243:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788521148.052256:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fef81580000 from 1 10000000:01000000:0.0:1788521148.052262:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788521148.052327:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: 0000000047511951/0x411dd0ee4d2d0fe0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521148.052344:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: 0000000047511951/0x411dd0ee4d2d0fe0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521148.052357:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: 0000000047511951/0x411dd0ee4d2d0fe0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521148.052388:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b023fa20 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222326784:0@lo:101: 00000100:00100000:0.0:1788521148.052486:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521148.052567:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 0000000092527bcc going to sleep for 11 seconds 00000100:00100000:2.0:1788521148.053036:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222326784 00000100:00100000:2.0:1788521148.053047:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222326784 00000100:00100000:2.0:1788521148.053114:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788521148.053123:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000084f293c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:6517:x1875400222326784:12345-0@lo:101: 00010000:00010000:2.0:1788521148.053139:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521148.053157:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008624e10f/0x411dd0ee4d2d0fe7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d0fe0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521148.053185:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008624e10f/0x411dd0ee4d2d0fe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0fe0 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521148.053196:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008624e10f/0x411dd0ee4d2d0fe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0fe0 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521148.053206:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008624e10f, rc 0) 00000100:00100000:2.0:1788521148.053260:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000084f293c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:6517:x1875400222326784:12345-0@lo:101: Request processed in 138us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521148.053267:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788521148.053461:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b023fa20 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222326784:0@lo:101: 00010000:00010000:0.0:1788521148.053480:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: 0000000047511951/0x411dd0ee4d2d0fe0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0fe7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521148.053490:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: 0000000047511951/0x411dd0ee4d2d0fe0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d0fe7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521148.053582:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b023fa20 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222326912:0@lo:501: 00000100:00100000:0.0:1788521148.053615:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521148.053646:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 0000000092527bcc going to sleep for 11 seconds 00000100:00100000:2.0:1788521148.053807:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222326912 00000100:00100000:2.0:1788521148.053813:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222326912 00000100:00100000:2.0:1788521148.053849:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788521148.053855:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041d56816 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:6517:x1875400222326912:12345-0@lo:501: 00000100:00100000:2.0:1788521148.054029:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041d56816 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:6517:x1875400222326912:12345-0@lo:501: Request processed in 175us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521148.054036:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788521148.054065:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b023fa20 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222326912:0@lo:501: 00000100:00100000:2.0:1788521148.054093:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000067f6618d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222327040:0@lo:503: 00000100:00100000:2.0:1788521148.054130:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521148.054147:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f7e8d8fe going to sleep for 11 seconds 00000100:00100000:2.0:1788521148.054157:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222327040 00000100:00100000:2.0:1788521148.054160:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222327040 00000100:00100000:2.0:1788521148.054177:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788521148.054197:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6d515db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:6517:x1875400222327040:12345-0@lo:503: 00000100:00100000:2.0:1788521148.054278:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6d515db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:6517:x1875400222327040:12345-0@lo:503: Request processed in 82us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521148.054285:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788521148.054327:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000067f6618d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222327040:0@lo:503: 00000100:00100000:2.0:1788521148.054538:0:7947:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000067f6618d pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7947:1875400222327168:0@lo:502: 00000100:00100000:2.0:1788521148.054571:0:7947:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521148.054589:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222327168 00000100:00100000:2.0:1788521148.054593:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222327168 00000100:00100000:2.0:1788521148.054611:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788521148.054615:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016af9256 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:7947:x1875400222327168:12345-0@lo:502: 00000100:00100000:2.0:1788521148.054705:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016af9256 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:7947:x1875400222327168:12345-0@lo:502: Request processed in 89us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521148.054712:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788521148.054739:0:7947:0:(client.c:2716:ptlrpc_set_wait()) set 00000000336df11c going to sleep for 11 seconds 00000100:00100000:2.0:1788521148.054756:0:7947:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000067f6618d pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7947:1875400222327168:0@lo:502: 00000020:01000000:2.0:1788521148.054777:0:7947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521148.054788:0:7947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521148.054791:0:7947:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788521148.054799:0:7947:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fef81580000 00000020:00000080:2.0:1788521148.054801:0:7947:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788521148.054849:0:7947:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7947:1875400222327296:0@lo:502: 00000100:00100000:2.0:1788521148.054910:0:7947:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521148.054929:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222327296 00000100:00100000:2.0:1788521148.054932:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222327296 00000100:00100000:2.0:1788521148.054948:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788521148.054954:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:7947:x1875400222327296:12345-0@lo:502: 00000100:00100000:2.0:1788521148.055012:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:7947:x1875400222327296:12345-0@lo:502: Request processed in 57us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521148.055018:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788521148.055050:0:7947:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef6dbc2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788521148.055060:0:7947:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7947:1875400222327296:0@lo:502: 00000020:01000000:2.0:1788521148.055077:0:7947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521148.055081:0:7947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521148.055082:0:7947:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788521148.055086:0:7947:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788521148.055562:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788521148.055589:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788521148.055601:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef40030400/0x411dd0ee4d2d0fe0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0fe7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521148.055612:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef40030400/0x411dd0ee4d2d0fe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0fe7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521148.055624:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788521148.055627:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fef58328000 from 1 10000000:01000000:3.0:1788521148.055630:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788521148.055661:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749cb400/0x411dd0ee4d2d0fee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521148.055670:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef749cb400/0x411dd0ee4d2d0fee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521148.055678:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef749cb400/0x411dd0ee4d2d0fee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521148.055706:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71523100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222327424:0@lo:101: 00000100:00100000:3.0:1788521148.055744:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521148.055768:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef6da1a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521148.056439:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222327424 00000100:00100000:0.0:1788521148.056449:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222327424 00000100:00100000:0.0:1788521148.056507:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788521148.056518:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:6517:x1875400222327424:12345-0@lo:101: 00010000:00010000:0.0:1788521148.056549:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521148.056576:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef40030800/0x411dd0ee4d2d0ff5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d0fee expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521148.056608:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef40030800/0x411dd0ee4d2d0ff5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0fee expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521148.056620:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef40030800/0x411dd0ee4d2d0ff5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0fee expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521148.056630:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef40030800, rc 0) 00000100:00100000:0.0:1788521148.056684:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:6517:x1875400222327424:12345-0@lo:101: Request processed in 168us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521148.056703:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788521148.059913:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71523100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222327424:0@lo:101: 00010000:00010000:3.0:1788521148.059950:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef749cb400/0x411dd0ee4d2d0fee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0ff5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521148.059976:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef749cb400/0x411dd0ee4d2d0fee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d0ff5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521148.060077:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71523100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222327552:0@lo:501: 00000100:00100000:3.0:1788521148.060151:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521148.060202:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef6da1a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521148.060255:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222327552 00000100:00100000:0.0:1788521148.060263:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222327552 00000100:00100000:0.0:1788521148.060322:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788521148.060333:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:6517:x1875400222327552:12345-0@lo:501: 00000100:00100000:0.0:1788521148.060486:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:6517:x1875400222327552:12345-0@lo:501: Request processed in 154us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521148.060494:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788521148.064337:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71523100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222327552:0@lo:501: 00000100:00100000:1.0:1788521148.064430:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef6e4bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222327680:0@lo:503: 00000100:00100000:1.0:1788521148.064526:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521148.064646:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef816c2840 going to sleep for 11 seconds 00000100:00100000:3.0:1788521148.064710:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222327680 00000100:00100000:3.0:1788521148.064719:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222327680 00000100:00100000:3.0:1788521148.064842:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788521148.064856:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:6517:x1875400222327680:12345-0@lo:503: 00000100:00100000:3.0:1788521148.065129:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:6517:x1875400222327680:12345-0@lo:503: Request processed in 274us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521148.065138:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788521148.065585:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef6e4bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222327680:0@lo:503: 00000100:00100000:1.0:1788521148.066803:0:7948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef6e4bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7948:1875400222327808:0@lo:502: 00000100:00100000:1.0:1788521148.067003:0:7948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521148.067085:0:7948:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef816c2180 going to sleep for 11 seconds 00000100:00100000:3.0:1788521148.067532:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222327808 00000100:00100000:3.0:1788521148.067542:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222327808 00000100:00100000:3.0:1788521148.067657:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788521148.067668:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:7948:x1875400222327808:12345-0@lo:502: 00000100:00100000:3.0:1788521148.067932:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:7948:x1875400222327808:12345-0@lo:502: Request processed in 265us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521148.067940:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788521148.068043:0:7948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef6e4bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7948:1875400222327808:0@lo:502: 00000020:01000000:1.0:1788521148.068080:0:7948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788521148.068092:0:7948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521148.068094:0:7948:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788521148.068102:0:7948:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fef58328000 00000020:00000080:1.0:1788521148.068104:0:7948:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788521148.068135:0:7948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef6e4bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7948:1875400222327936:0@lo:502: 00000100:00100000:1.0:1788521148.068172:0:7948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521148.068197:0:7948:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef816c2180 going to sleep for 11 seconds 00000100:00100000:2.0:1788521148.068432:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222327936 00000100:00100000:2.0:1788521148.068439:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222327936 00000100:00100000:2.0:1788521148.068479:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788521148.068487:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:7948:x1875400222327936:12345-0@lo:502: 00000100:00100000:2.0:1788521148.068597:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:7948:x1875400222327936:12345-0@lo:502: Request processed in 111us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521148.068605:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788521148.068797:0:7948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef6e4bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:7948:1875400222327936:0@lo:502: 00000020:01000000:1.0:1788521148.068817:0:7948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788521148.068826:0:7948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521148.068829:0:7948:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788521148.068833:0:7948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788521148.069049:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788521148.069074:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788521148.069086:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749cb400/0x411dd0ee4d2d0fee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0ff5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521148.069099:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef749cb400/0x411dd0ee4d2d0fee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0ff5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521148.622194:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521149.645267:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521150.672125:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521151.634115:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222328064:0@lo:41: 00000100:00100000:3.0:1788521151.634208:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521151.634312:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222328064 00000100:00100000:0.0:1788521151.634323:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222328064 00000100:00100000:0.0:1788521151.634387:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788521151.634399:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222328064:12345-0@lo:41: 00000004:00000024:0.0:1788521151.634442:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1788521151.634617:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222328064:12345-0@lo:41: Request processed in 219us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521151.634625:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788521151.634766:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222328064:0@lo:41: 00010000:00010000:0.0:1788521151.695185:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521152.141068:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788521152.141099:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef6e4bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222328192:0@lo:41: 00000100:00100000:1.0:1788521152.141184:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521152.141261:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222328192 00000100:00100000:1.0:1788521152.141270:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222328192 00000100:00100000:1.0:1788521152.141324:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788521152.141334:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6e4bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222328192:12345-0@lo:41: 00000004:00000024:1.0:1788521152.141375:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788521152.141433:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6e4bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222328192:12345-0@lo:41: Request processed in 100us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521152.141440:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788521152.141502:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef6e4bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222328192:0@lo:41: 00000100:00100000:1.0:1788521152.142868:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef6e4bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222328320:0@lo:400: 00000100:00100000:1.0:1788521152.142954:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521152.143079:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788521152.143086:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef6e4bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222328448:0@lo:400: 00000100:00100000:1.0:1788521152.143119:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521152.143157:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef6e4bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222328704:0@lo:400: 00000100:00100000:1.0:1788521152.143182:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521152.143201:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788521152.143206:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef6e4be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222328576:0@lo:400: 00000100:00100000:1.0:1788521152.143232:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521152.143263:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222328320 00000100:00100000:1.0:1788521152.143271:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222328320 00000100:00100000:1.0:1788521152.143332:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788521152.143341:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:3645:x1875400222328320:12345-0@lo:400: 00000100:00100000:1.0:1788521152.143441:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:3645:x1875400222328320:12345-0@lo:400: Request processed in 54us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521152.143510:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788521152.143548:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222328448 00000100:00100000:1.0:1788521152.143552:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222328448 00000100:00100000:1.0:1788521152.143578:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222328704 00000100:00100000:1.0:1788521152.143580:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222328704 00000100:00100000:1.0:1788521152.143592:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788521152.143598:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6e4be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222328448:12345-0@lo:400: 00000100:00100000:1.0:1788521152.143628:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6e4be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222328448:12345-0@lo:400: Request processed in 31us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521152.143635:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788521152.143645:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788521152.143651:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6e4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222328704:12345-0@lo:400: 00000100:00100000:1.0:1788521152.143691:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6e4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222328704:12345-0@lo:400: Request processed in 40us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521152.143698:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788521152.143741:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fef6e4bc700 x1875400222328704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521152.143756:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef6e4bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222328704:0@lo:400: 00000100:00100000:1.0:1788521152.143781:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222328576 00000100:00100000:1.0:1788521152.143784:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222328576 00000100:00100000:1.0:1788521152.143807:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788521152.143813:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6e4bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222328576:12345-0@lo:400: 00000100:00100000:1.0:1788521152.143848:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6e4bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222328576:12345-0@lo:400: Request processed in 36us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521152.143862:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788521152.143919:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef6e4be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222328576:0@lo:400: 00010000:00080000:1.0:1788521152.143947:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fef6e4bfb80 x1875400222328448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521152.143958:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef6e4bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222328448:0@lo:400: 00000100:00100000:1.0:1788521152.143967:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef6e4bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222328320:0@lo:400: 00010000:00010000:0.0:1788521152.718140:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521153.742244:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521154.777783:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521155.789459:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521156.753945:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788521156.753990:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222328832:0@lo:41: 00000100:00100000:0.0:1788521156.754094:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521156.756100:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222328832 00000100:00100000:2.0:1788521156.756132:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222328832 00000100:00100000:2.0:1788521156.756350:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788521156.756370:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef8149ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222328832:12345-0@lo:41: 00000004:00000024:2.0:1788521156.756424:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1788521156.756534:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef8149ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222328832:12345-0@lo:41: Request processed in 173us (2439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521156.756541:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788521156.756580:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222328832:0@lo:41: 00010000:00010000:0.0:1788521156.814153:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521157.261145:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef6e4bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222328960:0@lo:400: 00000100:00100000:3.0:1788521157.261240:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521157.264580:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef6e4bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222329088:0@lo:400: 00000100:00100000:1.0:1788521157.264682:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521157.264724:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222329600:0@lo:400: 00000100:00100000:1.0:1788521157.264751:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521157.264777:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788521157.264784:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef6e4be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222329216:0@lo:400: 00000100:00100000:1.0:1788521157.264807:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521157.264878:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222329088 00000100:00100000:1.0:1788521157.264937:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222329088 00000100:00100000:3.0:1788521157.265802:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222329472:0@lo:41: 00000100:00100000:3.0:1788521157.265866:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521157.265912:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788521157.265923:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef6e4bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875400222329344:0@lo:400: 00000100:00100000:3.0:1788521157.265947:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521157.266139:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222328960 00000100:00100000:3.0:1788521157.266148:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222328960 00000100:00100000:3.0:1788521157.266190:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788521157.266201:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:3646:x1875400222328960:12345-0@lo:400: 00000100:00100000:3.0:1788521157.266266:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:3646:x1875400222328960:12345-0@lo:400: Request processed in 67us (5027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521157.266275:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788521157.266323:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222329600 00000100:00100000:3.0:1788521157.266328:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222329600 00000100:00100000:3.0:1788521157.266347:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222329216 00000100:00100000:3.0:1788521157.266351:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222329216 00000100:00100000:3.0:1788521157.266380:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222329472 00000100:00100000:3.0:1788521157.266383:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222329472 00000100:00100000:3.0:1788521157.266394:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788521157.266487:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222329344 00000100:00100000:1.0:1788521157.266491:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222329344 00000100:00100000:1.0:1788521157.266512:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788521157.266518:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222329088:12345-0@lo:400: 00000100:00100000:1.0:1788521157.266565:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222329088:12345-0@lo:400: Request processed in 48us (1883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521157.266572:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788521157.266590:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788521157.266596:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875400222329344:12345-0@lo:400: 00000100:00100000:1.0:1788521157.266646:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875400222329344:12345-0@lo:400: Request processed in 50us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521157.266653:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788521157.266702:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fef6e4bfb80 x1875400222329088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521157.266718:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef6e4bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222329088:0@lo:400: 00000100:00100000:3.0:1788521157.268074:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875400222329600:12345-0@lo:400: 00000100:00100000:3.0:1788521157.268174:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875400222329600:12345-0@lo:400: Request processed in 1762us (3421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521157.268184:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788521157.268219:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788521157.268229:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222329216:12345-0@lo:400: 00000100:00100000:3.0:1788521157.268262:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222329216:12345-0@lo:400: Request processed in 36us (3455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521157.268268:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788521157.268281:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788521157.268288:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222329472:12345-0@lo:41: 00000004:00000024:3.0:1788521157.268316:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788521157.268365:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222329472:12345-0@lo:41: Request processed in 67us (2487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521157.268372:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788521157.269546:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fef6e4bc700 x1875400222329344/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521157.269566:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef6e4bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875400222329344:0@lo:400: 00000100:00100000:2.0:1788521157.274700:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef6e4be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222329216:0@lo:400: 00000100:00100000:2.0:1788521157.274725:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222329600:0@lo:400: 00000100:00100000:3.0:1788521157.277610:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222329472:0@lo:41: 00000100:00100000:3.0:1788521157.277647:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef6e4bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222328960:0@lo:400: 00010000:00010000:3.0:1788521157.841276:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521158.867235:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788521159.494401:0:8428:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788521159.494406:0:8428:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788521159.494408:0:8428:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788521159.494618:0:8428:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8fef76680800 00000020:01000004:3.0:1788521159.494641:0:8428:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788521159.494662:0:8428:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788521159.494680:0:8428:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8fef7a25cd40) 00000020:00000080:3.0:1788521159.494701:0:8428:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788521159.571919:0:8428:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788521159.583112:0:8428:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1788521159.664589:0:8428:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788521159.665053:0:8428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788521159.665070:0:8428:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788521159.665087:0:8428:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x411dd0ee4d2d1003 00000020:01000004:2.0:1788521159.665096:0:8428:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788521159.665127:0:8428:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.141@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788521159.665133:0:8428:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788521159.665141:0:8428:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788521159.665146:0:8428:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788521159.665160:0:8428:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8fef6d7f19c0) 00000020:00000080:2.0:1788521159.665173:0:8428:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1788521159.670702:0:8428:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788521159.672623:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788521159.672634:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788521159.680931:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788521159.680951:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788521159.681355:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788521159.681362:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788521159.690070:0:8428:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521159.690325:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788521159.690333:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788521159.700855:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788521159.700875:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788521159.741728:0:8428:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788521159.748056:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788521159.748069:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788521159.749339:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788521159.749360:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788521159.755157:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788521159.755187:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788521159.758107:0:8428:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788521159.758364:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788521159.758371:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788521159.760514:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788521159.760529:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:2.0:1788521159.886194:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521159.940809:0:8428:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521159.941123:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788521159.941132:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788521159.945973:0:8428:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788521159.945991:0:8428:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788521159.949782:0:8428:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788521159.951812:0:8428:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788521159.951825:0:8428:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.141@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788521160.010234:0:8428:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.141@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788521160.010283:0:8428:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.141@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788521160.010288:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788521160.010290:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788521160.010291:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521160.010292:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521160.010293:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521160.010294:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521160.010296:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788521160.010297:0:8428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788521160.010299:0:8428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788521160.010301:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521160.010302:0:8428:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788521160.010305:0:8428:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788521160.010308:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788521160.010309:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788521160.010311:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521160.010312:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521160.010313:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521160.010314:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521160.010316:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788521160.010317:0:8428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788521160.010318:0:8428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788521160.010319:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521160.010320:0:8428:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788521160.010348:0:8428:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788521160.010366:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222329728:0@lo:253: 00000100:00100000:2.0:1788521160.010434:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521160.010500:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef518a0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521160.010746:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222329728 00000100:00100000:1.0:1788521160.010754:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222329728 00000100:00100000:1.0:1788521160.010804:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788521160.010814:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:8428:x1875400222329728:12345-0@lo:253: 20000000:01000000:1.0:1788521160.011502:0:6512:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788521160.011507:0:6512:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788521160.011512:0:6512:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788521160.011515:0:6512:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788521160.011772:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788521160.011935:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1788521160.011951:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788521160.011968:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1788521160.011974:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788521160.011988:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1788521160.012004:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1788521160.012102:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1788521160.012119:0:6512:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.141@tcp 20000000:01000000:1.0:1788521160.012121:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.141@tcp (null) (null) (null) 00000040:00080000:1.0:1788521160.012136:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1788521160.012141:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788521160.012153:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1788521160.012165:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.141@tcp (null) (null) 00000040:00080000:1.0:1788521160.012178:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1788521160.012185:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788521160.012197:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788521160.012211:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788521160.012285:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:1.0:1788521160.012296:0:6512:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.141@tcp 20000000:01000000:1.0:1788521160.012297:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.141@tcp (null) (null) (null) 00000040:00080000:1.0:1788521160.012310:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:1.0:1788521160.012315:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788521160.012328:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:1.0:1788521160.012333:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.141@tcp (null) (null) 00000040:00080000:1.0:1788521160.012345:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:1.0:1788521160.012350:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788521160.012361:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:1.0:1788521160.012376:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:1.0:1788521160.012750:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:1.0:1788521160.012763:0:6512:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.141@tcp 20000000:01000000:1.0:1788521160.012764:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.141@tcp (null) (null) (null) 00000040:00080000:1.0:1788521160.012778:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:1.0:1788521160.012783:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788521160.012795:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:1.0:1788521160.012799:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.141@tcp (null) (null) 00000040:00080000:1.0:1788521160.012811:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:1.0:1788521160.012817:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788521160.012843:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:1.0:1788521160.012861:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:1.0:1788521160.012874:0:6512:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788521160.012876:0:6512:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788521160.012880:0:6512:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788521160.014579:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788521160.014595:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788521160.020032:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1788521160.020081:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1788521160.020098:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1788521160.020381:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1788521160.020405:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1788521160.020420:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:1.0:1788521160.020431:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788521160.020433:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788521160.021566:0:8448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1788521160.021618:0:8448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1788521160.021639:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788521160.021816:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788521160.021840:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788521160.021855:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1788521160.021866:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788521160.021868:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788521160.022308:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1788521160.022435:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1788521160.022455:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1788521160.022470:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1788521160.022480:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788521160.022482:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788521160.023150:0:8450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1788521160.023174:0:8450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1788521160.023189:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:3.0:1788521160.023326:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:3.0:1788521160.023346:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:3.0:1788521160.023361:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:3.0:1788521160.023395:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788521160.023412:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fef749cb600/0x411dd0ee4d2d1011 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521160.023429:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef40030200/0x411dd0ee4d2d0edd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0ed6 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521160.023437:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef413fca00/0x411dd0ee4d2d0f54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0f4d expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521160.023443:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef4167fc00/0x411dd0ee4d2d0f8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0f85 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521160.023449:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef749cb000/0x411dd0ee4d2d0fa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0fa1 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521160.023455:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef821dc200/0x411dd0ee4d2d0fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0fcb expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521160.023462:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fef749cb600/0x411dd0ee4d2d1011 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521160.023499:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef821dc200/0x411dd0ee4d2d0fd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d0fcb expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521160.023515:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef821dc200/0x411dd0ee4d2d0fd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0fcb expref: 18 pid: 6514 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521160.023529:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1875400222329856:0@lo:104: 00000100:00100000:3.0:1788521160.023587:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788521160.023652:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef749cb000/0x411dd0ee4d2d0fa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d0fa1 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521160.023665:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef749cb000/0x411dd0ee4d2d0fa8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0fa1 expref: 18 pid: 6512 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521160.023674:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1875400222329984:0@lo:104: 00000100:00100000:3.0:1788521160.023696:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788521160.023774:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef4167fc00/0x411dd0ee4d2d0f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d0f85 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521160.023782:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef4167fc00/0x411dd0ee4d2d0f8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0f85 expref: 18 pid: 6512 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521160.023790:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71522a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1875400222330112:0@lo:104: 00000100:00100000:3.0:1788521160.023811:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788521160.026867:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef413fca00/0x411dd0ee4d2d0f54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d0f4d expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521160.026908:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef413fca00/0x411dd0ee4d2d0f54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0f4d expref: 18 pid: 6513 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521160.026922:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71522680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1875400222330240:0@lo:104: 00000100:00100000:3.0:1788521160.026994:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521160.029273:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222329856 00000100:00100000:0.0:1788521160.029287:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222329856 00000100:00100000:0.0:1788521160.032782:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222329984 00000100:00100000:0.0:1788521160.032795:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222329984 00000100:00100000:0.0:1788521160.032835:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222330112 00000100:00100000:0.0:1788521160.032839:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222330112 00000100:00100000:0.0:1788521160.032856:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788521160.032865:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71520e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+5:6512:x1875400222329856:12345-0@lo:104: 00010000:00010000:0.0:1788521160.032899:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef413fc600/0x411dd0ee4d2d0fcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0fd2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.032987:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788521160.032993:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71520e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+5:6512:x1875400222329856:12345-0@lo:104: Request processed in 130us (9407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521160.033000:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788521160.033039:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788521160.033045:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71523800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+4:6512:x1875400222329984:12345-0@lo:104: 00010000:00010000:0.0:1788521160.033053:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef749cb200/0x411dd0ee4d2d0fa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0fa8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.033090:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788521160.033095:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71523800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+4:6512:x1875400222329984:12345-0@lo:104: Request processed in 51us (9398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521160.033100:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788521160.033110:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788521160.033115:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71523b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:6512:x1875400222330112:12345-0@lo:104: 00010000:00010000:0.0:1788521160.033123:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef4167fa00/0x411dd0ee4d2d0f85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0f8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.033160:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788521160.033164:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71523b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:6512:x1875400222330112:12345-0@lo:104: Request processed in 50us (9353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521160.033171:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788521160.033194:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788521160.033200:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef413fc600/0x411dd0ee4d2d0fcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0fd2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.033207:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef413fc600 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:0.0:1788521160.033212:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef413fc600/0x411dd0ee4d2d0fcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d0fd2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.033221:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef413fc600/0x411dd0ee4d2d0fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d0fd2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521160.033238:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef413fc600/0x411dd0ee4d2d0fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d0fd2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521160.033244:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521160.033289:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef413fc600/0x411dd0ee4d2d0fcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0fd2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.033306:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521160.033331:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef413fc600/0x411dd0ee4d2d0fcb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0fd2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.033339:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef413fc600/0x411dd0ee4d2d0fcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0fd2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.033355:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788521160.033358:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef749cb200/0x411dd0ee4d2d0fa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0fa8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.033363:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cb200 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:0.0:1788521160.033367:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef749cb200/0x411dd0ee4d2d0fa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d0fa8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.033373:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef749cb200/0x411dd0ee4d2d0fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d0fa8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521160.033378:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef749cb200/0x411dd0ee4d2d0fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d0fa8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521160.033383:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521160.033403:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef749cb200/0x411dd0ee4d2d0fa1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0fa8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.033410:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521160.033423:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef749cb200/0x411dd0ee4d2d0fa1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0fa8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.033429:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef749cb200/0x411dd0ee4d2d0fa1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0fa8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.033439:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521160.033441:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef4167fa00/0x411dd0ee4d2d0f85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0f8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.033446:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef4167fa00 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:0.0:1788521160.033449:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef4167fa00/0x411dd0ee4d2d0f85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d0f8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.033455:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef4167fa00/0x411dd0ee4d2d0f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d0f8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521160.033461:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef4167fa00/0x411dd0ee4d2d0f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d0f8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521160.033465:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521160.033475:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef4167fa00/0x411dd0ee4d2d0f85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0f8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.033480:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521160.033485:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef4167fa00/0x411dd0ee4d2d0f85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0f8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.033499:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef4167fa00/0x411dd0ee4d2d0f85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0f8c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.033507:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521160.033508:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521160.033510:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521160.033517:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521160.033523:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788521160.033536:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef8149a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222330368:0@lo:103: 00000100:00100000:0.0:1788521160.033573:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788521160.033716:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521160.033938:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef8149b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222330624:0@lo:103: 00000100:00100000:2.0:1788521160.033967:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521160.033991:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788521160.033997:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef81499880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222330496:0@lo:103: 00000100:00100000:2.0:1788521160.034016:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521160.036028:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222330368 00000100:00100000:2.0:1788521160.036040:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222330368 00010000:00010000:2.0:1788521160.036081:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef821dc200/0x411dd0ee4d2d0fd2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0fcb expref: 19 pid: 6514 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521160.036105:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222330624 00000100:00100000:2.0:1788521160.036108:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222330624 00010000:00010000:2.0:1788521160.036122:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef4167fc00/0x411dd0ee4d2d0f8c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0f85 expref: 20 pid: 6512 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521160.036133:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222330496 00000100:00100000:2.0:1788521160.036136:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222330496 00010000:00010000:2.0:1788521160.036169:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef749cb000/0x411dd0ee4d2d0fa8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0fa1 expref: 21 pid: 6512 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521160.036184:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788521160.036193:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef8149b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:3643:x1875400222330368:12345-0@lo:103: 00010000:00010000:2.0:1788521160.036206:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521160.036212:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef821dc200/0x411dd0ee4d2d0fd2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0fcb expref: 21 pid: 6514 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521160.036223:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef821dc200/0x411dd0ee4d2d0fd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0fcb expref: 21 pid: 6514 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521160.036253:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521160.036315:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef8149b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:3643:x1875400222330368:12345-0@lo:103: Request processed in 123us (2741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521160.036321:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788521160.036339:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788521160.036346:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:3646:x1875400222330624:12345-0@lo:103: 00010000:00010000:2.0:1788521160.036353:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521160.036357:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef4167fc00/0x411dd0ee4d2d0f8c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0f85 expref: 20 pid: 6512 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521160.036366:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef4167fc00/0x411dd0ee4d2d0f8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0f85 expref: 20 pid: 6512 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521160.036375:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521160.036407:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:3646:x1875400222330624:12345-0@lo:103: Request processed in 62us (2439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521160.036414:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788521160.036426:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788521160.036432:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+19:3646:x1875400222330496:12345-0@lo:103: 00010000:00010000:2.0:1788521160.036439:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521160.036443:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef749cb000/0x411dd0ee4d2d0fa8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0fa1 expref: 19 pid: 6512 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521160.036451:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef749cb000/0x411dd0ee4d2d0fa8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0fa1 expref: 19 pid: 6512 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521160.036461:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521160.036488:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+19:3646:x1875400222330496:12345-0@lo:103: Request processed in 57us (2471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521160.036495:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788521160.036534:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef81499880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222330496:0@lo:103: 00000100:00100000:2.0:1788521160.036544:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef8149b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222330624:0@lo:103: 00000100:00100000:0.0:1788521160.039919:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef8149a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222330368:0@lo:103: 00010000:00010000:3.0:1788521160.041253:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef40030200/0x411dd0ee4d2d0edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d0ed6 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521160.041269:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef40030200/0x411dd0ee4d2d0edd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0ed6 expref: 18 pid: 6512 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521160.041283:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71523100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1875400222330752:0@lo:104: 00000100:00100000:3.0:1788521160.041381:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521160.041395:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef484d8180 going to sleep for 11 seconds 00010000:00010000:3.0:1788521160.041413:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef821dc200/0x411dd0ee4d2d0fd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d0fcb expref: 18 pid: 6514 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521160.041426:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1875400222329856:0@lo:104: 00010000:00010000:3.0:1788521160.041437:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef749cb000/0x411dd0ee4d2d0fa8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d0fa1 expref: 17 pid: 6512 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521160.041444:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1875400222329984:0@lo:104: 00010000:00010000:3.0:1788521160.041453:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef4167fc00/0x411dd0ee4d2d0f8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d0f85 expref: 16 pid: 6512 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521160.041461:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71522a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1875400222330112:0@lo:104: 00000100:00100000:1.0:1788521160.041583:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222330240 00000100:00100000:1.0:1788521160.041590:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222330240 00000100:00100000:1.0:1788521160.041650:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222330752 00000100:00100000:1.0:1788521160.041653:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222330752 00000100:00100000:1.0:1788521160.041669:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788521160.041677:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71522300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+4:6512:x1875400222330240:12345-0@lo:104: 00010000:00010000:1.0:1788521160.041691:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef4167f800/0x411dd0ee4d2d0f4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0f54 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.041758:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788521160.041765:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71522300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+4:6512:x1875400222330240:12345-0@lo:104: Request processed in 88us (14770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521160.041772:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788521160.041789:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788521160.041796:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aa8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:6512:x1875400222330752:12345-0@lo:104: 00010000:00010000:1.0:1788521160.041803:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef4167fe00/0x411dd0ee4d2d0ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0edd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.041849:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788521160.041855:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aa8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:6512:x1875400222330752:12345-0@lo:104: Request processed in 60us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521160.041861:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788521160.041877:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788521160.041908:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef4167f800/0x411dd0ee4d2d0f4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0f54 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.041916:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef4167f800 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:1.0:1788521160.041920:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef4167f800/0x411dd0ee4d2d0f4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d0f54 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.041929:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef4167f800/0x411dd0ee4d2d0f4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d0f54 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521160.041935:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef4167f800/0x411dd0ee4d2d0f4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d0f54 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521160.041941:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788521160.041970:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef4167f800/0x411dd0ee4d2d0f4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0f54 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.041977:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788521160.041992:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef4167f800/0x411dd0ee4d2d0f4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0f54 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.041999:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef4167f800/0x411dd0ee4d2d0f4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0f54 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.042022:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521160.042026:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef4167fe00/0x411dd0ee4d2d0ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0edd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.042031:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef4167fe00 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:1.0:1788521160.042034:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef4167fe00/0x411dd0ee4d2d0ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d0edd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.042041:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef4167fe00/0x411dd0ee4d2d0ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d0edd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521160.042047:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef4167fe00/0x411dd0ee4d2d0ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d0edd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521160.042051:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788521160.042065:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef4167fe00/0x411dd0ee4d2d0ed6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0edd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.042071:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788521160.042077:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef4167fe00/0x411dd0ee4d2d0ed6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0edd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.042083:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef4167fe00/0x411dd0ee4d2d0ed6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0edd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.042096:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521160.042098:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521160.042100:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521160.042111:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef6e4bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222331008:0@lo:103: 00000100:00100000:1.0:1788521160.042143:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521160.042164:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788521160.042170:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222330880:0@lo:103: 00000100:00100000:1.0:1788521160.042191:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521160.042216:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222331008 00000100:00100000:1.0:1788521160.042220:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222331008 00010000:00010000:1.0:1788521160.042238:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef40030200/0x411dd0ee4d2d0edd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0ed6 expref: 16 pid: 6512 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521160.042256:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222330880 00000100:00100000:1.0:1788521160.042259:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222330880 00010000:00010000:1.0:1788521160.042269:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef413fca00/0x411dd0ee4d2d0f54 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0f4d expref: 17 pid: 6513 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521160.042281:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788521160.042286:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6e4bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:3644:x1875400222331008:12345-0@lo:103: 00010000:00010000:2.0:1788521160.042474:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521160.042513:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521160.042519:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef40030200/0x411dd0ee4d2d0edd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0ed6 expref: 17 pid: 6512 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.042528:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef40030200/0x411dd0ee4d2d0edd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0ed6 expref: 17 pid: 6512 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.042544:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521160.042582:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6e4bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:3644:x1875400222331008:12345-0@lo:103: Request processed in 296us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521160.042588:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788521160.042602:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788521160.042699:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef6e4bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222331008:0@lo:103: 00000100:00100000:1.0:1788521160.042749:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6d47b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:3644:x1875400222330880:12345-0@lo:103: 00010000:00010000:1.0:1788521160.042764:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521160.042769:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef413fca00/0x411dd0ee4d2d0f54 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0f4d expref: 16 pid: 6513 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.042779:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef413fca00/0x411dd0ee4d2d0f54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0f4d expref: 16 pid: 6513 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.042791:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fef749cb600/0x411dd0ee4d2d1011 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.042798:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef749cb600/0x411dd0ee4d2d1011 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.042812:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fef749cb600/0x411dd0ee4d2d1011 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.042820:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fef749cb600/0x411dd0ee4d2d1011 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.042826:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fef749cb600/0x411dd0ee4d2d1011 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.042832:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fef749cb600/0x411dd0ee4d2d1011 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.042837:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cb600 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:1.0:1788521160.042841:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fef749cb600/0x411dd0ee4d2d1011 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.042848:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fef749cb600/0x411dd0ee4d2d1011 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.042866:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fef749cb600/0x411dd0ee4d2d1011 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.042875:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521160.043020:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6d47b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:3644:x1875400222330880:12345-0@lo:103: Request processed in 273us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521160.043026:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788521160.043244:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef413fca00/0x411dd0ee4d2d0f54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d0f4d expref: 15 pid: 6513 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521160.043255:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71522680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1875400222330240:0@lo:104: 00010000:00010000:3.0:1788521160.043265:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef40030200/0x411dd0ee4d2d0edd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d0ed6 expref: 14 pid: 6512 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521160.043272:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71523100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1875400222330752:0@lo:104: 00010000:00010000:3.0:1788521160.043309:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fef749cb600/0x411dd0ee4d2d1011 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521160.043319:0:6512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fef749cb600/0x411dd0ee4d2d1011 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521160.043325:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fef749cb600/0x411dd0ee4d2d1011 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521160.043338:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef749cb600/0x411dd0ee4d2d1011 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788521160.043360:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788521160.052053:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+13:8428:x1875400222329728:12345-0@lo:253: Request processed in 41230us (41608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521160.052068:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788521160.052166:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222329728:0@lo:253: 10000000:01000000:3.0:1788521160.052182:0:8428:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788521160.052185:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788521160.052186:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788521160.052188:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788521160.052189:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788521160.052190:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788521160.052192:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788521160.052193:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788521160.052195:0:8428:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788521160.052196:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788521160.052197:0:8428:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788521160.052218:0:8428:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8fef76680800 from lustre-OST0000 10000000:01000000:3.0:1788521160.052248:0:8428:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788521160.052251:0:8428:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788521160.052258:0:8428:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8fef4e780000 local copy 10000000:01000000:3.0:1788521160.052262:0:8428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788521160.052297:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749ca000/0x411dd0ee4d2d1018 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521160.052308:0:8428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.141@tcp lock: ffff8fef749ca000/0x411dd0ee4d2d1018 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521160.052318:0:8428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef749ca000/0x411dd0ee4d2d1018 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521160.052338:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222331136:0@lo:101: 00000100:00100000:3.0:1788521160.052411:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521160.052452:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef484d8180 going to sleep for 11 seconds 00000100:00100000:1.0:1788521160.052496:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222331136 00000100:00100000:1.0:1788521160.052502:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222331136 00000100:00100000:1.0:1788521160.052544:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788521160.052553:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+13:8428:x1875400222331136:12345-0@lo:101: 00010000:00010000:1.0:1788521160.052564:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521160.052577:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef821dd600/0x411dd0ee4d2d101f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d1018 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.052599:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef821dd600/0x411dd0ee4d2d101f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1018 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.052624:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef821dd600/0x411dd0ee4d2d101f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1018 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.052633:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef821dd600, rc 0) 00000100:00100000:1.0:1788521160.052672:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:8428:x1875400222331136:12345-0@lo:101: Request processed in 120us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521160.052677:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788521160.052822:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222331136:0@lo:101: 00010000:00010000:0.0:1788521160.052838:0:8428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef749ca000/0x411dd0ee4d2d1018 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x411dd0ee4d2d101f expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.052857:0:8428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef749ca000/0x411dd0ee4d2d1018 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x411dd0ee4d2d101f expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521160.052977:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef8149a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222331264:0@lo:501: 00000100:00100000:0.0:1788521160.053003:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521160.053057:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222331264 00000100:00100000:1.0:1788521160.053062:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222331264 00000100:00100000:1.0:1788521160.053086:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788521160.053092:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:8428:x1875400222331264:12345-0@lo:501: 00000100:00100000:2.0:1788521160.053141:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222330880:0@lo:103: 00000100:00100000:0.0:1788521160.056629:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a689c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521160.057746:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:8428:x1875400222331264:12345-0@lo:501: Request processed in 4647us (4735us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788521160.057759:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788521160.057966:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef8149a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222331264:0@lo:501: 10000000:01000000:3.0:1788521160.057989:0:8428:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788521160.058039:0:8428:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788521160.058048:0:8428:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749ca000/0x411dd0ee4d2d1018 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x411dd0ee4d2d101f expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521160.058059:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749ca000/0x411dd0ee4d2d1018 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x411dd0ee4d2d101f expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521160.058068:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.141@tcp lock: ffff8fef749ca000/0x411dd0ee4d2d1018 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x411dd0ee4d2d101f expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521160.058093:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788521160.058122:0:8428:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8fef76680800 10000000:01000000:3.0:1788521160.058127:0:8428:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788521160.058132:0:8428:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788521160.058135:0:8428:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788521160.058140:0:8428:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788521160.058143:0:8428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788521160.058172:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749cb000/0x411dd0ee4d2d1026 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521160.058180:0:8428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef749cb000/0x411dd0ee4d2d1026 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521160.058190:0:8428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef749cb000/0x411dd0ee4d2d1026 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521160.058226:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aabb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222331392:0@lo:101: 00010000:00010000:2.0:1788521160.058242:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521160.058249:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef749ca000/0x411dd0ee4d2d1018 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x411dd0ee4d2d101f expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521160.058262:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788521160.058266:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749ca000 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:2.0:1788521160.058270:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef749ca000/0x411dd0ee4d2d1018 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x411dd0ee4d2d101f expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521160.058279:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef749ca000/0x411dd0ee4d2d1018 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x411dd0ee4d2d101f expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521160.058286:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef749ca000/0x411dd0ee4d2d1018 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x411dd0ee4d2d101f expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521160.058297:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef484d86c0 going to sleep for 11 seconds 10000000:01000000:2.0:1788521160.058300:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788521160.058320:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef749ca000/0x411dd0ee4d2d1018 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x411dd0ee4d2d101f expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521160.058326:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521160.058353:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef749ca000/0x411dd0ee4d2d1018 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x411dd0ee4d2d101f expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521160.058367:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef749ca000/0x411dd0ee4d2d1018 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x411dd0ee4d2d101f expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521160.058379:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521160.058380:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521160.058382:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521160.058417:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222331520:0@lo:103: 00000100:00100000:1.0:1788521160.058445:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521160.058529:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222331520 00000100:00100000:2.0:1788521160.058536:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222331520 00000100:00100000:2.0:1788521160.058590:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788521160.058599:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6e4bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:3645:x1875400222331520:12345-0@lo:103: 00010000:00010000:2.0:1788521160.058620:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521160.058634:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef821dd600/0x411dd0ee4d2d101f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x411dd0ee4d2d1018 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521160.058647:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521160.058682:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6e4bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+13:3645:x1875400222331520:12345-0@lo:103: Request processed in 84us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521160.058689:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788521160.058855:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222331392 00000100:00100000:0.0:1788521160.058860:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222331392 00000100:00100000:0.0:1788521160.059008:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788521160.059016:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+13:8428:x1875400222331392:12345-0@lo:101: 00010000:00010000:0.0:1788521160.059027:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521160.059046:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef40030e00/0x411dd0ee4d2d102d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d1026 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.059065:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef40030e00/0x411dd0ee4d2d102d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1026 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.059075:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef40030e00/0x411dd0ee4d2d102d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1026 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.059082:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef40030e00, rc 0) 00000100:00100000:0.0:1788521160.059151:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:8428:x1875400222331392:12345-0@lo:101: Request processed in 136us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521160.059157:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788521160.061901:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aabb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222331392:0@lo:101: 00010000:00010000:3.0:1788521160.061934:0:8428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef749cb000/0x411dd0ee4d2d1026 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d102d expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521160.061947:0:8428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef749cb000/0x411dd0ee4d2d1026 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d102d expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521160.062173:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222331648:0@lo:501: 00000100:00100000:2.0:1788521160.062225:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521160.062274:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef518a00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521160.062320:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222331648 00000100:00100000:3.0:1788521160.062326:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222331648 00000100:00100000:3.0:1788521160.062360:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788521160.062368:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:8428:x1875400222331648:12345-0@lo:501: 00000100:00100000:3.0:1788521160.062473:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:8428:x1875400222331648:12345-0@lo:501: Request processed in 105us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521160.062480:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788521160.062642:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222331648:0@lo:501: 00000100:00100000:2.0:1788521160.062666:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222331776:0@lo:503: 00000100:00100000:2.0:1788521160.062705:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521160.062732:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef518a00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521160.062839:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222331776 00000100:00100000:0.0:1788521160.062843:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222331776 00000100:00100000:0.0:1788521160.062872:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788521160.062878:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:8428:x1875400222331776:12345-0@lo:503: 00000100:00100000:0.0:1788521160.062977:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:8428:x1875400222331776:12345-0@lo:503: Request processed in 98us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521160.062984:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788521160.063153:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222331776:0@lo:503: 00000040:00080000:2.0:1788521160.063392:0:8428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788521160.063453:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222331904:0@lo:502: 00000100:00100000:2.0:1788521160.063485:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521160.063501:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef518a00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521160.063689:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222331904 00000100:00100000:3.0:1788521160.063694:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222331904 00000100:00100000:3.0:1788521160.063737:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788521160.063744:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:8428:x1875400222331904:12345-0@lo:502: 00000100:00100000:3.0:1788521160.063833:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:8428:x1875400222331904:12345-0@lo:502: Request processed in 89us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521160.063849:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788521160.064879:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222331904:0@lo:502: 00000040:00080000:2.0:1788521160.065328:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788521160.065359:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788521160.065374:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788521160.065388:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788521160.065402:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788521160.065428:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788521160.065462:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222332032:0@lo:502: 00000100:00100000:2.0:1788521160.065521:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521160.065561:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef518a00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521160.065689:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222332032 00000100:00100000:3.0:1788521160.065695:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222332032 00000100:00100000:3.0:1788521160.065748:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788521160.065757:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:8428:x1875400222332032:12345-0@lo:502: 00000100:00100000:3.0:1788521160.065880:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:8428:x1875400222332032:12345-0@lo:502: Request processed in 123us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521160.066103:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788521160.066237:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222332032:0@lo:502: 00000040:00080000:2.0:1788521160.066347:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788521160.066357:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000100:00100000:1.0:1788521160.067698:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222331520:0@lo:103: 00000020:01000000:0.0:1788521160.068358:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788521160.068367:0:8451:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788521160.068374:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521160.068376:0:8451:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788521160.068382:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788521160.068399:0:8451:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8fef6da819c0) 00000020:00000080:0.0:1788521160.068423:0:8451:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788521160.068429:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788521160.068526:0:8451:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fef76680800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788521160.068534:0:8451:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788521160.068547:0:8451:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x411dd0ee4d2d103b 00010000:00010000:0.0:1788521160.080553:0:8451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1788521160.082053:0:8451:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788521160.093592:0:8451:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788521160.094025:0:8451:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788521160.111547:0:8451:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1788521160.111741:0:8451:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788521160.135623:0:8451:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1788521160.138836:0:8451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788521160.138847:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521160.138853:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521160.138855:0:8451:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788521160.138858:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521160.138862:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521160.138864:0:8451:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788521160.138867:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788521160.138869:0:8451:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788521160.138915:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521160.138917:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521160.138919:0:8451:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788521160.138922:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788521160.139059:0:8428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788521160.139088:0:8428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788521160.139113:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749cb000/0x411dd0ee4d2d1026 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d102d expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521160.139124:0:8428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef749cb000/0x411dd0ee4d2d1026 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d102d expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521160.139144:0:8428:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fef76680800 from 1 10000000:01000000:2.0:1788521160.139146:0:8428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788521160.139180:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef413fdc00/0x411dd0ee4d2d1042 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521160.139188:0:8428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef413fdc00/0x411dd0ee4d2d1042 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521160.139198:0:8428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef413fdc00/0x411dd0ee4d2d1042 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521160.139231:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222332160:0@lo:101: 00000100:00100000:2.0:1788521160.139307:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521160.139350:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef518a0840 going to sleep for 11 seconds 00000100:00100000:2.0:1788521160.139385:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222332160 00000100:00100000:2.0:1788521160.139391:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222332160 00000100:00100000:2.0:1788521160.139432:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788521160.139439:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:8428:x1875400222332160:12345-0@lo:101: 00010000:00010000:2.0:1788521160.139451:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521160.139462:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef413fce00/0x411dd0ee4d2d1049 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d1042 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521160.139484:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef413fce00/0x411dd0ee4d2d1049 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1042 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521160.139493:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef413fce00/0x411dd0ee4d2d1049 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1042 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521160.139502:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fce00, rc 0) 00000100:00100000:2.0:1788521160.139544:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:8428:x1875400222332160:12345-0@lo:101: Request processed in 105us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521160.139551:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788521160.139600:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222332160:0@lo:101: 00010000:00010000:2.0:1788521160.139625:0:8428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef413fdc00/0x411dd0ee4d2d1042 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1049 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521160.139634:0:8428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef413fdc00/0x411dd0ee4d2d1042 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d1049 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521160.139718:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222332288:0@lo:501: 00000100:00100000:2.0:1788521160.139743:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521160.139760:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef518a0840 going to sleep for 11 seconds 00000100:00100000:0.0:1788521160.139777:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222332288 00000100:00100000:0.0:1788521160.139783:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222332288 00000100:00100000:0.0:1788521160.139819:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788521160.139826:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:8428:x1875400222332288:12345-0@lo:501: 00000100:00100000:0.0:1788521160.139933:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:8428:x1875400222332288:12345-0@lo:501: Request processed in 108us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521160.139940:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788521160.140088:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222332288:0@lo:501: 00000100:00100000:2.0:1788521160.140114:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222332416:0@lo:503: 00000100:00100000:2.0:1788521160.140154:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521160.140185:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef518a0840 going to sleep for 11 seconds 00000100:00100000:0.0:1788521160.141054:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222332416 00000100:00100000:0.0:1788521160.141062:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222332416 00000100:00100000:0.0:1788521160.141110:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788521160.141119:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:8428:x1875400222332416:12345-0@lo:503: 00000100:00100000:0.0:1788521160.141237:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:8428:x1875400222332416:12345-0@lo:503: Request processed in 119us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521160.141245:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788521160.141297:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222332416:0@lo:503: 00000040:00080000:1.0:1788521160.141576:0:8428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788521160.141665:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef6e4be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222332544:0@lo:502: 00000100:00100000:1.0:1788521160.141711:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521160.141747:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef516b4180 going to sleep for 11 seconds 00000100:00100000:0.0:1788521160.141768:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222332544 00000100:00100000:0.0:1788521160.141774:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222332544 00000100:00100000:0.0:1788521160.141803:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788521160.141819:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:8428:x1875400222332544:12345-0@lo:502: 00000100:00100000:0.0:1788521160.141912:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:8428:x1875400222332544:12345-0@lo:502: Request processed in 93us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521160.141918:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788521160.142058:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef6e4be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222332544:0@lo:502: 00000040:00080000:1.0:1788521160.142478:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788521160.142506:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788521160.142528:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef6e4be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222332672:0@lo:502: 00000100:00100000:1.0:1788521160.142573:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521160.142602:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef46193e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788521160.143562:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222332672 00000100:00100000:2.0:1788521160.143571:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222332672 00000100:00100000:2.0:1788521160.143621:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788521160.143630:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:8428:x1875400222332672:12345-0@lo:502: 00000100:00100000:2.0:1788521160.143752:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:8428:x1875400222332672:12345-0@lo:502: Request processed in 123us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521160.143760:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788521160.144322:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef6e4be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222332672:0@lo:502: 00000040:00080000:0.0:1788521160.144403:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788521160.144415:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788521160.144957:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788521160.144967:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521160.144969:0:8454:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788521160.144976:0:8454:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fef76680800 00000020:00000080:1.0:1788521160.144980:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788521160.145000:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788521160.145002:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521160.145004:0:8454:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788521160.145007:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788521160.145120:0:8428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788521160.145144:0:8428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788521160.145163:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef413fdc00/0x411dd0ee4d2d1042 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1049 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521160.145190:0:8428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef413fdc00/0x411dd0ee4d2d1042 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1049 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521160.145236:0:8428:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788521160.145239:0:8428:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8fef76680800 10000000:01000000:2.0:1788521160.145242:0:8428:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8fef76680800 10000000:01000000:2.0:1788521160.145246:0:8428:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788521160.145251:0:8428:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fef76680800 from 1 10000000:01000000:2.0:1788521160.145253:0:8428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788521160.145284:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef413fda00/0x411dd0ee4d2d1050 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521160.145293:0:8428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef413fda00/0x411dd0ee4d2d1050 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521160.145303:0:8428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef413fda00/0x411dd0ee4d2d1050 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521160.145320:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222332800:0@lo:101: 00000100:00100000:2.0:1788521160.145373:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521160.145404:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222332800 00000100:00100000:2.0:1788521160.145409:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222332800 00000100:00100000:2.0:1788521160.145453:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788521160.145462:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:8428:x1875400222332800:12345-0@lo:101: 00010000:00010000:2.0:1788521160.145472:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521160.145485:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef413fc800/0x411dd0ee4d2d1057 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d1050 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521160.145520:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef413fc800/0x411dd0ee4d2d1057 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1050 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521160.145532:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef413fc800/0x411dd0ee4d2d1057 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1050 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521160.145541:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fc800, rc 0) 00000100:00100000:2.0:1788521160.145569:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:8428:x1875400222332800:12345-0@lo:101: Request processed in 109us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521160.145576:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788521160.145629:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef518a0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521160.145643:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222332800:0@lo:101: 00010000:00010000:2.0:1788521160.145655:0:8428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef413fda00/0x411dd0ee4d2d1050 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1057 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521160.145664:0:8428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef413fda00/0x411dd0ee4d2d1050 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d1057 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521160.145723:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222332928:0@lo:501: 00000100:00100000:2.0:1788521160.145744:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521160.145762:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222332928 00000100:00100000:2.0:1788521160.145766:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222332928 00000100:00100000:2.0:1788521160.145783:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788521160.145788:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:8428:x1875400222332928:12345-0@lo:501: 00000100:00100000:2.0:1788521160.145875:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:8428:x1875400222332928:12345-0@lo:501: Request processed in 86us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521160.145903:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788521160.145931:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef518a0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521160.145941:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222332928:0@lo:501: 00000100:00100000:2.0:1788521160.145963:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222333056:0@lo:503: 00000100:00100000:2.0:1788521160.145994:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521160.146011:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222333056 00000100:00100000:2.0:1788521160.146014:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222333056 00000100:00100000:2.0:1788521160.146031:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788521160.146036:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:8428:x1875400222333056:12345-0@lo:503: 00000100:00100000:2.0:1788521160.146096:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:8428:x1875400222333056:12345-0@lo:503: Request processed in 58us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521160.146102:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788521160.146129:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef518a0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521160.146138:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222333056:0@lo:503: 00000040:00080000:2.0:1788521160.146321:0:8428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788521160.146382:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222333184:0@lo:502: 00000100:00100000:2.0:1788521160.146413:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521160.146431:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222333184 00000100:00100000:2.0:1788521160.146434:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222333184 00000100:00100000:2.0:1788521160.146452:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788521160.146458:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:8428:x1875400222333184:12345-0@lo:502: 00000100:00100000:2.0:1788521160.146514:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:8428:x1875400222333184:12345-0@lo:502: Request processed in 56us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521160.146521:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788521160.146547:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef518a0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521160.146557:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222333184:0@lo:502: 00000040:00080000:2.0:1788521160.146722:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788521160.146748:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788521160.146760:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788521160.146777:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788521160.146788:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788521160.146799:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788521160.146811:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788521160.146822:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788521160.146837:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788521160.146850:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788521160.146861:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788521160.146871:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788521160.146896:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788521160.146911:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788521160.146935:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788521160.146950:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788521160.146966:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788521160.146980:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788521160.146995:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788521160.147007:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788521160.147017:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788521160.147027:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788521160.147038:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788521160.147049:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788521160.147060:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788521160.147073:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788521160.147083:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788521160.147093:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1788521160.147102:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788521160.147111:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788521160.147130:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788521160.147146:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788521160.147163:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788521160.147177:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788521160.147198:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788521160.147209:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788521160.147219:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1788521160.147239:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222333312:0@lo:502: 00000100:00100000:2.0:1788521160.147271:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521160.147297:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222333312 00000100:00100000:2.0:1788521160.147301:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222333312 00000100:00100000:2.0:1788521160.147325:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788521160.147332:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:8428:x1875400222333312:12345-0@lo:502: 00000100:00100000:2.0:1788521160.147404:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:8428:x1875400222333312:12345-0@lo:502: Request processed in 73us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521160.147410:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788521160.147444:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef518a0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521160.147457:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222333312:0@lo:502: 00000040:00080000:2.0:1788521160.147493:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788521160.147500:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1788521160.151710:0:8456:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788521160.151741:0:8456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8fee42138000) 00000020:00000080:0.0:1788521160.151764:0:8456:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788521160.151863:0:8456:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fef76680800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788521160.151868:0:8456:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fef76680800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788521160.151871:0:8456:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fef76680800 3 00010000:00080000:0.0:1788521160.152006:0:8456:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fef81471000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.141@tcp at head 00010000:00010000:0.0:1788521160.156030:0:8456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:0.0:1788521160.156249:0:8456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788521160.156294:0:8456:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788521160.156305:0:8456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x411dd0ee4d2d1065 00000100:00080000:0.0:1788521160.156316:0:8456:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788521160.156323:0:8456:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8fef81471000 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:0.0:1788521160.156368:0:8456:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fef81498a80 x1875400222333440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788521160.156401:0:8456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788521160.156514:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef81498a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875400222333440:0@lo:38: 00000100:00100000:1.0:1788521160.156586:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521160.156638:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222333824:0@lo:400: 00000100:00100000:1.0:1788521160.156660:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222333952:0@lo:400: 00000100:00100000:2.0:1788521160.156674:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521160.156697:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521160.156700:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788521160.156709:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222333696:0@lo:400: 00000100:00100000:1.0:1788521160.156724:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788521160.156732:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222333568:0@lo:400: 00000100:00100000:2.0:1788521160.156738:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521160.156763:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521160.156776:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222333952 00000100:00100000:2.0:1788521160.156783:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222333952 00000100:00100000:1.0:1788521160.156814:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222333440 00000100:00100000:2.0:1788521160.156817:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222333696 00000100:00100000:1.0:1788521160.156819:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222333440 00000100:00100000:2.0:1788521160.156821:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222333696 00000100:00100000:1.0:1788521160.156839:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222333824 00000100:00100000:1.0:1788521160.156844:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222333824 00000100:00100000:2.0:1788521160.156846:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788521160.156857:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6e4be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222333952:12345-0@lo:400: 00000100:00100000:1.0:1788521160.156868:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222333568 00000100:00100000:1.0:1788521160.156871:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222333568 00000100:00100000:1.0:1788521160.156903:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788521160.156910:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222333824:12345-0@lo:400: 00000100:00100000:2.0:1788521160.156934:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6e4be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222333952:12345-0@lo:400: Request processed in 78us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521160.156948:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788521160.156955:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222333824:12345-0@lo:400: Request processed in 45us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521160.156964:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788521160.156968:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788521160.156977:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222333696:12345-0@lo:400: 00000100:00100000:1.0:1788521160.156985:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788521160.156994:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6e4bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222333568:12345-0@lo:400: 00000100:00100000:2.0:1788521160.157012:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222333696:12345-0@lo:400: Request processed in 36us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521160.157020:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788521160.157029:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6e4bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222333568:12345-0@lo:400: Request processed in 36us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521160.157036:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788521160.157050:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788521160.157054:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6e4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875400222333440:12345-0@lo:38: 00010000:00080000:1.0:1788521160.157079:0:6519:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:1.0:1788521160.157111:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x411dd0ee4d2d106c 00000004:00100000:1.0:1788521160.157126:0:6519:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788521160.157152:0:6519:0:(import.c:65:import_set_state_nolock()) ffff8fee4211d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788521160.157201:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6e4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875400222333440:12345-0@lo:38: Request processed in 146us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521160.157208:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788521160.157248:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fef766f7800 x1875400222333568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521160.157260:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222333568:0@lo:400: 00000100:00100000:1.0:1788521160.157269:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222333952:0@lo:400: 00000100:00100000:1.0:1788521160.157292:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222333696:0@lo:400: 00010000:00080000:1.0:1788521160.157300:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fef766f5c00 x1875400222333824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521160.157319:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222333824:0@lo:400: 00010000:00080000:2.0:1788521160.157531:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fef81498a80 x1875400222333440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788521170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521160.157540:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788521160.157547:0:3642:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788521160.157554:0:3642:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788521160.157559:0:3642:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788521160.157561:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef81471000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788521160.157566:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef81498a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875400222333440:0@lo:38: 00000020:01000004:1.0:1788521160.162326:0:8456:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788521160.162343:0:8456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8fef4e783380) 00000020:00000080:1.0:1788521160.162367:0:8456:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1788521160.162452:0:8456:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fef76680800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788521160.162456:0:8456:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fef76680800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788521160.162459:0:8456:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fef76680800 3 00010000:00080000:1.0:1788521160.162487:0:8456:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fee42118000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.141@tcp at head 00010000:00010000:1.0:1788521160.166441:0:8456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1788521160.166653:0:8456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788521160.166694:0:8456:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788521160.166711:0:8456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x411dd0ee4d2d107a 00000100:00080000:1.0:1788521160.166720:0:8456:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788521160.166726:0:8456:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8fee42118000 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:1.0:1788521160.166760:0:8456:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fef71523100 x1875400222334080/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788521160.166784:0:8456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788521160.167125:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1875400222334080:0@lo:38: 00000100:00100000:2.0:1788521160.167190:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788521160.167473:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1788521160.167518:0:8428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788521160.167543:0:8428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788521160.167554:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef413fda00/0x411dd0ee4d2d1050 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1057 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521160.167564:0:8428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef413fda00/0x411dd0ee4d2d1050 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1057 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788521160.167617:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788521160.167623:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788521160.167624:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521160.167625:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521160.167626:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521160.167627:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521160.167629:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788521160.167630:0:8428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788521160.167631:0:8428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788521160.167633:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521160.167634:0:8428:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788521160.167637:0:8428:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788521160.167639:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788521160.167640:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788521160.167641:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521160.167642:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521160.167643:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521160.167644:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521160.167645:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788521160.167646:0:8428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788521160.167646:0:8428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788521160.167647:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521160.167648:0:8428:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788521160.167664:0:8428:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788521160.167674:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222334208:0@lo:253: 00000100:00100000:2.0:1788521160.167705:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521160.167720:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef604c1600 going to sleep for 11 seconds 00000100:00100000:2.0:1788521160.167735:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222334208 00000100:00100000:2.0:1788521160.167740:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222334208 00000100:00100000:2.0:1788521160.167773:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788521160.167779:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:8428:x1875400222334208:12345-0@lo:253: 20000000:01000000:2.0:1788521160.167801:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788521160.167825:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788521160.169932:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222334080 00000100:00100000:1.0:1788521160.169944:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222334080 00000100:00100000:1.0:1788521160.169979:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788521160.169986:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875400222334080:12345-0@lo:38: 00010000:00080000:1.0:1788521160.170012:0:6519:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:1.0:1788521160.170050:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x411dd0ee4d2d1081 00000004:00100000:1.0:1788521160.170065:0:6519:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788521160.170095:0:6519:0:(import.c:65:import_set_state_nolock()) ffff8fee4211b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788521160.170165:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875400222334080:12345-0@lo:38: Request processed in 178us (2974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521160.170172:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788521160.170226:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fef71523100 x1875400222334080/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788521170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521160.170237:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788521160.170256:0:3642:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788521160.170263:0:3642:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788521160.170267:0:3642:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788521160.170269:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fee42118000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788521160.170274:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1875400222334080:0@lo:38: 20000000:01000000:0.0:1788521160.179363:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788521160.179381:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788521160.179506:0:6535:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788521160.179515:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788521160.179534:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fef821dd200/0x411dd0ee4d2d1088 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.179550:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef413fd200/0x411dd0ee4d2d0f7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0f77 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.179558:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef749cb800/0x411dd0ee4d2d0f9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0f93 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.179565:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fef821dd200/0x411dd0ee4d2d1088 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.179599:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef749cb800/0x411dd0ee4d2d0f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d0f93 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.179622:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef749cb800/0x411dd0ee4d2d0f9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0f93 expref: 16 pid: 6512 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521160.179635:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71523100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1875400222334336:0@lo:104: 00000100:00100000:1.0:1788521160.179695:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788521160.179742:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef413fd200/0x411dd0ee4d2d0f7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d0f77 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.179750:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef413fd200/0x411dd0ee4d2d0f7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0f77 expref: 16 pid: 6513 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521160.179757:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71522680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1875400222334464:0@lo:104: 00000100:00100000:1.0:1788521160.179773:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef46193cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521160.179831:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788521160.179854:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521160.179877:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222334336 00000100:00100000:0.0:1788521160.179913:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222334336 00000100:00100000:0.0:1788521160.179947:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222334464 00000100:00100000:0.0:1788521160.179950:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222334464 00000100:00100000:0.0:1788521160.179961:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788521160.179968:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76581450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+4:6535:x1875400222334336:12345-0@lo:104: 00010000:00010000:0.0:1788521160.179980:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef749cae00/0x411dd0ee4d2d0f93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0f9a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.180026:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788521160.180031:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76581450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+4:6535:x1875400222334336:12345-0@lo:104: Request processed in 64us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521160.180037:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788521160.180074:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788521160.180079:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef81498e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:6535:x1875400222334464:12345-0@lo:104: 00010000:00010000:0.0:1788521160.180087:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef40030c00/0x411dd0ee4d2d0f77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0f7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.180113:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788521160.180117:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef81498e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:6535:x1875400222334464:12345-0@lo:104: Request processed in 39us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521160.180122:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1788521160.180135:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788521160.180140:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef749cae00/0x411dd0ee4d2d0f93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0f9a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.180147:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cae00 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:0.0:1788521160.180156:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef749cae00/0x411dd0ee4d2d0f93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d0f9a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.180164:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef749cae00/0x411dd0ee4d2d0f93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d0f9a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521160.180171:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef749cae00/0x411dd0ee4d2d0f93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d0f9a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521160.180176:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521160.180199:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef749cae00/0x411dd0ee4d2d0f93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0f9a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.180205:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521160.180218:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef749cae00/0x411dd0ee4d2d0f93 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0f9a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.180224:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef749cae00/0x411dd0ee4d2d0f93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0f9a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.180236:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521160.180238:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef40030c00/0x411dd0ee4d2d0f77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0f7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.180308:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40030c00 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:0.0:1788521160.180312:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef40030c00/0x411dd0ee4d2d0f77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d0f7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.180319:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef40030c00/0x411dd0ee4d2d0f77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d0f7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521160.180333:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef40030c00/0x411dd0ee4d2d0f77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d0f7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521160.180338:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521160.180350:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef40030c00/0x411dd0ee4d2d0f77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0f7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.180355:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521160.180367:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef40030c00/0x411dd0ee4d2d0f77 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0f7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.180373:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef40030c00/0x411dd0ee4d2d0f77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0f7e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.180384:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521160.180386:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521160.180387:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521160.180403:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef8149b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222334592:0@lo:103: 00000100:00100000:0.0:1788521160.180427:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521160.180455:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef8149bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222334720:0@lo:103: 00000100:00100000:0.0:1788521160.180474:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521160.180497:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222334592 00000100:00100000:0.0:1788521160.180500:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222334592 00010000:00010000:0.0:1788521160.180514:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef749cb800/0x411dd0ee4d2d0f9a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0f93 expref: 17 pid: 6512 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521160.180530:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222334720 00000100:00100000:0.0:1788521160.180531:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222334720 00010000:00010000:0.0:1788521160.180539:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef413fd200/0x411dd0ee4d2d0f7e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0f77 expref: 18 pid: 6513 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521160.180555:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788521160.180560:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef81498a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:3646:x1875400222334592:12345-0@lo:103: 00010000:00010000:0.0:1788521160.180570:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521160.180573:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef749cb800/0x411dd0ee4d2d0f9a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0f93 expref: 18 pid: 6512 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.180582:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef749cb800/0x411dd0ee4d2d0f9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0f93 expref: 18 pid: 6512 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.180594:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521160.180627:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef81498a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:3646:x1875400222334592:12345-0@lo:103: Request processed in 67us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521160.180633:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788521160.180643:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788521160.180648:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef8149a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:3643:x1875400222334720:12345-0@lo:103: 00010000:00010000:0.0:1788521160.180655:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521160.180658:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef413fd200/0x411dd0ee4d2d0f7e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0f77 expref: 17 pid: 6513 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.180666:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef413fd200/0x411dd0ee4d2d0f7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0f77 expref: 17 pid: 6513 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.180676:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fef821dd200/0x411dd0ee4d2d1088 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.180683:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef821dd200/0x411dd0ee4d2d1088 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788521160.180702:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010206398s 00010000:00010000:0.0:1788521160.180706:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fef821dd200/0x411dd0ee4d2d1088 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.180713:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fef821dd200/0x411dd0ee4d2d1088 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.180719:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fef821dd200/0x411dd0ee4d2d1088 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.180725:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fef821dd200/0x411dd0ee4d2d1088 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.180729:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef821dd200 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:0.0:1788521160.180733:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fef821dd200/0x411dd0ee4d2d1088 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.180739:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fef821dd200/0x411dd0ee4d2d1088 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.180746:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fef821dd200/0x411dd0ee4d2d1088 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521160.180754:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521160.180775:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef8149a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:3643:x1875400222334720:12345-0@lo:103: Request processed in 127us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521160.180780:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788521160.180808:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef8149b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222334592:0@lo:103: 00010000:00010000:3.0:1788521160.180981:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521160.181905:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef749cb800/0x411dd0ee4d2d0f9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d0f93 expref: 16 pid: 6512 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521160.181934:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71523100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1875400222334336:0@lo:104: 00010000:00010000:1.0:1788521160.181945:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef413fd200/0x411dd0ee4d2d0f7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d0f77 expref: 15 pid: 6513 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521160.181954:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71522680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1875400222334464:0@lo:104: 00010000:00010000:1.0:1788521160.181972:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fef821dd200/0x411dd0ee4d2d1088 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.181981:0:6535:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fef821dd200/0x411dd0ee4d2d1088 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.181991:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fef821dd200/0x411dd0ee4d2d1088 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521160.181997:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef821dd200/0x411dd0ee4d2d1088 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521160.183013:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:8428:x1875400222334208:12345-0@lo:253: Request processed in 15229us (15302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521160.183024:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788521160.183242:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef8149bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222334720:0@lo:103: 00000100:00100000:3.0:1788521160.183245:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8428:1875400222334208:0@lo:253: 10000000:01000000:3.0:1788521160.183267:0:8428:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788521160.183271:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788521160.183273:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788521160.183275:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788521160.183276:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788521160.183277:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788521160.183279:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788521160.183281:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788521160.183283:0:8428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788521160.183284:0:8428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788521160.183286:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788521160.183288:0:8428:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788521160.183305:0:8428:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788521160.195719:0:8428:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788521160.196732:0:8428:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788521160.197014:0:8428:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788521160.197162:0:8428:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788521160.197513:0:8428:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788521160.197781:0:8428:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1788521160.200485:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788521160.216481:0:8428:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788521160.216490:0:8428:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788521160.216531:0:8428:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788521160.216581:0:8428:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.141@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788521160.216614:0:8428:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788521160.216640:0:8428:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788521160.220401:0:8428:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788521160.220579:0:8428:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788521160.911629:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788521161.242266:0:8511:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788521161.242703:0:8511:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788521161.871179:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222334848:0@lo:41: 00000100:00100000:3.0:1788521161.871263:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521161.871384:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222334848 00000100:00100000:1.0:1788521161.871391:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222334848 00000100:00100000:1.0:1788521161.871444:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788521161.871454:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222334848:12345-0@lo:41: 00000004:00000024:1.0:1788521161.871487:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1788521161.871535:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222334848:12345-0@lo:41: Request processed in 82us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521161.871541:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788521161.871582:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222334848:0@lo:41: 00010000:00010000:3.0:1788521161.937367:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521162.381164:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222334976:0@lo:41: 00000100:00100000:1.0:1788521162.381249:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521162.381508:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222334976 00000100:00100000:2.0:1788521162.381516:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222334976 00000100:00100000:2.0:1788521162.381569:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788521162.381578:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222334976:12345-0@lo:41: 00000004:00000024:2.0:1788521162.381623:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788521162.381675:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222334976:12345-0@lo:41: Request processed in 98us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521162.381682:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788521162.381764:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222334976:0@lo:41: 00010000:00010000:3.0:1788521162.963491:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521163.985408:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521165.007488:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521165.453134:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef8149bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222335104:0@lo:400: 00000100:00100000:0.0:1788521165.453138:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef8149b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222335488:0@lo:400: 00000100:00100000:1.0:1788521165.454288:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef8149b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222335232:0@lo:400: 00000100:00100000:0.0:1788521165.458480:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521165.458546:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521165.458575:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521165.458601:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222335104 00000100:00100000:3.0:1788521165.458613:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222335104 00000100:00100000:1.0:1788521165.458615:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875400222335744:0@lo:400: 00000100:00100000:0.0:1788521165.458615:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef8149b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222335360:0@lo:400: 00000100:00100000:3.0:1788521165.458681:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788521165.458694:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:3646:x1875400222335104:12345-0@lo:400: 00000100:00100000:1.0:1788521165.458729:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521165.458778:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:3646:x1875400222335104:12345-0@lo:400: Request processed in 85us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521165.458783:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222335488 00000100:00100000:1.0:1788521165.458788:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222335488 00000100:00100000:3.0:1788521165.458789:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788521165.458821:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222335232 00000100:00100000:1.0:1788521165.458826:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222335232 00000100:00100000:1.0:1788521165.458846:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222335744 00000100:00100000:1.0:1788521165.458848:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222335744 00000100:00100000:3.0:1788521165.458877:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef8149bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222335104:0@lo:400: 00000100:00100000:1.0:1788521165.458956:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788521165.458963:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222335488:12345-0@lo:400: 00000100:00100000:1.0:1788521165.459244:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222335488:12345-0@lo:400: Request processed in 280us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521165.459253:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788521165.459272:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788521165.459280:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222335232:12345-0@lo:400: 00000100:00100000:1.0:1788521165.459319:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222335232:12345-0@lo:400: Request processed in 40us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521165.459327:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521165.459329:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788521165.459346:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788521165.459354:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71522a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875400222335744:12345-0@lo:400: 00000100:00100000:0.0:1788521165.459369:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875400222335872:0@lo:400: 00000100:00100000:1.0:1788521165.459387:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71522a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875400222335744:12345-0@lo:400: Request processed in 34us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521165.459402:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788521165.459412:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521165.459440:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222335872 00000100:00100000:1.0:1788521165.459446:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222335872 00000100:00100000:1.0:1788521165.459469:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788521165.459476:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875400222335872:12345-0@lo:400: 00000100:00100000:0.0:1788521165.459517:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222335360 00000100:00100000:0.0:1788521165.459522:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222335360 00000100:00100000:1.0:1788521165.459523:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875400222335872:12345-0@lo:400: Request processed in 47us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521165.459537:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788521165.459591:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef8149b800 x1875400222335232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521165.459603:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef8149b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222335232:0@lo:400: 00010000:00080000:1.0:1788521165.459615:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee424e8000 x1875400222335744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521165.459623:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875400222335744:0@lo:400: 00010000:00080000:1.0:1788521165.459988:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef8149b480 x1875400222335488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521165.460008:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef8149b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222335488:0@lo:400: 00000100:00100000:0.0:1788521165.461166:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788521165.461187:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222335360:12345-0@lo:400: 00000100:00100000:0.0:1788521165.461273:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222335360:12345-0@lo:400: Request processed in 96us (1949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521165.461282:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788521165.461330:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef8149b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222335360:0@lo:400: 00010000:00080000:0.0:1788521165.461348:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee424e8a80 x1875400222335872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521165.461360:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875400222335872:0@lo:400: 00000100:00080000:3.0:1788521165.462975:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788521165.462982:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521165.463013:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef81499880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222335616:0@lo:400: 00000100:00100000:3.0:1788521165.463233:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521165.463287:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222335616 00000100:00100000:3.0:1788521165.463297:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222335616 00000100:00100000:3.0:1788521165.463352:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788521165.463362:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222335616:12345-0@lo:400: 00000100:00100000:3.0:1788521165.463421:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222335616:12345-0@lo:400: Request processed in 60us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521165.463429:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788521165.464333:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef81499880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222335616:0@lo:400: 00010000:00010000:3.0:1788521166.032152:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521166.989223:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222336000:0@lo:41: 00000100:00100000:0.0:1788521166.989318:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521167.001078:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222336000 00000100:00100000:0.0:1788521167.001102:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222336000 00000100:00100000:0.0:1788521167.001193:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788521167.001423:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222336000:12345-0@lo:41: 00000004:00000024:0.0:1788521167.001479:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1788521167.001605:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222336000:12345-0@lo:41: Request processed in 187us (12286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521167.008104:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222336000:0@lo:41: 00000100:00100000:0.0:1788521167.012064:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:0.0:1788521167.056754:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521167.501052:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222336128:0@lo:41: 00000100:00100000:1.0:1788521167.501151:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521167.501250:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222336128 00000100:00100000:1.0:1788521167.501259:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222336128 00000100:00100000:1.0:1788521167.501329:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788521167.501340:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222336128:12345-0@lo:41: 00000004:00000024:1.0:1788521167.501393:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788521167.501445:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222336128:12345-0@lo:41: Request processed in 107us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521167.501452:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788521167.501512:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222336128:0@lo:41: 00000001:02000400:0.0:1788521167.547729:0:8801:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg341-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788521168.101342:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788521168.931366:0:8853:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788521168.931648:0:8853:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1788521169.040127:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788521169.040137:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fef81580000 from 30 10000000:01000000:1.0:1788521169.040145:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788521169.040200:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef821dd800/0x411dd0ee4d2d108f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521169.040214:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef821dd800/0x411dd0ee4d2d108f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521169.040226:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef821dd800/0x411dd0ee4d2d108f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521169.040255:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222336256:0@lo:101: 00000100:00100000:1.0:1788521169.041172:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521169.041250:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef7a431d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521169.041948:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222336256 00000100:00100000:2.0:1788521169.041959:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222336256 00000100:00100000:2.0:1788521169.042035:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788521169.042045:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:6517:x1875400222336256:12345-0@lo:101: 00010000:00010000:2.0:1788521169.042063:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521169.042084:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d1096 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d108f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521169.042130:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d1096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d108f expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521169.042143:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d1096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d108f expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521169.042155:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fde00, rc 0) 00000100:00100000:2.0:1788521169.042215:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:6517:x1875400222336256:12345-0@lo:101: Request processed in 172us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521169.042221:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788521169.042503:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222336256:0@lo:101: 00010000:00010000:1.0:1788521169.042523:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef821dd800/0x411dd0ee4d2d108f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1096 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521169.042533:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef821dd800/0x411dd0ee4d2d108f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d1096 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521169.042643:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222336384:0@lo:501: 00000100:00100000:1.0:1788521169.042678:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521169.043681:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef7a431d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521169.047624:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222336384 00000100:00100000:3.0:1788521169.047642:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222336384 00000100:00100000:3.0:1788521169.047709:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788521169.047723:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:6517:x1875400222336384:12345-0@lo:501: 00000100:00100000:3.0:1788521169.047978:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:6517:x1875400222336384:12345-0@lo:501: Request processed in 257us (5299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521169.047986:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788521169.048149:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222336384:0@lo:501: 00000100:00100000:1.0:1788521169.048213:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222336512:0@lo:503: 00000100:00100000:1.0:1788521169.048270:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521169.048318:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef7a431d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521169.048433:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222336512 00000100:00100000:2.0:1788521169.048439:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222336512 00000100:00100000:2.0:1788521169.048466:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788521169.048474:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:6517:x1875400222336512:12345-0@lo:503: 00000100:00100000:2.0:1788521169.048584:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:6517:x1875400222336512:12345-0@lo:503: Request processed in 111us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521169.048592:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788521169.048668:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222336512:0@lo:503: 00000100:00100000:1.0:1788521169.049173:0:8862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8862:1875400222336640:0@lo:502: 00000100:00100000:1.0:1788521169.049213:0:8862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521169.049242:0:8862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef7a431300 going to sleep for 11 seconds 00000100:00100000:2.0:1788521169.049283:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222336640 00000100:00100000:2.0:1788521169.049288:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222336640 00000100:00100000:2.0:1788521169.049319:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788521169.049327:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:8862:x1875400222336640:12345-0@lo:502: 00000100:00100000:2.0:1788521169.049420:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:8862:x1875400222336640:12345-0@lo:502: Request processed in 93us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521169.049427:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788521169.049537:0:8862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8862:1875400222336640:0@lo:502: 00000100:00100000:1.0:1788521169.049590:0:8862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8862:1875400222336768:0@lo:502: 00000100:00100000:1.0:1788521169.049626:0:8862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521169.049650:0:8862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef7a431300 going to sleep for 11 seconds 00000100:00100000:3.0:1788521169.049700:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222336768 00000100:00100000:3.0:1788521169.049705:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222336768 00000100:00100000:3.0:1788521169.049743:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788521169.049750:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:8862:x1875400222336768:12345-0@lo:502: 00000100:00100000:3.0:1788521169.049822:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:8862:x1875400222336768:12345-0@lo:502: Request processed in 72us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521169.049828:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788521169.049933:0:8862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8862:1875400222336768:0@lo:502: 00000040:00080000:1.0:1788521169.049951:0:8862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788521169.050272:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788521169.050300:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788521169.050376:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef821dd800/0x411dd0ee4d2d108f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1096 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521169.050389:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef821dd800/0x411dd0ee4d2d108f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1096 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521169.050399:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788521169.050403:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fef81580000 from 5 10000000:01000000:3.0:1788521169.050406:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788521169.050438:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749ca200/0x411dd0ee4d2d109d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521169.050447:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef749ca200/0x411dd0ee4d2d109d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521169.050457:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef749ca200/0x411dd0ee4d2d109d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521169.050471:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222336896:0@lo:101: 00000100:00100000:3.0:1788521169.050504:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521169.050536:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee4241f900 going to sleep for 11 seconds 00000100:00100000:2.0:1788521169.051425:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222336896 00000100:00100000:2.0:1788521169.051434:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222336896 00000100:00100000:2.0:1788521169.051483:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788521169.051501:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:6517:x1875400222336896:12345-0@lo:101: 00010000:00010000:2.0:1788521169.051514:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521169.051532:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d10a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d109d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521169.051570:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d10a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d109d expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521169.051583:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d10a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d109d expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521169.051592:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fc600, rc 0) 00000100:00100000:2.0:1788521169.051644:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:6517:x1875400222336896:12345-0@lo:101: Request processed in 145us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521169.051651:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788521169.051976:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222336896:0@lo:101: 00010000:00010000:3.0:1788521169.052003:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef749ca200/0x411dd0ee4d2d109d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d10a4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521169.052085:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef749ca200/0x411dd0ee4d2d109d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d10a4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521169.052152:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222337024:0@lo:256: 00000100:00100000:3.0:1788521169.052192:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521169.052223:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee4241f900 going to sleep for 11 seconds 00000100:00100000:2.0:1788521169.052297:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222337024 00000100:00100000:2.0:1788521169.052301:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222337024 00000100:00100000:2.0:1788521169.052393:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788521169.052400:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:6517:x1875400222337024:12345-0@lo:256: 20000000:01000000:2.0:1788521169.052416:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788521169.052434:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788521169.052438:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788521169.053220:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:6517:x1875400222337024:12345-0@lo:256: Request processed in 816us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521169.053230:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788521169.061777:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222337024:0@lo:256: 10000000:01000000:1.0:1788521169.061868:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788521169.061906:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749ca200/0x411dd0ee4d2d109d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d10a4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521169.061919:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef749ca200/0x411dd0ee4d2d109d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d10a4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521169.061939:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788521169.061943:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1788521169.061946:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788521169.061994:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef821ddc00/0x411dd0ee4d2d10ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521169.062003:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef821ddc00/0x411dd0ee4d2d10ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521169.062024:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef821ddc00/0x411dd0ee4d2d10ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521169.062048:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222337152:0@lo:101: 00000100:00100000:1.0:1788521169.062125:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521169.062179:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef7a431d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521169.064788:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222337152 00000100:00100000:2.0:1788521169.064808:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222337152 00000100:00100000:2.0:1788521169.064877:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788521169.064910:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:6517:x1875400222337152:12345-0@lo:101: 00010000:00010000:2.0:1788521169.064940:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521169.064961:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef413fca00/0x411dd0ee4d2d10b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d10ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521169.064994:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef413fca00/0x411dd0ee4d2d10b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d10ab expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521169.065018:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef413fca00/0x411dd0ee4d2d10b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d10ab expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521169.065028:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fca00, rc 0) 00000100:00100000:2.0:1788521169.065118:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:6517:x1875400222337152:12345-0@lo:101: Request processed in 210us (2992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521169.065125:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788521169.069292:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222337152:0@lo:101: 00010000:00010000:0.0:1788521169.069339:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef821ddc00/0x411dd0ee4d2d10ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d10b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521169.069353:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef821ddc00/0x411dd0ee4d2d10ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d10b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521169.069457:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222337280:0@lo:501: 00000100:00100000:0.0:1788521169.069536:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521169.069588:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef71d5b300 going to sleep for 11 seconds 00000100:00100000:0.0:1788521169.069615:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222337280 00000100:00100000:0.0:1788521169.069623:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222337280 00000100:00100000:0.0:1788521169.069674:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788521169.069685:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:6517:x1875400222337280:12345-0@lo:501: 00000100:00100000:0.0:1788521169.069844:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:6517:x1875400222337280:12345-0@lo:501: Request processed in 160us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521169.069852:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788521169.069922:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222337280:0@lo:501: 00000100:00100000:0.0:1788521169.069962:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222337408:0@lo:503: 00000100:00100000:0.0:1788521169.069998:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521169.070261:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef71d5b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788521169.070502:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222337408 00000100:00100000:2.0:1788521169.070507:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222337408 00000100:00100000:2.0:1788521169.070582:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788521169.070591:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:6517:x1875400222337408:12345-0@lo:503: 00000100:00100000:2.0:1788521169.070710:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:6517:x1875400222337408:12345-0@lo:503: Request processed in 121us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521169.070717:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788521169.070792:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222337408:0@lo:503: 00000100:00100000:1.0:1788521169.072950:0:8865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71520380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8865:1875400222337536:0@lo:502: 00000100:00100000:1.0:1788521169.073052:0:8865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521169.077677:0:8865:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef7a431240 going to sleep for 11 seconds 00000100:00100000:0.0:1788521169.077762:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222337536 00000100:00100000:0.0:1788521169.077773:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222337536 00000100:00100000:0.0:1788521169.077836:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788521169.077847:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:8865:x1875400222337536:12345-0@lo:502: 00000100:00100000:1.0:1788521169.078270:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:8865:x1875400222337536:12345-0@lo:502: Request processed in 424us (5218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521169.078280:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788521169.078360:0:8865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71520380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8865:1875400222337536:0@lo:502: 00000020:01000000:1.0:1788521169.078401:0:8865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788521169.078411:0:8865:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788521169.078419:0:8865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521169.078428:0:8865:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788521169.078436:0:8865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788521169.078440:0:8865:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.141@tcp to nid 0x20000c0a8cb8d (192.168.203.141@tcp) 00000020:01000000:1.0:1788521169.078470:0:8865:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788521169.078473:0:8865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788521169.078492:0:8865:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8fef4e784d40) 00000020:00000080:1.0:1788521169.078518:0:8865:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1788521169.078524:0:8865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788521169.078652:0:8865:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1788521169.078660:0:8865:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788521169.078667:0:8865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x411dd0ee4d2d10c0 00010000:00080000:1.0:1788521169.078713:0:8865:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fef81664000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.141@tcp at head 00010000:00010000:1.0:1788521169.078976:0:8865:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788521169.094159:0:8865:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788521169.094192:0:8865:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788521169.094476:0:8865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788521169.094733:0:8865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788521169.094828:0:8865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788521169.097269:0:8865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788521169.101298:0:8867:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788521169.101306:0:8867:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00010000:00010000:1.0:1788521169.102805:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788521169.104728:0:8865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788521169.104747:0:8865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788521169.104805:0:8865:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788521169.104838:0:8865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x411dd0ee4d2d10c7 00000100:00080000:1.0:1788521169.104852:0:8865:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788521169.104860:0:8865:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8fef81664000 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:1.0:1788521169.104944:0:8865:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fef71520380 x1875400222337664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788521169.104971:0:8865:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1788521169.105092:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222337792:0@lo:400: 00000100:00100000:1.0:1788521169.105188:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521169.105228:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875400222338304:0@lo:400: 00000100:00100000:1.0:1788521169.105254:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521169.105280:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788521169.105286:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222337920:0@lo:400: 00000100:00100000:1.0:1788521169.105315:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521169.105346:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222338432:0@lo:400: 00000100:00100000:1.0:1788521169.105368:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521169.105394:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222338048:0@lo:400: 00000100:00100000:1.0:1788521169.105422:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521169.105436:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788521169.105441:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222338176:0@lo:400: 00000100:00100000:1.0:1788521169.105475:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521169.105513:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222337792 00000100:00100000:1.0:1788521169.105521:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222337792 00000100:00100000:1.0:1788521169.105573:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222338304 00000100:00100000:1.0:1788521169.105577:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222338304 00000100:00100000:1.0:1788521169.105603:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222338432 00000100:00100000:1.0:1788521169.105606:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222338432 00000100:00100000:1.0:1788521169.105617:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222338048 00000100:00100000:1.0:1788521169.105619:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222338048 00000100:00100000:1.0:1788521169.105633:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788521169.105643:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef81499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222337792:12345-0@lo:400: 00000100:00100000:1.0:1788521169.105701:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef81499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222337792:12345-0@lo:400: Request processed in 59us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521169.105709:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788521169.105725:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788521169.105731:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef8149bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875400222338304:12345-0@lo:400: 00000100:00100000:1.0:1788521169.105765:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef8149bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875400222338304:12345-0@lo:400: Request processed in 34us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521169.105771:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788521169.105784:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788521169.105789:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef8149b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222338432:12345-0@lo:400: 00000100:00100000:1.0:1788521169.105815:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef8149b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222338432:12345-0@lo:400: Request processed in 26us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521169.105821:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788521169.105832:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788521169.105838:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef8149b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222338048:12345-0@lo:400: 00000100:00100000:1.0:1788521169.105866:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef8149b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222338048:12345-0@lo:400: Request processed in 29us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521169.105872:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788521169.105916:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222337920 00000100:00100000:1.0:1788521169.105920:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222337920 00000100:00100000:1.0:1788521169.105937:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222338176 00000100:00100000:1.0:1788521169.105939:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222338176 00000100:00100000:1.0:1788521169.105949:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788521169.105955:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef8149b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222337920:12345-0@lo:400: 00000100:00100000:1.0:1788521169.105986:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef8149b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222337920:12345-0@lo:400: Request processed in 31us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521169.105991:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788521169.106003:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788521169.106009:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222338176:12345-0@lo:400: 00000100:00100000:1.0:1788521169.106046:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222338176:12345-0@lo:400: Request processed in 38us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521169.106060:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788521169.106085:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788521169.106090:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521169.106121:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222338176:0@lo:400: 00010000:00080000:1.0:1788521169.106136:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef71520e00 x1875400222338048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521169.106145:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222338048:0@lo:400: 00000100:00100000:1.0:1788521169.106179:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222337920:0@lo:400: 00010000:00080000:1.0:1788521169.106189:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef71522300 x1875400222338432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521169.106196:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222338432:0@lo:400: 00010000:00080000:1.0:1788521169.106204:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef71521180 x1875400222337792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521169.106211:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222337792:0@lo:400: 00010000:00080000:1.0:1788521169.106219:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef71523b80 x1875400222338304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521169.106225:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875400222338304:0@lo:400: 00000020:01000000:1.0:1788521169.106308:0:8865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788521169.106314:0:8865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521169.106316:0:8865:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788521169.106320:0:8865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788521169.106325:0:8865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521169.106326:0:8865:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788521169.106329:0:8865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788521169.106337:0:8865:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788521169.106367:0:8865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8865:1875400222338560:0@lo:502: 00000100:00100000:1.0:1788521169.106410:0:8865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521169.106435:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222338560 00000100:00100000:1.0:1788521169.106439:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222338560 00000100:00100000:1.0:1788521169.106474:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788521169.106481:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:8865:x1875400222338560:12345-0@lo:502: 00000100:00100000:1.0:1788521169.106609:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:8865:x1875400222338560:12345-0@lo:502: Request processed in 128us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521169.106616:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788521169.106662:0:8865:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef7a4313c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521169.106674:0:8865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8865:1875400222338560:0@lo:502: 00000020:01000000:1.0:1788521169.106696:0:8865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788521169.106700:0:8865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521169.106701:0:8865:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788521169.106705:0:8865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000100:00100000:3.0:1788521169.106970:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222337664:0@lo:8: 00000100:00100000:3.0:1788521169.107022:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1788521169.107058:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:3.0:1788521169.107084:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788521169.107095:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef821ddc00/0x411dd0ee4d2d10ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d10b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521169.107108:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef821ddc00/0x411dd0ee4d2d10ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d10b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521169.107120:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788521169.107123:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fef58328000 from 30 10000000:01000000:3.0:1788521169.107126:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788521169.107153:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749cb600/0x411dd0ee4d2d10ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521169.107162:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef749cb600/0x411dd0ee4d2d10ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521169.107183:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef749cb600/0x411dd0ee4d2d10ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521169.107197:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222338688:0@lo:101: 00000100:00100000:3.0:1788521169.107226:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521169.107240:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee4241fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788521169.107255:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222338688 00000100:00100000:3.0:1788521169.107261:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222338688 00000100:00100000:3.0:1788521169.107292:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788521169.107298:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:6517:x1875400222338688:12345-0@lo:101: 00010000:00010000:3.0:1788521169.107307:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521169.107320:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef749ca600/0x411dd0ee4d2d10d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d10ce expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521169.107343:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef749ca600/0x411dd0ee4d2d10d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d10ce expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521169.107355:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef749ca600/0x411dd0ee4d2d10d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d10ce expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521169.107365:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749ca600, rc 0) 00000100:00100000:3.0:1788521169.107391:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:6517:x1875400222338688:12345-0@lo:101: Request processed in 94us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521169.107397:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788521169.107430:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222338688:0@lo:101: 00010000:00010000:3.0:1788521169.107444:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef749cb600/0x411dd0ee4d2d10ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d10d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521169.107463:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef749cb600/0x411dd0ee4d2d10ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d10d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521169.107519:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222338816:0@lo:501: 00000100:00100000:3.0:1788521169.107556:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521169.107571:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee4241fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788521169.107581:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222338816 00000100:00100000:3.0:1788521169.107584:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222338816 00000100:00100000:3.0:1788521169.107604:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788521169.107610:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:6517:x1875400222338816:12345-0@lo:501: 00000100:00100000:3.0:1788521169.107722:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:6517:x1875400222338816:12345-0@lo:501: Request processed in 111us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521169.107729:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788521169.107756:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222338816:0@lo:501: 00000100:00100000:3.0:1788521169.107781:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222338944:0@lo:503: 00000100:00100000:3.0:1788521169.107866:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521169.107879:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee4241fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788521169.107915:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222338944 00000100:00100000:3.0:1788521169.107918:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222338944 00000100:00100000:3.0:1788521169.107938:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788521169.107943:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:6517:x1875400222338944:12345-0@lo:503: 00000100:00100000:3.0:1788521169.108009:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:6517:x1875400222338944:12345-0@lo:503: Request processed in 65us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521169.108015:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788521169.108055:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222338944:0@lo:503: 00000100:00100000:1.0:1788521169.111643:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222337664 00000100:00100000:1.0:1788521169.111660:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222337664 00000100:00100000:1.0:1788521169.111717:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788521169.111726:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1875400222337664:12345-0@lo:8: 00010000:00080000:1.0:1788521169.111765:0:8434:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:1.0:1788521169.111801:0:8434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x411dd0ee4d2d10dc 00002000:00100000:1.0:1788521169.111847:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8fef76790800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788521169.111852:0:8434:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:1.0:1788521169.111857:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788521169.111951:0:8434:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788521169.112219:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788521169.112273:0:8434:0:(import.c:65:import_set_state_nolock()) ffff8fef76797800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788521169.112383:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1875400222337664:12345-0@lo:8: Request processed in 657us (5359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521169.112392:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788521169.116989:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef71520380 x1875400222337664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788521179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521169.117009:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788521169.117022:0:3642:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788521169.117032:0:3642:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788521169.117041:0:3642:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788521169.117046:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef81664000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788521169.117070:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788521169.117077:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222337664:0@lo:8: 00000004:00080000:3.0:1788521169.119578:0:8867:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788521169.119686:0:8867:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 219185801822ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788521169.119697:0:8867:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788521169.120293:0:8869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8869:1875400222339072:0@lo:700: 00000100:00100000:1.0:1788521169.120380:0:8869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521169.120415:0:8869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef7a4313c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521169.122532:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222339072 00000100:00100000:0.0:1788521169.122559:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222339072 00000100:00100000:0.0:1788521169.122662:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788521169.122675:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8869:x1875400222339072:12345-0@lo:700: 00000100:00100000:0.0:1788521169.122741:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8443:1875400222339200:0@lo:700: 00000100:00100000:0.0:1788521169.122814:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521169.122849:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef71d5bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788521169.122878:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222339200 00000100:00100000:0.0:1788521169.122899:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222339200 00000100:00100000:0.0:1788521169.122931:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788521169.122937:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8443:x1875400222339200:12345-0@lo:700: 00000100:00080000:1.0:1788521169.124201:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521169.133382:0:8870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8870:1875400222339328:0@lo:502: 00000100:00100000:0.0:1788521169.134423:0:8870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521169.134478:0:8870:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef71d5b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788521169.134590:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222339328 00000100:00100000:1.0:1788521169.134601:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222339328 00000100:00100000:1.0:1788521169.134668:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788521169.134679:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:8870:x1875400222339328:12345-0@lo:502: 00000100:00100000:1.0:1788521169.134841:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:8870:x1875400222339328:12345-0@lo:502: Request processed in 163us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521169.134850:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788521169.135170:0:8870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8870:1875400222339328:0@lo:502: 00000100:00100000:0.0:1788521169.135244:0:8870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8870:1875400222339456:0@lo:502: 00000100:00100000:0.0:1788521169.135284:0:8870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521169.135303:0:8870:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef71d5b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788521169.135757:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222339456 00000100:00100000:2.0:1788521169.135764:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222339456 00000100:00100000:2.0:1788521169.135832:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788521169.135841:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:8870:x1875400222339456:12345-0@lo:502: 00000100:00100000:2.0:1788521169.135964:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:8870:x1875400222339456:12345-0@lo:502: Request processed in 122us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521169.135971:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788521169.146128:0:8870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8870:1875400222339456:0@lo:502: 00000040:00080000:0.0:1788521169.146195:0:8870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788521169.149877:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788521169.150177:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788521169.150191:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749cb600/0x411dd0ee4d2d10ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d10d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521169.150205:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef749cb600/0x411dd0ee4d2d10ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d10d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521169.150217:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788521169.150220:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fef58328000 from 5 10000000:01000000:3.0:1788521169.150223:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788521169.150272:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749caa00/0x411dd0ee4d2d10e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521169.150280:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef749caa00/0x411dd0ee4d2d10e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521169.150305:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef749caa00/0x411dd0ee4d2d10e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521169.150333:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222339584:0@lo:101: 00000100:00100000:3.0:1788521169.150419:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521169.150472:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee4241fe40 going to sleep for 11 seconds 00000004:00080000:1.0:1788521169.152103:0:7450:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788521169.152667:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222339584 00000100:00100000:0.0:1788521169.152682:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222339584 00000100:00100000:0.0:1788521169.152753:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788521169.152765:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:6517:x1875400222339584:12345-0@lo:101: 00010000:00010000:0.0:1788521169.152788:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521169.152810:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef40030c00/0x411dd0ee4d2d10ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d10e3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521169.152846:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef40030c00/0x411dd0ee4d2d10ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d10e3 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521169.152859:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef40030c00/0x411dd0ee4d2d10ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d10e3 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521169.152869:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef40030c00, rc 0) 00000100:00100000:0.0:1788521169.152967:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+19:6517:x1875400222339584:12345-0@lo:101: Request processed in 204us (2548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521169.152974:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 40000000:02000000:0.0:1788521169.153037:0:6526:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:3.0:1788521169.153811:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222339584:0@lo:101: 00010000:00010000:3.0:1788521169.153839:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef749caa00/0x411dd0ee4d2d10e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d10ea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521169.153852:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef749caa00/0x411dd0ee4d2d10e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d10ea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521169.154553:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222339712:0@lo:256: 00000100:00100000:3.0:1788521169.155299:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521169.157152:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee4241fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788521169.158384:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222339712 00000100:00100000:1.0:1788521169.158401:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222339712 00000100:00100000:1.0:1788521169.158490:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788521169.158502:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+19:6517:x1875400222339712:12345-0@lo:256: 20000000:01000000:1.0:1788521169.158535:0:6514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788521169.158574:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788521169.158578:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788521169.158733:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+19:6517:x1875400222339712:12345-0@lo:256: Request processed in 232us (3435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521169.158742:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788521169.162065:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222339712:0@lo:256: 10000000:01000000:3.0:1788521169.162159:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788521169.162173:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749caa00/0x411dd0ee4d2d10e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d10ea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521169.162187:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef749caa00/0x411dd0ee4d2d10e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d10ea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521169.162199:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788521169.162202:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1788521169.162215:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788521169.162262:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749ca400/0x411dd0ee4d2d10f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521169.162272:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef749ca400/0x411dd0ee4d2d10f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521169.162284:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef749ca400/0x411dd0ee4d2d10f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521169.162307:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222339840:0@lo:101: 00000100:00100000:3.0:1788521169.162380:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521169.162424:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee4241fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788521169.162576:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222339840 00000100:00100000:1.0:1788521169.162585:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222339840 00000100:00100000:1.0:1788521169.162643:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788521169.162661:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+19:6517:x1875400222339840:12345-0@lo:101: 00010000:00010000:1.0:1788521169.162680:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521169.162695:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef821dc000/0x411dd0ee4d2d10f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d10f1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521169.162723:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef821dc000/0x411dd0ee4d2d10f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d10f1 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521169.162735:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef821dc000/0x411dd0ee4d2d10f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d10f1 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521169.162744:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef821dc000, rc 0) 00000100:00100000:1.0:1788521169.162803:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:6517:x1875400222339840:12345-0@lo:101: Request processed in 144us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521169.162810:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788521169.165225:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222339840:0@lo:101: 00010000:00010000:3.0:1788521169.165266:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef749ca400/0x411dd0ee4d2d10f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d10f8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521169.165281:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef749ca400/0x411dd0ee4d2d10f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d10f8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521169.165391:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222339968:0@lo:501: 00000100:00100000:3.0:1788521169.165457:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521169.165507:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee4241fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788521169.165532:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222339968 00000100:00100000:3.0:1788521169.165539:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222339968 00000100:00100000:3.0:1788521169.165594:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788521169.165604:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:6517:x1875400222339968:12345-0@lo:501: 00000100:00100000:3.0:1788521169.165761:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:6517:x1875400222339968:12345-0@lo:501: Request processed in 159us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521169.165779:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788521169.165812:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222339968:0@lo:501: 00000100:00100000:3.0:1788521169.165836:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222340096:0@lo:503: 00000100:00100000:3.0:1788521169.165870:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521169.165917:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee4241fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788521169.165937:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222340096 00000100:00100000:3.0:1788521169.165940:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222340096 00000100:00100000:3.0:1788521169.166083:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788521169.166091:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4813ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:6517:x1875400222340096:12345-0@lo:503: 00000100:00100000:3.0:1788521169.166176:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4813ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:6517:x1875400222340096:12345-0@lo:503: Request processed in 87us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521169.166183:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788521169.166222:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222340096:0@lo:503: 00000100:00100000:3.0:1788521169.166475:0:8872:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8872:1875400222340224:0@lo:502: 00000100:00100000:3.0:1788521169.166508:0:8872:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521169.166526:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222340224 00000100:00100000:3.0:1788521169.166529:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222340224 00000100:00100000:3.0:1788521169.166569:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788521169.166576:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4813d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:8872:x1875400222340224:12345-0@lo:502: 00000100:00100000:3.0:1788521169.166647:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4813d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:8872:x1875400222340224:12345-0@lo:502: Request processed in 71us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521169.166654:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788521169.166681:0:8872:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee4241fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788521169.166693:0:8872:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8872:1875400222340224:0@lo:502: 00000020:01000000:3.0:1788521169.166723:0:8872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788521169.166733:0:8872:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788521169.166741:0:8872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521169.166743:0:8872:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788521169.166749:0:8872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788521169.166753:0:8872:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.141@tcp to nid 0x20000c0a8cb8d (192.168.203.141@tcp) 00000020:01000000:3.0:1788521169.166779:0:8872:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788521169.166782:0:8872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788521169.166800:0:8872:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8fef7a258000) 00000020:00000080:3.0:1788521169.166827:0:8872:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1788521169.166833:0:8872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788521169.168561:0:8872:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788521169.168575:0:8872:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788521169.170455:0:8872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x411dd0ee4d2d1106 00010000:00080000:3.0:1788521169.170538:0:8872:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fef7ef40000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.141@tcp at head 00010000:00010000:3.0:1788521169.171567:0:8872:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:0.0:1788521169.185034:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8443:x1875400222339200:12345-0@lo:700: Request processed in 60846us (60970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521169.185051:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788521169.185138:0:8443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee424e8380 x1875400222339200/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788521185 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521169.185155:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8443:1875400222339200:0@lo:700: 40000000:02000000:0.0:1788521169.185172:0:8443:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:3.0:1788521169.216149:0:8872:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788521169.216184:0:8872:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788521169.216473:0:8872:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788521169.216716:0:8872:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788521169.216814:0:8872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788521169.216936:0:8872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788521169.223434:0:8873:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788521169.223443:0:8873:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000001:00100000:0.0:1788521169.227803:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788521169.228279:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8869:x1875400222339072:12345-0@lo:700: Request processed in 105601us (107893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521169.228300:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:00000080:0.0:1788521169.228614:0:8872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788521169.228631:0:8872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788521169.228685:0:8872:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788521169.228713:0:8872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x411dd0ee4d2d110d 00000100:00080000:0.0:1788521169.228723:0:8872:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788521169.228729:0:8872:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8fef7ef40000 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:0.0:1788521169.228769:0:8872:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee424e8380 x1875400222340352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788521169.228794:0:8872:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788521169.228858:0:8872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521169.228862:0:8872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521169.228865:0:8872:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788521169.228868:0:8872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521169.228872:0:8872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521169.228873:0:8872:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788521169.228876:0:8872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788521169.228878:0:8872:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00010000:00080000:1.0:1788521169.230233:0:8869:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef76714700 x1875400222339072/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788521185 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521169.230251:0:8869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8869:1875400222339072:0@lo:700: 00000100:00100000:2.0:1788521169.230589:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222340352:0@lo:8: 00000100:00100000:2.0:1788521169.230675:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521169.232173:0:8872:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8872:1875400222340480:0@lo:502: 00000100:00100000:0.0:1788521169.232254:0:8872:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521169.232289:0:8872:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4e6d5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788521169.232425:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222340480 00000100:00100000:2.0:1788521169.232435:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222340480 00000100:00100000:2.0:1788521169.232501:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788521169.232515:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4813f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:8872:x1875400222340480:12345-0@lo:502: 00000100:00100000:3.0:1788521169.233191:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222340352 00000100:00100000:3.0:1788521169.233205:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222340352 00000100:00100000:3.0:1788521169.233264:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788521169.233272:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1875400222340352:12345-0@lo:8: 00010000:00080000:3.0:1788521169.233304:0:8437:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:3.0:1788521169.233333:0:8437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x411dd0ee4d2d1114 00002000:00100000:3.0:1788521169.233348:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8fef7ef44000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788521169.233361:0:8437:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788521169.233365:0:8437:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788521169.233443:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788521169.233470:0:8437:0:(import.c:65:import_set_state_nolock()) ffff8fef7ef41800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788521169.233566:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875400222340352:12345-0@lo:8: Request processed in 294us (2891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521169.233573:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788521169.233623:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee424e8380 x1875400222340352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788521179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521169.233634:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788521169.233642:0:3642:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788521169.233649:0:3642:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788521169.233654:0:3642:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788521169.233656:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef7ef40000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788521169.233670:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788521169.233675:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222340352:0@lo:8: 00000004:00080000:3.0:1788521169.233700:0:8873:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788521169.233746:0:8873:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 219299861585ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788521169.233751:0:8873:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788521169.241722:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4813f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:8872:x1875400222340480:12345-0@lo:502: Request processed in 9196us (9453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521169.241741:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788521169.242299:0:8872:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:8872:1875400222340480:0@lo:502: 00000020:01000000:0.0:1788521169.242346:0:8872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521169.242359:0:8872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521169.242362:0:8872:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788521169.242367:0:8872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1788521169.242527:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788521169.242589:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788521169.242602:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749ca400/0x411dd0ee4d2d10f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d10f8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521169.242614:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef749ca400/0x411dd0ee4d2d10f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d10f8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521169.242625:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788521169.242628:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8fef4e780000 from 1 10000000:01000000:0.0:1788521169.242631:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788521169.242674:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef40030600/0x411dd0ee4d2d111b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521169.242683:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef40030600/0x411dd0ee4d2d111b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521169.242694:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef40030600/0x411dd0ee4d2d111b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521169.242717:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222340608:0@lo:101: 00000100:00100000:0.0:1788521169.242791:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521169.242843:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4e6d5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788521169.242996:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222340608 00000100:00100000:3.0:1788521169.243011:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222340608 00000100:00100000:3.0:1788521169.243064:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788521169.243074:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71ec6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:6517:x1875400222340608:12345-0@lo:101: 00010000:00010000:3.0:1788521169.243090:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521169.243108:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef749cac00/0x411dd0ee4d2d1122 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d111b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521169.243136:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef749cac00/0x411dd0ee4d2d1122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d111b expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521169.243162:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef749cac00/0x411dd0ee4d2d1122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d111b expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521169.243171:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749cac00, rc 0) 00000100:00100000:3.0:1788521169.243246:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71ec6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222340608:12345-0@lo:101: Request processed in 173us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521169.243255:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000004:00080000:0.0:1788521169.243714:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788521169.243859:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222340608:0@lo:101: 00010000:00010000:0.0:1788521169.243880:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef40030600/0x411dd0ee4d2d111b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1122 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521169.244072:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef40030600/0x411dd0ee4d2d111b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d1122 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521169.244176:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222340736:0@lo:501: 00000100:00100000:0.0:1788521169.244223:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521169.244258:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4e6d5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788521169.244278:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222340736 00000100:00100000:0.0:1788521169.244284:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222340736 00000100:00100000:0.0:1788521169.244326:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788521169.244334:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71ec7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222340736:12345-0@lo:501: 00000100:00100000:0.0:1788521169.244428:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71ec7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222340736:12345-0@lo:501: Request processed in 94us (204us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788521169.244435:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788521169.244468:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222340736:0@lo:501: 10000000:01000000:0.0:1788521169.244494:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788521169.244500:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef40030600/0x411dd0ee4d2d111b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1122 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521169.244509:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef40030600/0x411dd0ee4d2d111b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1122 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788521169.259315:0:8869:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788521169.259344:0:8869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8869:1875400222340992:0@lo:7: 00000100:00100000:2.0:1788521169.259409:0:8869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521169.259444:0:8869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef484d8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788521169.259471:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222340992 00000100:00100000:2.0:1788521169.259476:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222340992 00000100:00100000:2.0:1788521169.259517:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788521169.259525:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8869:x1875400222340992:12345-0@lo:7: 00000100:00100000:0.0:1788521169.260161:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222340864:0@lo:13: 00000100:00100000:0.0:1788521169.260243:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521169.260323:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222340864 00000100:00100000:0.0:1788521169.260332:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222340864 00000100:00100000:0.0:1788521169.260391:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788521169.260403:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875400222340864:12345-0@lo:13: 00002000:00000024:0.0:1788521169.260437:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923918848 avail 3692396544 00000100:00100000:0.0:1788521169.260512:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875400222340864:12345-0@lo:13: Request processed in 112us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521169.260520:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788521169.260591:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef766f4a80 x1875400222340864/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521185 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521169.260617:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222340864:0@lo:13: 00000004:00080000:3.0:1788521169.263236:0:8874:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788521169.263266:0:8874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8874:1875400222341248:0@lo:7: 00000100:00100000:3.0:1788521169.263326:0:8874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521169.263353:0:8874:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee4241ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788521169.264680:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222341120:0@lo:13: 00000100:00100000:0.0:1788521169.264764:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521169.264841:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788521169.264851:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788521169.264899:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222341120 00000100:00100000:0.0:1788521169.264910:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222341120 00000100:00100000:0.0:1788521169.264986:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788521169.264996:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875400222341120:12345-0@lo:13: 00002000:00000024:0.0:1788521169.265024:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923918848 avail 3692396544 00000100:00100000:0.0:1788521169.265073:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875400222341120:12345-0@lo:13: Request processed in 78us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521169.265080:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788521169.265124:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee41aa9c00 x1875400222341120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521185 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521169.265148:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222341120:0@lo:13: 00000100:00100000:0.0:1788521169.265410:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222341248 00000100:00100000:0.0:1788521169.265420:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222341248 00000100:00100000:3.0:1788521169.266115:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788521169.266126:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8874:x1875400222341248:12345-0@lo:7: 00000100:00080000:0.0:1788521169.266282:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1788521169.277608:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788521169.277620:0:8436:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788521169.277717:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8869:x1875400222340992:12345-0@lo:7: Request processed in 18188us (18302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521169.277728:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788521169.278082:0:8869:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef766f5c00 x1875400222340992/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788521185 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521169.278097:0:8869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8869:1875400222340992:0@lo:7: 00000004:00080000:1.0:1788521169.278111:0:8869:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788521169.278149:0:8869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8869:1875400222341376:0@lo:5: 00000100:00100000:1.0:1788521169.278185:0:8869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521169.278216:0:8869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef7a4313c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521169.278272:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222341376 00000100:00100000:0.0:1788521169.278280:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222341376 00000100:00100000:0.0:1788521169.278334:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521169.278343:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8869:x1875400222341376:12345-0@lo:5: 00002000:00080000:0.0:1788521169.278386:0:8434:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1788521169.278438:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8869:x1875400222341376:12345-0@lo:5: Request processed in 95us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521169.278444:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788521169.282251:0:8869:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef76714700 x1875400222341376/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788521185 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521169.282283:0:8869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8869:1875400222341376:0@lo:5: 00000004:00080000:2.0:1788521169.282299:0:8869:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788521169.282362:0:8869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8869:1875400222341504:0@lo:5: 00000100:00100000:2.0:1788521169.282419:0:8869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521169.282454:0:8869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef484d8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788521169.282557:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222341504 00000100:00100000:1.0:1788521169.282564:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222341504 00000100:00100000:1.0:1788521169.282622:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788521169.282631:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8869:x1875400222341504:12345-0@lo:5: 00002000:00080000:1.0:1788521169.282666:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1788521169.284345:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8869:x1875400222341504:12345-0@lo:5: Request processed in 1711us (1921us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788521169.284354:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788521169.284401:0:8869:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef766f5880 x1875400222341504/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788521185 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521169.284415:0:8869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8869:1875400222341504:0@lo:5: 00000004:00080000:1.0:1788521169.284428:0:8869:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1788521169.284461:0:8869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76715f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8869:1875400222341632:0@lo:900: 00000100:00100000:1.0:1788521169.284492:0:8869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521169.284515:0:8869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef7a431c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788521169.284761:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222341632 00000100:00100000:0.0:1788521169.284768:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222341632 00000100:00100000:0.0:1788521169.284811:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788521169.284820:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8869:x1875400222341632:12345-0@lo:900: 00000100:00100000:0.0:1788521169.284874:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8869:x1875400222341632:12345-0@lo:900: Request processed in 55us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521169.284899:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788521169.284911:0:8869:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef76715f80 x1875400222341632/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788521185 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521169.284921:0:8869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76715f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8869:1875400222341632:0@lo:900: 00002000:00080000:2.0:1788521169.291314:0:8875:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788521169.291323:0:8875:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788521169.291407:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8874:x1875400222341248:12345-0@lo:7: Request processed in 25280us (28076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521169.291417:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788521169.292064:0:8874:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee41aa9880 x1875400222341248/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788521185 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521169.292079:0:8874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8874:1875400222341248:0@lo:7: 00000004:00080000:3.0:1788521169.292099:0:8874:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788521169.292136:0:8874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8874:1875400222341760:0@lo:5: 00000100:00100000:3.0:1788521169.292172:0:8874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521169.292198:0:8874:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee4241ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788521169.292328:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222341760 00000100:00100000:1.0:1788521169.292336:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222341760 00000100:00100000:1.0:1788521169.292391:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788521169.292401:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8874:x1875400222341760:12345-0@lo:5: 00002000:00080000:1.0:1788521169.292425:0:8437:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788521169.292428:0:8437:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:3.0:1788521169.301074:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:3.0:1788521169.301101:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1788521169.301108:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788521169.301276:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8874:x1875400222341760:12345-0@lo:5: Request processed in 8868us (9095us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788521169.301289:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788521169.301344:0:8874:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee41aa9880 x1875400222341760/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788521185 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521169.301378:0:8874:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788521169.301398:0:8874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8874:1875400222341760:0@lo:5: 00000004:00080000:3.0:1788521169.301417:0:8874:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788521169.301484:0:8874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8874:1875400222341888:0@lo:700: 00000100:00100000:3.0:1788521169.301555:0:8874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521169.301751:0:8874:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee4241ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788521169.301775:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222341888 00000100:00100000:2.0:1788521169.301784:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222341888 00000100:00100000:2.0:1788521169.301834:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788521169.301844:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8874:x1875400222341888:12345-0@lo:700: 00000100:00100000:0.0:1788521169.321860:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8874:x1875400222341888:12345-0@lo:700: Request processed in 20009us (20296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521169.321875:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788521169.322033:0:8874:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee41aa9880 x1875400222341888/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788521185 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521169.322055:0:8874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8874:1875400222341888:0@lo:700: 00000004:02000040:3.0:1788521169.336202:0:8874:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:3.0:1788521169.344130:0:8874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8874:1875400222342016:0@lo:5: 00000100:00100000:3.0:1788521169.344477:0:8874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521169.344593:0:8874:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee4241ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788521169.350333:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222342016 00000100:00100000:0.0:1788521169.350353:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222342016 00000100:00100000:0.0:1788521169.354333:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788521169.354359:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8874:x1875400222342016:12345-0@lo:5: 00002000:00080000:1.0:1788521169.366035:0:8875:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788521169.366062:0:8875:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:0.0:1788521169.371095:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8874:x1875400222342016:12345-0@lo:5: Request processed in 16738us (26702us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788521169.371111:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788521169.371249:0:8874:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee41aa9880 x1875400222342016/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788521185 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521169.371269:0:8874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8874:1875400222342016:0@lo:5: 00000004:00080000:3.0:1788521169.371287:0:8874:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:2.0:1788521170.125105:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788521170.282000:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1788521171.149166:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521172.109157:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222342144:0@lo:41: 00000100:00100000:0.0:1788521172.109260:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521172.111338:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222342144 00000100:00100000:0.0:1788521172.111428:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222342144 00000100:00100000:0.0:1788521172.111546:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788521172.111559:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222342144:12345-0@lo:41: 00000004:00000024:0.0:1788521172.111626:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788521172.111806:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222342144:12345-0@lo:41: Request processed in 249us (2544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521172.111814:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788521172.112599:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222342144:0@lo:41: 00010000:00010000:0.0:1788521172.175965:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788521172.251704:0:8963:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788521172.251963:0:8963:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788521172.625099:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222342272:0@lo:41: 00000100:00100000:0.0:1788521172.625198:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521172.625422:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222342272 00000100:00100000:1.0:1788521172.625431:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222342272 00000100:00100000:1.0:1788521172.625504:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788521172.625515:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222342272:12345-0@lo:41: 00000004:00000024:1.0:1788521172.625581:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788521172.646872:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222342272:12345-0@lo:41: Request processed in 21341us (21656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521172.646906:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788521172.647192:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222342272:0@lo:41: 00010000:00010000:2.0:1788521173.197080:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788521173.245263:0:9011:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788521173.245278:0:9011:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1788521174.221422:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521174.673259:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222342400:0@lo:400: 00000100:00100000:0.0:1788521174.673445:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521174.673514:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222342912:0@lo:400: 00000100:00100000:0.0:1788521174.673546:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521174.673566:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222343424:0@lo:400: 00000100:00100000:0.0:1788521174.673594:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521174.673624:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788521174.673630:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222342528:0@lo:400: 00000100:00100000:0.0:1788521174.673655:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521174.673677:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875400222343040:0@lo:400: 00000100:00100000:0.0:1788521174.673698:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521174.673723:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222342784:0@lo:400: 00000100:00100000:0.0:1788521174.673747:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521174.673763:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222343296:0@lo:400: 00000100:00100000:0.0:1788521174.673781:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521174.673796:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788521174.673822:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222342656:0@lo:400: 00000100:00100000:0.0:1788521174.673848:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521174.673863:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875400222343168:0@lo:400: 00000100:00100000:0.0:1788521174.674034:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521174.675852:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222342528 00000100:00100000:1.0:1788521174.675866:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222342528 00000100:00100000:1.0:1788521174.675935:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222343040 00000100:00100000:1.0:1788521174.675939:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222343040 00000100:00100000:1.0:1788521174.675967:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222342784 00000100:00100000:1.0:1788521174.675970:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222342784 00000100:00100000:1.0:1788521174.675981:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222343168 00000100:00100000:1.0:1788521174.675984:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222343168 00000100:00100000:1.0:1788521174.676006:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788521174.676017:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222342528:12345-0@lo:400: 00000100:00100000:1.0:1788521174.676118:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222342528:12345-0@lo:400: Request processed in 103us (2461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521174.676127:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788521174.676148:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788521174.676155:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875400222343040:12345-0@lo:400: 00000100:00100000:1.0:1788521174.676184:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875400222343040:12345-0@lo:400: Request processed in 30us (2485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521174.676190:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788521174.676201:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788521174.676206:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222342784:12345-0@lo:400: 00000100:00100000:1.0:1788521174.676234:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222342784:12345-0@lo:400: Request processed in 28us (2486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521174.676259:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788521174.676343:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788521174.676352:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875400222343168:12345-0@lo:400: 00000100:00100000:1.0:1788521174.676481:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875400222343168:12345-0@lo:400: Request processed in 131us (2596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521174.676487:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788521174.676528:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222343424 00000100:00100000:1.0:1788521174.676533:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222343424 00000100:00100000:1.0:1788521174.676566:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222343296 00000100:00100000:1.0:1788521174.676570:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222343296 00000100:00100000:1.0:1788521174.676595:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788521174.676601:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222343424:12345-0@lo:400: 00000100:00100000:1.0:1788521174.676635:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222343424:12345-0@lo:400: Request processed in 34us (3042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521174.676641:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788521174.676652:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788521174.676658:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222343296:12345-0@lo:400: 00000100:00100000:1.0:1788521174.676685:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222343296:12345-0@lo:400: Request processed in 28us (2903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521174.676691:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788521174.676712:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222342912 00000100:00100000:1.0:1788521174.676716:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222342912 00000100:00100000:1.0:1788521174.676733:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222342656 00000100:00100000:1.0:1788521174.676736:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222342656 00000100:00100000:1.0:1788521174.676747:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788521174.676754:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222342912:12345-0@lo:400: 00000100:00100000:1.0:1788521174.676788:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222342912:12345-0@lo:400: Request processed in 35us (3241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521174.676801:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788521174.676813:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788521174.676819:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222342656:12345-0@lo:400: 00000100:00100000:1.0:1788521174.676848:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222342656:12345-0@lo:400: Request processed in 30us (2999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521174.676854:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788521174.676954:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222342656:0@lo:400: 00010000:00080000:1.0:1788521174.676974:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef76715180 x1875400222343168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521174.676985:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875400222343168:0@lo:400: 00010000:00080000:1.0:1788521174.676997:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef76717480 x1875400222342784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521174.677005:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222342784:0@lo:400: 00010000:00080000:1.0:1788521174.677014:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef76717100 x1875400222343296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521174.677021:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788521174.677038:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222343296:0@lo:400: 00000100:00100000:1.0:1788521174.677060:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788521174.677072:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222343680:0@lo:13: 00000100:00100000:1.0:1788521174.677116:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521174.677162:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222343680 00000100:00100000:1.0:1788521174.677165:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222343680 00000100:00100000:1.0:1788521174.677191:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788521174.677197:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222343680:12345-0@lo:13: 00002000:00000024:1.0:1788521174.677231:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788521174.678425:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222343552:0@lo:13: 00000100:00100000:3.0:1788521174.678480:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521174.678614:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222343680:12345-0@lo:13: Request processed in 71us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521174.678623:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788521174.678646:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222343552 00000100:00100000:1.0:1788521174.678653:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222343552 00000100:00100000:1.0:1788521174.678680:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788521174.678687:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222343552:12345-0@lo:13: 00002000:00000024:1.0:1788521174.678706:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521174.678759:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222343552:12345-0@lo:13: Request processed in 72us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521174.678766:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788521174.678814:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef76716d80 x1875400222343680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521190 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521174.678826:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1788521174.678852:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222343680:0@lo:13: 00010000:00080000:3.0:1788521174.679056:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee424e8000 x1875400222343552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521190 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521174.679085:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222343552:0@lo:13: 00000100:00100000:3.0:1788521174.679985:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222342400 00000100:00100000:3.0:1788521174.679995:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222342400 00000100:00100000:3.0:1788521174.680042:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788521174.680052:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4875b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:3645:x1875400222342400:12345-0@lo:400: 00000100:00100000:3.0:1788521174.680114:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4875b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:3645:x1875400222342400:12345-0@lo:400: Request processed in 64us (6670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521174.680122:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:0.0:1788521174.680413:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788521174.680421:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788521174.680424:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788521174.680462:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef76715880 x1875400222342528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521174.680476:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222342528:0@lo:400: 00010000:00080000:0.0:1788521174.680491:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef76714a80 x1875400222343040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521174.680498:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875400222343040:0@lo:400: 00000100:00100000:0.0:1788521174.680519:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222342400:0@lo:400: 00000100:00100000:0.0:1788521174.680532:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222342912:0@lo:400: 00010000:00080000:0.0:1788521174.680542:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef76715500 x1875400222343424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521174.680549:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222343424:0@lo:400: 00010000:00010000:0.0:1788521175.248260:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521176.275390:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521177.231492:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222343808:0@lo:41: 00000100:00100000:3.0:1788521177.231594:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521177.233051:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222343808 00000100:00100000:1.0:1788521177.233069:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222343808 00000100:00100000:1.0:1788521177.233141:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788521177.233152:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222343808:12345-0@lo:41: 00000004:00000024:1.0:1788521177.233201:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788521177.233294:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222343808:12345-0@lo:41: Request processed in 143us (1700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521177.233302:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788521177.233384:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222343808:0@lo:41: 00010000:00010000:1.0:1788521177.293196:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521177.744035:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788521177.744078:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222343936:0@lo:41: 00000100:00100000:1.0:1788521177.744190:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521177.744274:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222343936 00000100:00100000:1.0:1788521177.744283:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222343936 00000100:00100000:1.0:1788521177.744342:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788521177.744352:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222343936:12345-0@lo:41: 00000004:00000024:1.0:1788521177.744397:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788521177.744448:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222343936:12345-0@lo:41: Request processed in 97us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521177.744455:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788521177.744527:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222343936:0@lo:41: 00010000:00010000:2.0:1788521178.317222:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521179.341257:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521179.790093:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521179.790126:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222344064:0@lo:13: 00000100:00100000:0.0:1788521179.790246:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521179.790985:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222344064 00000100:00100000:0.0:1788521179.790997:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222344064 00000100:00100000:0.0:1788521179.791108:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521179.791121:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222344064:12345-0@lo:13: 00002000:00000024:0.0:1788521179.791157:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521179.791221:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222344064:12345-0@lo:13: Request processed in 104us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521179.791228:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788521179.791278:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee424e8000 x1875400222344064/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521195 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521179.791300:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222344064:0@lo:13: 00000100:00100000:1.0:1788521179.793187:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875400222344320:0@lo:400: 00000100:00100000:1.0:1788521179.793267:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521179.793304:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875400222344832:0@lo:400: 00000100:00100000:1.0:1788521179.793342:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521179.793368:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788521179.793374:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222344192:0@lo:400: 00000100:00100000:1.0:1788521179.793407:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521179.793434:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222344704:0@lo:400: 00000100:00100000:1.0:1788521179.793461:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521179.793506:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222344320 00000100:00100000:1.0:1788521179.793515:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222344320 00000100:00100000:1.0:1788521179.793565:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222344832 00000100:00100000:1.0:1788521179.793568:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222344832 00000100:00100000:0.0:1788521179.793644:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222344192 00000100:00100000:0.0:1788521179.793648:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222344192 00000100:00100000:0.0:1788521179.793683:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788521179.793694:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef48759050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:3644:x1875400222344192:12345-0@lo:400: 00000100:00100000:0.0:1788521179.793754:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef48759050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:3644:x1875400222344192:12345-0@lo:400: Request processed in 62us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521179.793762:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788521179.793800:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222344448:0@lo:400: 00000100:00100000:0.0:1788521179.793827:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521179.793846:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875400222344960:0@lo:400: 00000100:00100000:0.0:1788521179.793868:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521179.793880:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788521179.793903:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222344576:0@lo:400: 00000100:00100000:0.0:1788521179.793926:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521179.793954:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222345088:0@lo:400: 00000100:00100000:0.0:1788521179.793979:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521179.794916:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222345216:0@lo:13: 00000100:00100000:2.0:1788521179.794967:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521179.795031:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222345216 00000100:00100000:2.0:1788521179.795037:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222345216 00000100:00080000:3.0:1788521179.797650:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788521179.797663:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521179.797701:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222344960 00000100:00100000:3.0:1788521179.797713:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222344960 00000100:00100000:3.0:1788521179.797781:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222344576 00000100:00100000:3.0:1788521179.797785:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222344576 00000100:00100000:3.0:1788521179.797810:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788521179.797821:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875400222344320:12345-0@lo:400: 00000100:00100000:3.0:1788521179.797955:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875400222344320:12345-0@lo:400: Request processed in 136us (4687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521179.797964:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788521179.797987:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788521179.797994:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875400222344960:12345-0@lo:400: 00000100:00100000:3.0:1788521179.798034:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875400222344960:12345-0@lo:400: Request processed in 42us (4165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521179.798041:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788521179.798063:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788521179.798070:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222344576:12345-0@lo:400: 00000100:00100000:3.0:1788521179.798100:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222344576:12345-0@lo:400: Request processed in 31us (4173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521179.798106:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1788521179.798162:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef76716d80 x1875400222344576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521179.798180:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222344576:0@lo:400: 00010000:00080000:3.0:1788521179.798201:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef76715c00 x1875400222344960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521179.798210:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875400222344960:0@lo:400: 00000100:00080000:3.0:1788521179.798245:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788521179.798402:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788521179.798411:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875400222344832:12345-0@lo:400: 00000100:00100000:1.0:1788521179.798451:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875400222344832:12345-0@lo:400: Request processed in 43us (5109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521179.798465:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788521179.798508:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222344704 00000100:00100000:1.0:1788521179.798513:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222344704 00000100:00100000:1.0:1788521179.798535:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222344448 00000100:00100000:1.0:1788521179.798538:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222344448 00000100:00100000:1.0:1788521179.798552:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788521179.798558:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222344704:12345-0@lo:400: 00000100:00100000:1.0:1788521179.798594:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222344704:12345-0@lo:400: Request processed in 37us (5132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521179.798600:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788521179.798612:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788521179.798619:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222344448:12345-0@lo:400: 00000100:00100000:1.0:1788521179.798649:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222344448:12345-0@lo:400: Request processed in 31us (4821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521179.798656:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788521179.798684:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76715180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222344192:0@lo:400: 00000100:00100000:1.0:1788521179.798697:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222344704:0@lo:400: 00010000:00080000:1.0:1788521179.798711:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef76714e00 x1875400222344320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521179.798721:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875400222344320:0@lo:400: 00010000:00080000:1.0:1788521179.798731:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef76714000 x1875400222344832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521179.798739:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875400222344832:0@lo:400: 00000100:00100000:1.0:1788521179.798771:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222345088 00000100:00100000:1.0:1788521179.798781:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222345088 00000100:00100000:1.0:1788521179.798810:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788521179.798816:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875400222345088:12345-0@lo:400: 00000100:00100000:1.0:1788521179.798847:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875400222345088:12345-0@lo:400: Request processed in 31us (4867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521179.798853:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788521179.799152:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef76714a80 x1875400222345088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521179.799162:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222345088:0@lo:400: 00000100:00100000:3.0:1788521179.799175:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222344448:0@lo:400: 00000100:00100000:2.0:1788521179.800389:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788521179.800402:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222345216:12345-0@lo:13: 00002000:00000024:2.0:1788521179.800431:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521179.800519:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222345216:12345-0@lo:13: Request processed in 121us (5551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521179.800527:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788521179.800574:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef766f5f80 x1875400222345216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521195 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521179.800597:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222345216:0@lo:13: 00010000:00010000:0.0:1788521180.367519:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521181.403075:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521182.353389:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222345344:0@lo:41: 00000100:00100000:2.0:1788521182.353500:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521182.353631:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222345344 00000100:00100000:1.0:1788521182.353641:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222345344 00000100:00100000:1.0:1788521182.353730:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788521182.353741:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222345344:12345-0@lo:41: 00000004:00000024:1.0:1788521182.353781:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788521182.353837:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222345344:12345-0@lo:41: Request processed in 98us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521182.353845:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788521182.367234:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222345344:0@lo:41: 00010000:00010000:0.0:1788521182.418929:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521182.864350:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788521182.864387:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222345472:0@lo:41: 00000100:00100000:3.0:1788521182.864492:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521182.865380:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222345472 00000100:00100000:2.0:1788521182.865394:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222345472 00000100:00100000:2.0:1788521182.865474:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788521182.865487:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222345472:12345-0@lo:41: 00000004:00000024:2.0:1788521182.865534:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788521182.865620:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222345472:12345-0@lo:41: Request processed in 136us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521182.865627:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788521182.870341:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222345472:0@lo:41: 00010000:00010000:2.0:1788521183.437071:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788521184.269503:0:9511:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788521184.269509:0:9511:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788521184.269511:0:9511:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788521184.269679:0:9511:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8fef7675d800 00000020:01000004:3.0:1788521184.269700:0:9511:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788521184.269718:0:9511:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788521184.269735:0:9511:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8fef7a2599c0) 00000020:00000080:3.0:1788521184.269763:0:9511:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788521184.328991:0:9511:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788521184.329076:0:9511:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1788521184.374196:0:9511:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788521184.378546:0:9511:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788521184.378570:0:9511:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788521184.378656:0:9511:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x411dd0ee4d2d1130 00000020:01000004:0.0:1788521184.378669:0:9511:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788521184.378778:0:9511:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.141@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788521184.378783:0:9511:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788521184.378792:0:9511:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788521184.379001:0:9511:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1788521184.379008:0:9511:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.141@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788521184.421988:0:9511:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.141@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788521184.422041:0:9511:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.141@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1788521184.422046:0:9511:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788521184.422048:0:9511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788521184.422049:0:9511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788521184.422050:0:9511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788521184.422051:0:9511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788521184.422052:0:9511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788521184.422054:0:9511:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788521184.422056:0:9511:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788521184.422057:0:9511:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788521184.422059:0:9511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788521184.422061:0:9511:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788521184.422066:0:9511:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1788521184.422068:0:9511:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788521184.422070:0:9511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788521184.422071:0:9511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788521184.422072:0:9511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788521184.422073:0:9511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788521184.422074:0:9511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788521184.422081:0:9511:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788521184.422082:0:9511:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788521184.422083:0:9511:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788521184.422084:0:9511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788521184.422084:0:9511:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788521184.422120:0:9511:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788521184.422143:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222345600:0@lo:253: 00000100:00100000:0.0:1788521184.422243:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521184.422327:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222345600 00000100:00100000:0.0:1788521184.422337:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222345600 00000100:00100000:0.0:1788521184.422398:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788521184.422409:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:9511:x1875400222345600:12345-0@lo:253: 20000000:01000000:0.0:1788521184.423688:0:6513:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788521184.423696:0:6513:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788521184.423702:0:6513:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788521184.423706:0:6513:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788521184.424221:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788521184.424545:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1788521184.424563:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788521184.424584:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1788521184.424591:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788521184.424604:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1788521184.424618:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1788521184.424724:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1788521184.424747:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.141@tcp 00000100:00100000:3.0:1788521184.424946:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef816b7780 going to sleep for 11 seconds 20000000:01000000:0.0:1788521184.425064:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.141@tcp (null) (null) (null) 00000040:00080000:0.0:1788521184.425089:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1788521184.425097:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788521184.425112:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1788521184.425118:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.141@tcp (null) (null) 00000040:00080000:0.0:1788521184.425132:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1788521184.425139:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788521184.425166:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1788521184.425204:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1788521184.425431:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1788521184.425456:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.141@tcp 20000000:01000000:0.0:1788521184.425458:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.141@tcp (null) (null) (null) 00000040:00080000:0.0:1788521184.425474:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1788521184.425480:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788521184.425494:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1788521184.425499:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.141@tcp (null) (null) 00000040:00080000:0.0:1788521184.425512:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1788521184.425517:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788521184.425530:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1788521184.425548:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1788521184.432674:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1788521184.432714:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.141@tcp 20000000:01000000:0.0:1788521184.432717:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.141@tcp (null) (null) (null) 00000040:00080000:0.0:1788521184.432736:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1788521184.432743:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788521184.433115:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1788521184.433124:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.141@tcp (null) (null) 00000040:00080000:0.0:1788521184.433139:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1788521184.433146:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788521184.433158:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1788521184.433172:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1788521184.433190:0:6513:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788521184.433194:0:6513:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788521184.433198:0:6513:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788521184.433466:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788521184.433469:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788521184.437524:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1788521184.437590:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1788521184.437620:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1788521184.440198:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1788521184.440255:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1788521184.440272:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1788521184.440285:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788521184.440289:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788521184.441117:0:9518:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:3.0:1788521184.441153:0:9518:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:3.0:1788521184.441170:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1788521184.449297:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1788521184.449348:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1788521184.449365:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:1.0:1788521184.449381:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788521184.449384:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788521184.461284:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1788521184.461365:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1788521184.461380:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788521184.461733:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788521184.461765:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1788521184.461781:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1788521184.461796:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788521184.461799:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 00010000:00010000:2.0:1788521184.461909:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:2.0:1788521184.462596:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1788521184.462633:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1788521184.462664:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:0.0:1788521184.468388:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:0.0:1788521184.468455:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:0.0:1788521184.468473:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:0.0:1788521184.468491:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788521184.468494:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788521184.469157:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1788521184.469508:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1788521184.469535:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1788521184.469550:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 10000000:01000000:0.0:1788521184.469566:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788521184.469593:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fef40031a00/0x411dd0ee4d2d1137 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521184.469618:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef40030e00/0x411dd0ee4d2d102d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1026 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521184.469628:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef413fc800/0x411dd0ee4d2d1057 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1050 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521184.469635:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d1096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d108f expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521184.469641:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef413fca00/0x411dd0ee4d2d10b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d10ab expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521184.469648:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef749ca600/0x411dd0ee4d2d10d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d10ce expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521184.469655:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef821dc000/0x411dd0ee4d2d10f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d10f1 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521184.469663:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef749cac00/0x411dd0ee4d2d1122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d111b expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521184.469691:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fef40031a00/0x411dd0ee4d2d1137 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521184.469744:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef749cac00/0x411dd0ee4d2d1122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d111b expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521184.469835:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef749cac00/0x411dd0ee4d2d1122 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d111b expref: 21 pid: 6513 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521184.469853:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1875400222345728:0@lo:104: 00000100:00100000:0.0:1788521184.470151:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788521184.470217:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef821dc000/0x411dd0ee4d2d10f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d10f1 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521184.470236:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef821dc000/0x411dd0ee4d2d10f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d10f1 expref: 21 pid: 6512 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521184.470245:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1875400222345856:0@lo:104: 00000100:00100000:0.0:1788521184.470269:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788521184.470425:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef749ca600/0x411dd0ee4d2d10d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d10ce expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521184.470443:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef749ca600/0x411dd0ee4d2d10d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d10ce expref: 21 pid: 6514 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521184.470453:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1875400222345984:0@lo:104: 00000100:00100000:0.0:1788521184.470476:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788521184.470560:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef413fca00/0x411dd0ee4d2d10b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d10ab expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521184.470580:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef413fca00/0x411dd0ee4d2d10b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d10ab expref: 21 pid: 6514 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521184.470588:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1875400222346112:0@lo:104: 00000100:00100000:0.0:1788521184.470610:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521184.470665:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222345728 00000100:00100000:3.0:1788521184.470674:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222345728 00000100:00100000:3.0:1788521184.470724:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222345856 00000100:00100000:3.0:1788521184.470728:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222345856 00000100:00100000:3.0:1788521184.470739:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222345984 00000100:00100000:3.0:1788521184.470742:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222345984 00000100:00100000:3.0:1788521184.470768:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788521184.470779:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+5:6513:x1875400222345728:12345-0@lo:104: 00010000:00010000:3.0:1788521184.470797:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef40030600/0x411dd0ee4d2d111b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d1122 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521184.471020:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788521184.471028:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+5:6513:x1875400222345728:12345-0@lo:104: Request processed in 251us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521184.471035:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788521184.471057:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788521184.471064:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+4:6513:x1875400222345856:12345-0@lo:104: 00010000:00010000:3.0:1788521184.471081:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef749ca400/0x411dd0ee4d2d10f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d10f8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521184.471649:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d1096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d108f expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521184.471661:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d1096 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d108f expref: 21 pid: 6514 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521184.471674:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1875400222346240:0@lo:104: 00000100:00100000:0.0:1788521184.471708:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788521184.471726:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef413fc800/0x411dd0ee4d2d1057 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d1050 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521184.471734:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef413fc800/0x411dd0ee4d2d1057 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1050 expref: 21 pid: 6513 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521184.471742:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1875400222346368:0@lo:104: 00000100:00100000:0.0:1788521184.471784:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788521184.471818:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef40030e00/0x411dd0ee4d2d102d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d1026 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521184.471826:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef40030e00/0x411dd0ee4d2d102d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1026 expref: 21 pid: 6513 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521184.471834:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1875400222346496:0@lo:104: 00000100:00100000:0.0:1788521184.471861:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef816b7540 going to sleep for 11 seconds 00000100:00100000:0.0:1788521184.471910:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1875400222345728:0@lo:104: 00000100:00100000:0.0:1788521184.471922:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1875400222345856:0@lo:104: 00010000:00010000:1.0:1788521184.472148:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788521184.472158:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef40030600/0x411dd0ee4d2d111b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d1122 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521184.472178:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40030600 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:1.0:1788521184.472183:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef40030600/0x411dd0ee4d2d111b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d1122 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521184.472194:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef40030600/0x411dd0ee4d2d111b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d1122 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521184.472201:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef40030600/0x411dd0ee4d2d111b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d1122 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521184.472208:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788521184.472301:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef40030600/0x411dd0ee4d2d111b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d1122 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521184.472309:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788521184.472334:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef40030600/0x411dd0ee4d2d111b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d1122 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521184.472341:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef40030600/0x411dd0ee4d2d111b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d1122 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521184.472355:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521184.472358:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef749ca400/0x411dd0ee4d2d10f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d10f8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521184.472364:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749ca400 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:1.0:1788521184.472367:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef749ca400/0x411dd0ee4d2d10f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d10f8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521184.472385:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef749ca400/0x411dd0ee4d2d10f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d10f8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521184.472391:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef749ca400/0x411dd0ee4d2d10f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d10f8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521184.472397:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788521184.472411:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef749ca400/0x411dd0ee4d2d10f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d10f8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521184.472417:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788521184.472430:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef749ca400/0x411dd0ee4d2d10f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d10f8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521184.472447:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef749ca400/0x411dd0ee4d2d10f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d10f8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521184.472458:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521184.472459:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521184.472461:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521184.472473:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788521184.472488:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222346624:0@lo:103: 00000100:00100000:1.0:1788521184.472526:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521184.472617:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222346752:0@lo:103: 00000100:00100000:2.0:1788521184.472648:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521184.472703:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788521184.472721:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521184.472731:0:6503:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788521184.472737:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:0.0:1788521184.473104:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222346624 00000100:00100000:0.0:1788521184.473114:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222346624 00010000:00010000:0.0:1788521184.473147:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef749cac00/0x411dd0ee4d2d1122 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d111b expref: 22 pid: 6513 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521184.473179:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222346752 00000100:00100000:0.0:1788521184.473181:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222346752 00010000:00010000:0.0:1788521184.473193:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef821dc000/0x411dd0ee4d2d10f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d10f1 expref: 23 pid: 6512 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521184.473208:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788521184.473216:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76715180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:3645:x1875400222346624:12345-0@lo:103: 00010000:00010000:0.0:1788521184.473303:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521184.473310:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef749cac00/0x411dd0ee4d2d1122 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d111b expref: 23 pid: 6513 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521184.473322:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef749cac00/0x411dd0ee4d2d1122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d111b expref: 23 pid: 6513 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521184.473338:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef749cac00/0x411dd0ee4d2d1122 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d111b expref: 23 pid: 6513 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521184.473353:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521184.473399:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76715180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:3645:x1875400222346624:12345-0@lo:103: Request processed in 183us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521184.473407:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788521184.473445:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788521184.473452:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:3643:x1875400222346752:12345-0@lo:103: 00010000:00010000:0.0:1788521184.473459:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521184.473464:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef821dc000/0x411dd0ee4d2d10f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d10f1 expref: 21 pid: 6512 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521184.473472:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef821dc000/0x411dd0ee4d2d10f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d10f1 expref: 21 pid: 6512 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521184.473482:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef821dc000/0x411dd0ee4d2d10f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d10f1 expref: 21 pid: 6512 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521184.473494:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521184.473521:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:3643:x1875400222346752:12345-0@lo:103: Request processed in 70us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521184.473526:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788521184.473578:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222346624:0@lo:103: 00000100:00100000:2.0:1788521184.475593:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222346752:0@lo:103: 00000100:00100000:2.0:1788521184.475648:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222346112 00000100:00100000:2.0:1788521184.475656:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222346112 00000100:00100000:2.0:1788521184.475712:0:6503:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788521184.475722:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222346240 00000100:00100000:2.0:1788521184.475725:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222346240 00000100:00100000:2.0:1788521184.475738:0:6503:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788521184.475742:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222346368 00000100:00100000:2.0:1788521184.475745:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222346368 00000100:00100000:2.0:1788521184.475754:0:6503:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788521184.475758:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222346496 00000100:00100000:2.0:1788521184.475760:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222346496 00000100:00100000:0.0:1788521184.476019:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788521184.476031:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+8:6513:x1875400222345984:12345-0@lo:104: 00010000:00010000:0.0:1788521184.476055:0:9522:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef749cb600/0x411dd0ee4d2d10ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d10d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521184.476156:0:9522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788521184.476162:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+8:6513:x1875400222345984:12345-0@lo:104: Request processed in 134us (5685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521184.476168:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788521184.476186:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788521184.476192:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+7:6513:x1875400222346112:12345-0@lo:104: 00010000:00010000:0.0:1788521184.476219:0:9522:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef821ddc00/0x411dd0ee4d2d10ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d10b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521184.476879:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1875400222345984:0@lo:104: 00010000:00010000:2.0:1788521184.476924:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521184.476932:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef749cb600/0x411dd0ee4d2d10ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d10d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.476952:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cb600 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:2.0:1788521184.476957:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef749cb600/0x411dd0ee4d2d10ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d10d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.476968:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef749cb600/0x411dd0ee4d2d10ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d10d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521184.476993:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef749cb600/0x411dd0ee4d2d10ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d10d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521184.476999:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788521184.477052:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef749cb600/0x411dd0ee4d2d10ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d10d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.477059:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521184.477081:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef749cb600/0x411dd0ee4d2d10ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d10d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.477089:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef749cb600/0x411dd0ee4d2d10ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d10d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.477104:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521184.477105:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521184.477107:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521184.477123:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222346880:0@lo:103: 00000100:00100000:2.0:1788521184.477180:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521184.477360:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222346880 00000100:00100000:2.0:1788521184.477368:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222346880 00010000:00010000:2.0:1788521184.477396:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef749ca600/0x411dd0ee4d2d10d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d10ce expref: 20 pid: 6514 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521184.477443:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788521184.477452:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:3644:x1875400222346880:12345-0@lo:103: 00010000:00010000:2.0:1788521184.477465:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521184.477472:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef749ca600/0x411dd0ee4d2d10d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d10ce expref: 20 pid: 6514 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.477490:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef749ca600/0x411dd0ee4d2d10d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d10ce expref: 20 pid: 6514 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.477507:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef749ca600/0x411dd0ee4d2d10d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d10ce expref: 20 pid: 6514 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.477522:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521184.477557:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+19:3644:x1875400222346880:12345-0@lo:103: Request processed in 107us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521184.477564:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788521184.477592:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222346880:0@lo:103: 00010000:00010000:3.0:1788521184.479150:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1788521184.479169:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+7:6513:x1875400222345856:12345-0@lo:104: Request processed in 8101us (8893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521184.479180:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788521184.479232:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788521184.479251:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+6:6513:x1875400222346240:12345-0@lo:104: 00010000:00010000:3.0:1788521184.479268:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef821dd800/0x411dd0ee4d2d108f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d1096 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521184.479368:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788521184.479373:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+6:6513:x1875400222346240:12345-0@lo:104: Request processed in 134us (7665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521184.479379:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:3.0:1788521184.479399:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521184.479406:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef821dd800/0x411dd0ee4d2d108f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d1096 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521184.479414:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef821dd800 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:3.0:1788521184.479418:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef821dd800/0x411dd0ee4d2d108f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d1096 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521184.479427:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef821dd800/0x411dd0ee4d2d108f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d1096 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521184.479443:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef821dd800/0x411dd0ee4d2d108f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d1096 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521184.479465:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788521184.479538:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1875400222346240:0@lo:104: 00010000:00010000:2.0:1788521184.479764:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521184.479965:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788521184.479977:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee42278850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+5:6513:x1875400222346368:12345-0@lo:104: 00010000:00010000:2.0:1788521184.479987:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef413fda00/0x411dd0ee4d2d1050 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d1057 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521184.480048:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1875400222346368:0@lo:104: 00010000:00010000:2.0:1788521184.480063:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788521184.480068:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee42278850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+5:6513:x1875400222346368:12345-0@lo:104: Request processed in 96us (8285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521184.480074:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1788521184.480089:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521184.480094:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef413fda00/0x411dd0ee4d2d1050 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d1057 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.480101:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef413fda00 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:2.0:1788521184.480112:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef413fda00/0x411dd0ee4d2d1050 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d1057 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.480120:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef413fda00/0x411dd0ee4d2d1050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d1057 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521184.480127:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef413fda00/0x411dd0ee4d2d1050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d1057 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521184.480132:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788521184.480198:0:9522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788521184.480206:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+4:6513:x1875400222346112:12345-0@lo:104: Request processed in 4013us (9593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521184.480212:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788521184.480356:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788521184.480365:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:6513:x1875400222346496:12345-0@lo:104: 00010000:00010000:1.0:1788521184.480379:0:9522:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef749cb000/0x411dd0ee4d2d1026 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d102d expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521184.480406:0:9522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788521184.480410:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:6513:x1875400222346496:12345-0@lo:104: Request processed in 48us (7689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521184.480416:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1788521184.480555:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef821dd800/0x411dd0ee4d2d108f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d1096 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521184.480562:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521184.480587:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef821dd800/0x411dd0ee4d2d108f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d1096 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521184.480595:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef821dd800/0x411dd0ee4d2d108f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d1096 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521184.480609:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788521184.480613:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef821ddc00/0x411dd0ee4d2d10ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d10b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521184.480618:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef821ddc00 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:3.0:1788521184.480621:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef821ddc00/0x411dd0ee4d2d10ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d10b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521184.480628:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef821ddc00/0x411dd0ee4d2d10ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d10b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521184.480635:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef821ddc00/0x411dd0ee4d2d10ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d10b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521184.480641:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788521184.480704:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef413fda00/0x411dd0ee4d2d1050 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d1057 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.480710:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521184.480715:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef413fda00/0x411dd0ee4d2d1050 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d1057 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.480722:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef413fda00/0x411dd0ee4d2d1050 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d1057 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.480732:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521184.480735:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef749cb000/0x411dd0ee4d2d1026 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d102d expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.480741:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cb000 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:2.0:1788521184.480744:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef749cb000/0x411dd0ee4d2d1026 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d102d expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.480760:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef749cb000/0x411dd0ee4d2d1026 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d102d expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521184.480776:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef749cb000/0x411dd0ee4d2d1026 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d102d expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521184.480781:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788521184.480793:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef749cb000/0x411dd0ee4d2d1026 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d102d expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.480797:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521184.480817:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef749cb000/0x411dd0ee4d2d1026 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d102d expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.480825:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef749cb000/0x411dd0ee4d2d1026 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d102d expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.480835:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521184.480836:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521184.480838:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521184.480843:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521184.480860:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1875400222346112:0@lo:104: 00000100:00100000:2.0:1788521184.480868:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1875400222346496:0@lo:104: 00010000:00010000:2.0:1788521184.480952:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fef40031a00/0x411dd0ee4d2d1137 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521184.480969:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788521184.480983:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222347264:0@lo:103: 00000100:00100000:2.0:1788521184.481030:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521184.481078:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222347264 00000100:00100000:2.0:1788521184.481084:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222347264 00010000:00010000:2.0:1788521184.481114:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef40030e00/0x411dd0ee4d2d102d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1026 expref: 19 pid: 6513 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521184.481140:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788521184.481146:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6d478c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+19:3644:x1875400222347264:12345-0@lo:103: 00010000:00010000:2.0:1788521184.481157:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521184.481162:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef40030e00/0x411dd0ee4d2d102d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1026 expref: 19 pid: 6513 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.481173:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef40030e00/0x411dd0ee4d2d102d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1026 expref: 19 pid: 6513 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.481191:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef40030e00/0x411dd0ee4d2d102d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d1026 expref: 19 pid: 6513 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.481204:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521184.481240:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6d478c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:3644:x1875400222347264:12345-0@lo:103: Request processed in 94us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521184.481246:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788521184.481295:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222347264:0@lo:103: 00010000:00010000:3.0:1788521184.483507:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef821ddc00/0x411dd0ee4d2d10ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d10b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521184.483585:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788521184.485055:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222347136:0@lo:103: 00010000:00010000:3.0:1788521184.485083:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef821ddc00/0x411dd0ee4d2d10ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d10b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521184.485095:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef821ddc00/0x411dd0ee4d2d10ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d10b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521184.485149:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521184.485218:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788521184.485237:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222347008:0@lo:103: 00000100:00100000:2.0:1788521184.485261:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521184.485304:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222347136 00000100:00100000:2.0:1788521184.485313:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222347136 00010000:00010000:2.0:1788521184.485351:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef413fc800/0x411dd0ee4d2d1057 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1050 expref: 18 pid: 6513 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521184.485403:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222347008 00000100:00100000:2.0:1788521184.485407:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222347008 00010000:00010000:2.0:1788521184.485421:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d1096 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d108f expref: 19 pid: 6514 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521184.485444:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788521184.485454:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+19:3646:x1875400222347136:12345-0@lo:103: 00010000:00010000:2.0:1788521184.485470:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521184.485476:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef413fc800/0x411dd0ee4d2d1057 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1050 expref: 19 pid: 6513 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.485487:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef413fc800/0x411dd0ee4d2d1057 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1050 expref: 19 pid: 6513 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.485507:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef413fc800/0x411dd0ee4d2d1057 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d1050 expref: 19 pid: 6513 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.485526:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521184.485565:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:3646:x1875400222347136:12345-0@lo:103: Request processed in 112us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521184.485573:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788521184.485593:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788521184.485600:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:3646:x1875400222347008:12345-0@lo:103: 00010000:00010000:3.0:1788521184.485603:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521184.485606:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521184.485607:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521184.485608:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521184.485611:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d1096 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d108f expref: 17 pid: 6514 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.485619:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d1096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d108f expref: 17 pid: 6514 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.485635:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d1096 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d108f expref: 17 pid: 6514 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.485646:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521184.485669:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:3646:x1875400222347008:12345-0@lo:103: Request processed in 70us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521184.485675:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788521184.485703:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788521184.485714:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222347392:0@lo:103: 00000100:00100000:2.0:1788521184.485718:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222347008:0@lo:103: 00000100:00100000:2.0:1788521184.485728:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222347136:0@lo:103: 00000100:00100000:3.0:1788521184.485743:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521184.485758:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222347392 00000100:00100000:2.0:1788521184.485761:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222347392 00010000:00010000:2.0:1788521184.485774:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef413fca00/0x411dd0ee4d2d10b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d10ab expref: 16 pid: 6514 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521184.485800:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788521184.485806:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aa9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:3643:x1875400222347392:12345-0@lo:103: 00010000:00010000:2.0:1788521184.485814:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521184.485819:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef413fca00/0x411dd0ee4d2d10b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d10ab expref: 16 pid: 6514 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.485828:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef413fca00/0x411dd0ee4d2d10b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d10ab expref: 16 pid: 6514 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.485838:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef413fca00/0x411dd0ee4d2d10b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d10ab expref: 16 pid: 6514 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.485850:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fef40031a00/0x411dd0ee4d2d1137 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.485866:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef40031a00/0x411dd0ee4d2d1137 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.485909:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fef40031a00/0x411dd0ee4d2d1137 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.485918:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fef40031a00/0x411dd0ee4d2d1137 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.485925:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fef40031a00/0x411dd0ee4d2d1137 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.485932:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fef40031a00/0x411dd0ee4d2d1137 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.485938:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40031a00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:2.0:1788521184.485942:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fef40031a00/0x411dd0ee4d2d1137 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.485951:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fef40031a00/0x411dd0ee4d2d1137 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.485965:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fef40031a00/0x411dd0ee4d2d1137 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.485976:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521184.486006:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aa9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:3643:x1875400222347392:12345-0@lo:103: Request processed in 201us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521184.486013:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788521184.486036:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222347392:0@lo:103: 00010000:00010000:2.0:1788521184.486064:0:6513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fef40031a00/0x411dd0ee4d2d1137 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.486072:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fef40031a00/0x411dd0ee4d2d1137 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.486077:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef40031a00/0x411dd0ee4d2d1137 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788521184.486093:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788521184.488472:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:9511:x1875400222345600:12345-0@lo:253: Request processed in 66053us (66215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521184.488489:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788521184.488534:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222345600:0@lo:253: 10000000:01000000:3.0:1788521184.488552:0:9511:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788521184.488556:0:9511:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788521184.488558:0:9511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788521184.488560:0:9511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788521184.488561:0:9511:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1788521184.488563:0:9511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788521184.488564:0:9511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788521184.488566:0:9511:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788521184.488568:0:9511:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788521184.488569:0:9511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788521184.488570:0:9511:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788521184.488603:0:9511:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8fef7675d800 from lustre-OST0001 10000000:01000000:3.0:1788521184.488741:0:9511:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788521184.488745:0:9511:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788521184.488756:0:9511:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8fef4e780000 local copy 10000000:01000000:3.0:1788521184.488761:0:9511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788521184.488807:0:9511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749cba00/0x411dd0ee4d2d113e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521184.488821:0:9511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.141@tcp lock: ffff8fef749cba00/0x411dd0ee4d2d113e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521184.488846:0:9511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef749cba00/0x411dd0ee4d2d113e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521184.488870:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222347520:0@lo:101: 00000100:00100000:3.0:1788521184.488954:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521184.488990:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef7658ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788521184.489181:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222347520 00000100:00100000:0.0:1788521184.489189:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222347520 00000100:00100000:0.0:1788521184.489402:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788521184.489413:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:9511:x1875400222347520:12345-0@lo:101: 00010000:00010000:0.0:1788521184.489427:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521184.489455:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef40030200/0x411dd0ee4d2d1145 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d113e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521184.489483:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef40030200/0x411dd0ee4d2d1145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d113e expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521184.489494:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef40030200/0x411dd0ee4d2d1145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d113e expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521184.489504:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef40030200, rc 0) 00000100:00100000:0.0:1788521184.489565:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:9511:x1875400222347520:12345-0@lo:101: Request processed in 154us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521184.489571:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788521184.489760:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222347520:0@lo:101: 00010000:00010000:3.0:1788521184.489779:0:9511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef749cba00/0x411dd0ee4d2d113e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x411dd0ee4d2d1145 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521184.489793:0:9511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef749cba00/0x411dd0ee4d2d113e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x411dd0ee4d2d1145 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521184.490035:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222347648:0@lo:501: 00000100:00100000:3.0:1788521184.490071:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521184.490097:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef7658ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788521184.490166:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222347648 00000100:00100000:0.0:1788521184.490173:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222347648 00000100:00100000:0.0:1788521184.490352:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788521184.490362:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:9511:x1875400222347648:12345-0@lo:501: 00000100:00100000:0.0:1788521184.490462:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:9511:x1875400222347648:12345-0@lo:501: Request processed in 102us (390us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788521184.490470:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788521184.490530:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222347648:0@lo:501: 10000000:01000000:3.0:1788521184.490544:0:9511:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788521184.490564:0:9511:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788521184.490572:0:9511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749cba00/0x411dd0ee4d2d113e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x411dd0ee4d2d1145 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521184.490581:0:9511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749cba00/0x411dd0ee4d2d113e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x411dd0ee4d2d1145 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521184.490589:0:9511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.141@tcp lock: ffff8fef749cba00/0x411dd0ee4d2d113e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x411dd0ee4d2d1145 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521184.490622:0:9511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788521184.490659:0:9511:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8fef7675d800 10000000:01000000:3.0:1788521184.490665:0:9511:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788521184.490672:0:9511:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788521184.490675:0:9511:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788521184.490680:0:9511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788521184.490684:0:9511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788521184.490706:0:9511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749cbe00/0x411dd0ee4d2d114c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521184.490714:0:9511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef749cbe00/0x411dd0ee4d2d114c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521184.490723:0:9511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef749cbe00/0x411dd0ee4d2d114c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521184.490739:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222347776:0@lo:101: 00000100:00100000:3.0:1788521184.490768:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788521184.490819:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521184.490828:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef749cba00/0x411dd0ee4d2d113e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x411dd0ee4d2d1145 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.490835:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cba00 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:2.0:1788521184.490839:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef749cba00/0x411dd0ee4d2d113e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x411dd0ee4d2d1145 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.490847:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef749cba00/0x411dd0ee4d2d113e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x411dd0ee4d2d1145 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521184.490855:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef749cba00/0x411dd0ee4d2d113e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x411dd0ee4d2d1145 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521184.490860:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788521184.490907:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef749cba00/0x411dd0ee4d2d113e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x411dd0ee4d2d1145 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.490914:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521184.490937:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef749cba00/0x411dd0ee4d2d113e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x411dd0ee4d2d1145 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.490956:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef749cba00/0x411dd0ee4d2d113e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x411dd0ee4d2d1145 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.490971:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521184.490973:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521184.490974:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521184.490989:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222347904:0@lo:103: 00000100:00100000:2.0:1788521184.491024:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521184.491064:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222347904 00000100:00100000:2.0:1788521184.491069:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222347904 00000100:00100000:2.0:1788521184.491106:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788521184.491113:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:3645:x1875400222347904:12345-0@lo:103: 00010000:00010000:2.0:1788521184.491125:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521184.491141:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef40030200/0x411dd0ee4d2d1145 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x411dd0ee4d2d113e expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.491159:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521184.491188:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:3645:x1875400222347904:12345-0@lo:103: Request processed in 76us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521184.491195:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788521184.491246:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222347904:0@lo:103: 00000100:00100000:3.0:1788521184.491601:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef71d5b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788521184.491706:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222347776 00000100:00100000:1.0:1788521184.491715:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222347776 00000100:00100000:1.0:1788521184.491742:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788521184.491750:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+14:9511:x1875400222347776:12345-0@lo:101: 00010000:00010000:1.0:1788521184.491761:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521184.491778:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef821dd600/0x411dd0ee4d2d1153 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d114c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521184.491802:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef821dd600/0x411dd0ee4d2d1153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d114c expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521184.491813:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef821dd600/0x411dd0ee4d2d1153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d114c expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521184.491820:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef821dd600, rc 0) 00000100:00100000:1.0:1788521184.491873:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:9511:x1875400222347776:12345-0@lo:101: Request processed in 124us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521184.491879:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788521184.492019:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222347776:0@lo:101: 00010000:00010000:3.0:1788521184.492034:0:9511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef749cbe00/0x411dd0ee4d2d114c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1153 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521184.492044:0:9511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef749cbe00/0x411dd0ee4d2d114c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d1153 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521184.492140:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222348032:0@lo:501: 00000100:00100000:3.0:1788521184.492187:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521184.492328:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef71d5b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788521184.492384:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222348032 00000100:00100000:1.0:1788521184.492389:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222348032 00000100:00100000:1.0:1788521184.492409:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788521184.492416:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:9511:x1875400222348032:12345-0@lo:501: 00000100:00100000:1.0:1788521184.492563:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:9511:x1875400222348032:12345-0@lo:501: Request processed in 147us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521184.492570:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788521184.492706:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222348032:0@lo:501: 00000100:00100000:3.0:1788521184.492738:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222348160:0@lo:503: 00000100:00100000:3.0:1788521184.492781:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521184.492801:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef71d5b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788521184.492846:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222348160 00000100:00100000:1.0:1788521184.492850:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222348160 00000100:00100000:1.0:1788521184.492947:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788521184.492954:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:9511:x1875400222348160:12345-0@lo:503: 00000100:00100000:1.0:1788521184.493041:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:9511:x1875400222348160:12345-0@lo:503: Request processed in 88us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521184.493048:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788521184.493122:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222348160:0@lo:503: 00000040:00080000:3.0:1788521184.493461:0:9511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788521184.493559:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222348288:0@lo:502: 00000100:00100000:3.0:1788521184.493603:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521184.493919:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef71d5b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788521184.494073:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222348288 00000100:00100000:2.0:1788521184.494081:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222348288 00000100:00100000:2.0:1788521184.494116:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788521184.494125:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:9511:x1875400222348288:12345-0@lo:502: 00000100:00100000:2.0:1788521184.494412:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:9511:x1875400222348288:12345-0@lo:502: Request processed in 287us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521184.494426:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788521184.494537:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222348288:0@lo:502: 00000040:00080000:3.0:1788521184.494770:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788521184.494801:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788521184.494816:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788521184.494830:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788521184.494842:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788521184.494855:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788521184.494930:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222348416:0@lo:502: 00000100:00100000:3.0:1788521184.494976:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521184.495004:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef71d5b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788521184.495087:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222348416 00000100:00100000:2.0:1788521184.495093:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222348416 00000100:00100000:2.0:1788521184.495118:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788521184.495124:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:9511:x1875400222348416:12345-0@lo:502: 00000100:00100000:3.0:1788521184.495366:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222348416:0@lo:502: 00000040:00080000:3.0:1788521184.495409:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788521184.495417:0:9511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000100:00100000:2.0:1788521184.495586:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:9511:x1875400222348416:12345-0@lo:502: Request processed in 97us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521184.495595:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000020:01000000:3.0:1788521184.495942:0:9523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788521184.495952:0:9523:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788521184.495966:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521184.495969:0:9523:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788521184.495975:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788521184.496001:0:9523:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8fee426d0000) 00000020:00000080:3.0:1788521184.496028:0:9523:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788521184.496035:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788521184.496126:0:9523:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fef7675d800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788521184.496136:0:9523:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788521184.496144:0:9523:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x411dd0ee4d2d1161 00010000:00010000:3.0:1788521184.501652:0:9523:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1788521184.502403:0:9523:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788521184.505542:0:9523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788521184.506349:0:9523:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788521184.513879:0:9523:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1788521184.514176:0:9523:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1788521184.521616:0:9523:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1788521184.523184:0:9523:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788521184.523214:0:9523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521184.523231:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521184.523234:0:9523:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788521184.523239:0:9523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521184.523245:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521184.523247:0:9523:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788521184.523250:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788521184.523253:0:9523:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788521184.523292:0:9523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521184.523296:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521184.523298:0:9523:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788521184.523302:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788521184.523670:0:9511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788521184.523712:0:9511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788521184.523740:0:9511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749cbe00/0x411dd0ee4d2d114c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1153 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521184.523755:0:9511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef749cbe00/0x411dd0ee4d2d114c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1153 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521184.523764:0:9511:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fef7675d800 from 1 10000000:01000000:1.0:1788521184.523767:0:9511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788521184.523817:0:9511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef821dd200/0x411dd0ee4d2d1168 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521184.523827:0:9511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef821dd200/0x411dd0ee4d2d1168 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521184.523840:0:9511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef821dd200/0x411dd0ee4d2d1168 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521184.523922:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222348544:0@lo:101: 00000100:00100000:1.0:1788521184.524017:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521184.524068:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef767bc480 going to sleep for 11 seconds 00000100:00100000:2.0:1788521184.526123:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222348544 00000100:00100000:2.0:1788521184.526141:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222348544 00000100:00100000:2.0:1788521184.526221:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788521184.526233:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:9511:x1875400222348544:12345-0@lo:101: 00010000:00010000:2.0:1788521184.526255:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521184.526276:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef413fca00/0x411dd0ee4d2d116f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d1168 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.526310:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef413fca00/0x411dd0ee4d2d116f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1168 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.526324:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef413fca00/0x411dd0ee4d2d116f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1168 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.526334:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fca00, rc 0) 00000100:00100000:2.0:1788521184.526426:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:9511:x1875400222348544:12345-0@lo:101: Request processed in 195us (2409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521184.526433:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788521184.526670:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222348544:0@lo:101: 00010000:00010000:1.0:1788521184.526694:0:9511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef821dd200/0x411dd0ee4d2d1168 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d116f expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521184.526705:0:9511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef821dd200/0x411dd0ee4d2d1168 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d116f expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521184.526844:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222348672:0@lo:501: 00000100:00100000:1.0:1788521184.526922:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521184.526960:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef767bc480 going to sleep for 11 seconds 00000100:00100000:2.0:1788521184.538558:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222348672 00000100:00100000:2.0:1788521184.538580:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222348672 00000100:00100000:2.0:1788521184.538732:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788521184.538745:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:9511:x1875400222348672:12345-0@lo:501: 00000100:00100000:2.0:1788521184.539004:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:9511:x1875400222348672:12345-0@lo:501: Request processed in 262us (12081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521184.539012:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788521184.540489:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222348672:0@lo:501: 00000100:00100000:1.0:1788521184.540576:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222348800:0@lo:503: 00000100:00100000:1.0:1788521184.540677:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521184.540726:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef767bc480 going to sleep for 11 seconds 00000100:00100000:3.0:1788521184.540848:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222348800 00000100:00100000:3.0:1788521184.540857:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222348800 00000100:00100000:3.0:1788521184.540940:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788521184.540951:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:9511:x1875400222348800:12345-0@lo:503: 00000100:00100000:3.0:1788521184.541097:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:9511:x1875400222348800:12345-0@lo:503: Request processed in 149us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521184.541106:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788521184.541836:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222348800:0@lo:503: 00000040:00080000:1.0:1788521184.542210:0:9511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788521184.542844:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222348928:0@lo:502: 00000100:00100000:1.0:1788521184.542979:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521184.543033:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef767bc480 going to sleep for 11 seconds 00000100:00100000:2.0:1788521184.543110:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222348928 00000100:00100000:2.0:1788521184.543119:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222348928 00000100:00100000:2.0:1788521184.543173:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788521184.543183:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:9511:x1875400222348928:12345-0@lo:502: 00000100:00100000:2.0:1788521184.543483:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:9511:x1875400222348928:12345-0@lo:502: Request processed in 300us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521184.543491:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788521184.544446:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222348928:0@lo:502: 00000040:00080000:1.0:1788521184.544874:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788521184.544949:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788521184.544993:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222349056:0@lo:502: 00000100:00100000:1.0:1788521184.545070:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521184.545123:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef767bc480 going to sleep for 11 seconds 00000100:00100000:2.0:1788521184.545298:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222349056 00000100:00100000:2.0:1788521184.545308:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222349056 00000100:00100000:2.0:1788521184.545370:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788521184.545379:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:9511:x1875400222349056:12345-0@lo:502: 00000100:00100000:2.0:1788521184.545527:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:9511:x1875400222349056:12345-0@lo:502: Request processed in 148us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521184.545535:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788521184.546581:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222349056:0@lo:502: 00000040:00080000:1.0:1788521184.546757:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788521184.546773:0:9511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788521184.558456:0:9527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788521184.558475:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521184.558478:0:9527:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788521184.558486:0:9527:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fef7675d800 00000020:00000080:1.0:1788521184.558489:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788521184.558505:0:9527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788521184.558507:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521184.558509:0:9527:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788521184.558512:0:9527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788521184.558865:0:9511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788521184.558934:0:9511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788521184.558958:0:9511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef821dd200/0x411dd0ee4d2d1168 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d116f expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521184.558972:0:9511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef821dd200/0x411dd0ee4d2d1168 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d116f expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521184.559033:0:9511:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788521184.559037:0:9511:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8fef7675d800 10000000:01000000:0.0:1788521184.559041:0:9511:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8fef7675d800 10000000:01000000:0.0:1788521184.559045:0:9511:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788521184.559053:0:9511:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fef7675d800 from 1 10000000:01000000:0.0:1788521184.559055:0:9511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788521184.559123:0:9511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef40030200/0x411dd0ee4d2d1176 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521184.559133:0:9511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef40030200/0x411dd0ee4d2d1176 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521184.559145:0:9511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef40030200/0x411dd0ee4d2d1176 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521184.559173:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222349184:0@lo:101: 00000100:00100000:1.0:1788521184.561587:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521184.561759:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef816b7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788521184.561843:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222349184 00000100:00100000:2.0:1788521184.561856:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222349184 00000100:00100000:1.0:1788521184.565012:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788521184.565048:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:9511:x1875400222349184:12345-0@lo:101: 00010000:00010000:1.0:1788521184.565074:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521184.565100:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef821ddc00/0x411dd0ee4d2d117d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d1176 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521184.565139:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef821ddc00/0x411dd0ee4d2d117d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1176 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521184.565155:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef821ddc00/0x411dd0ee4d2d117d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1176 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521184.565191:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef821ddc00, rc 0) 00000100:00100000:1.0:1788521184.565322:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:9511:x1875400222349184:12345-0@lo:101: Request processed in 293us (3748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521184.565330:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788521184.565574:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222349184:0@lo:101: 00010000:00010000:2.0:1788521184.565600:0:9511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef40030200/0x411dd0ee4d2d1176 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d117d expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.565611:0:9511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef40030200/0x411dd0ee4d2d1176 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d117d expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521184.566504:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222349312:0@lo:501: 00000100:00100000:2.0:1788521184.566563:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521184.566971:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee425f13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521184.570823:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222349312 00000100:00100000:0.0:1788521184.570844:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222349312 00000100:00100000:0.0:1788521184.570941:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788521184.570955:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:9511:x1875400222349312:12345-0@lo:501: 00000100:00100000:0.0:1788521184.571195:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:9511:x1875400222349312:12345-0@lo:501: Request processed in 243us (4630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521184.571379:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222349312:0@lo:501: 00000100:00100000:2.0:1788521184.571457:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222349440:0@lo:503: 00000100:00100000:2.0:1788521184.571529:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521184.571563:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee425f13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521184.571695:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788521184.571732:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222349440 00000100:00100000:0.0:1788521184.571738:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222349440 00000100:00100000:0.0:1788521184.571758:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788521184.571766:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:9511:x1875400222349440:12345-0@lo:503: 00000100:00100000:0.0:1788521184.571946:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:9511:x1875400222349440:12345-0@lo:503: Request processed in 179us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521184.571954:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788521184.577057:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222349440:0@lo:503: 00000040:00080000:1.0:1788521184.578786:0:9511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788521184.579052:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222349568:0@lo:502: 00000100:00100000:1.0:1788521184.579174:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521184.579412:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef767bc480 going to sleep for 11 seconds 00000100:00100000:0.0:1788521184.579473:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222349568 00000100:00100000:0.0:1788521184.579482:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222349568 00000100:00100000:0.0:1788521184.579574:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788521184.579586:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:9511:x1875400222349568:12345-0@lo:502: 00000100:00100000:2.0:1788521184.580004:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222349568:0@lo:502: 00000040:00080000:2.0:1788521184.580427:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788521184.580472:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788521184.580487:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788521184.580499:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788521184.580511:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788521184.580523:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788521184.580537:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788521184.580549:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788521184.580562:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788521184.580575:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788521184.580589:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788521184.580602:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788521184.580692:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788521184.580714:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788521184.580730:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788521184.580743:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788521184.580757:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788521184.580770:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788521184.581054:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788521184.581074:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788521184.581089:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788521184.581102:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788521184.581115:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788521184.581130:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788521184.581142:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788521184.581157:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788521184.581172:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788521184.581186:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1788521184.581420:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:9511:x1875400222349568:12345-0@lo:502: Request processed in 1831us (2242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521184.581444:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000040:00080000:2.0:1788521184.581602:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788521184.581713:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788521184.581732:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788521184.581748:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788521184.581761:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788521184.581775:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788521184.581800:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788521184.581817:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788521184.581833:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1788521184.581849:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788521184.581863:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1788521184.581878:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1788521184.581928:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1788521184.581970:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1788521184.581986:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1788521184.581999:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1788521184.582010:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1788521184.582022:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1788521184.582074:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222349696:0@lo:502: 00000100:00100000:2.0:1788521184.582154:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521184.582935:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee425f13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521184.583104:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222349696 00000100:00100000:1.0:1788521184.583115:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222349696 00000100:00100000:3.0:1788521184.583233:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788521184.583247:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:9511:x1875400222349696:12345-0@lo:502: 00000100:00100000:3.0:1788521184.583431:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:9511:x1875400222349696:12345-0@lo:502: Request processed in 187us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521184.583449:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788521184.583637:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222349696:0@lo:502: 00000040:00080000:2.0:1788521184.583730:0:9511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:2.0:1788521184.583745:0:9511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1788521184.584965:0:9528:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788521184.584985:0:9528:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8fef6d7f3380) 00000020:00000080:2.0:1788521184.585017:0:9528:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1788521184.585131:0:9528:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fef7675d800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788521184.585136:0:9528:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fef7675d800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788521184.585139:0:9528:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fef7675d800 3 00010000:00080000:2.0:1788521184.585178:0:9528:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fef7a7c0800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.141@tcp at head 00010000:00010000:3.0:1788521184.588098:0:9528:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1788521184.588488:0:9528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788521184.597734:0:9528:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788521184.597774:0:9528:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x411dd0ee4d2d118b 00000100:00080000:3.0:1788521184.597808:0:9528:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788521184.597817:0:9528:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8fef7a7c0800 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:3.0:1788521184.597868:0:9528:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee41aa9180 x1875400222349824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788521184.597914:0:9528:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788521184.598758:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875400222349824:0@lo:38: 00000100:00100000:2.0:1788521184.598874:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521184.598968:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875400222349952:0@lo:400: 00000100:00100000:2.0:1788521184.598996:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521184.599018:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875400222350464:0@lo:400: 00000100:00100000:2.0:1788521184.599041:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521184.599061:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788521184.599067:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222350336:0@lo:400: 00000100:00100000:2.0:1788521184.599093:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521184.599111:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222350848:0@lo:400: 00000100:00100000:2.0:1788521184.599134:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521184.599165:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222350080:0@lo:400: 00000100:00100000:2.0:1788521184.599191:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521184.599340:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222350592:0@lo:400: 00000100:00100000:2.0:1788521184.599370:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521184.599387:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788521184.599394:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875400222350208:0@lo:400: 00000100:00100000:2.0:1788521184.599457:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521184.599473:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222350720:0@lo:400: 00000100:00100000:2.0:1788521184.599495:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521184.599535:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222349824 00000100:00100000:2.0:1788521184.599545:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222349824 00000100:00100000:2.0:1788521184.599577:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222349952 00000100:00100000:2.0:1788521184.599580:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222349952 00000100:00100000:2.0:1788521184.599605:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222350464 00000100:00100000:2.0:1788521184.599608:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222350464 00000100:00100000:2.0:1788521184.599708:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222350592 00000100:00100000:2.0:1788521184.599712:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222350592 00000100:00100000:2.0:1788521184.599726:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222350208 00000100:00100000:2.0:1788521184.599728:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222350208 00000100:00100000:2.0:1788521184.599758:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788521184.599767:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875400222349952:12345-0@lo:400: 00000100:00100000:2.0:1788521184.599829:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875400222349952:12345-0@lo:400: Request processed in 63us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521184.599836:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788521184.599854:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788521184.599860:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875400222350464:12345-0@lo:400: 00000100:00100000:2.0:1788521184.599918:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875400222350464:12345-0@lo:400: Request processed in 58us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521184.599923:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788521184.599934:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788521184.599940:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222350592:12345-0@lo:400: 00000100:00100000:2.0:1788521184.599984:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222350592:12345-0@lo:400: Request processed in 44us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521184.599990:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788521184.600009:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788521184.600015:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875400222350208:12345-0@lo:400: 00000100:00100000:2.0:1788521184.600042:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875400222350208:12345-0@lo:400: Request processed in 28us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521184.600048:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788521184.600059:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788521184.600063:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875400222349824:12345-0@lo:38: 00010000:00080000:2.0:1788521184.600089:0:6520:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:2.0:1788521184.600129:0:6520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x411dd0ee4d2d1192 00000004:00100000:2.0:1788521184.600148:0:6520:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788521184.601419:0:6520:0:(import.c:65:import_set_state_nolock()) ffff8fee4326d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788521184.601539:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875400222349824:12345-0@lo:38: Request processed in 1468us (2660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521184.601549:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788521184.601604:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222350336 00000100:00100000:2.0:1788521184.601611:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222350336 00000100:00100000:2.0:1788521184.601936:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222350080 00000100:00100000:2.0:1788521184.601941:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222350080 00000100:00100000:2.0:1788521184.601956:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788521184.601965:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222350336:12345-0@lo:400: 00000100:00100000:2.0:1788521184.602018:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222350336:12345-0@lo:400: Request processed in 53us (2923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521184.602025:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788521184.602037:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788521184.602043:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6e4bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222350080:12345-0@lo:400: 00000100:00100000:2.0:1788521184.602071:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6e4bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222350080:12345-0@lo:400: Request processed in 29us (2880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521184.602094:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788521184.602116:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222350848 00000100:00100000:2.0:1788521184.602120:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222350848 00000100:00100000:2.0:1788521184.602158:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222350720 00000100:00100000:2.0:1788521184.602162:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222350720 00000100:00100000:2.0:1788521184.602186:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788521184.602192:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222350848:12345-0@lo:400: 00000100:00100000:3.0:1788521184.602613:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788521184.602633:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4325b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222350720:12345-0@lo:400: 00000100:00100000:3.0:1788521184.602679:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4325b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222350720:12345-0@lo:400: Request processed in 52us (3183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521184.602685:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788521184.603134:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222350848:12345-0@lo:400: Request processed in 940us (3996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521184.603141:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788521184.603163:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788521184.603170:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788521184.603173:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521184.603342:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222350336:0@lo:400: 00010000:00080000:2.0:1788521184.603363:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee43255f80 x1875400222350848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521184.603375:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43255f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222350848:0@lo:400: 00010000:00080000:2.0:1788521184.603390:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee41aa9c00 x1875400222349952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521184.603398:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875400222349952:0@lo:400: 00010000:00080000:2.0:1788521184.603411:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee41aaad80 x1875400222350464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521184.603420:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875400222350464:0@lo:400: 00010000:00080000:2.0:1788521184.603484:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee41aa8700 x1875400222350208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521184.603513:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875400222350208:0@lo:400: 00010000:00080000:2.0:1788521184.603529:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee43257b80 x1875400222350720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521184.603537:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222350720:0@lo:400: 00000100:00100000:2.0:1788521184.603548:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222350080:0@lo:400: 00010000:00080000:2.0:1788521184.603559:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee41aa8380 x1875400222350592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521184.603567:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222350592:0@lo:400: 00010000:00080000:2.0:1788521184.603600:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee41aa9180 x1875400222349824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788521194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521184.603609:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000020:01000004:3.0:1788521184.603832:0:9528:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788521184.603851:0:9528:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8fee426d19c0) 00000020:00000080:3.0:1788521184.603878:0:9528:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:3.0:1788521184.604020:0:9528:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fef7675d800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788521184.604025:0:9528:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fef7675d800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788521184.604027:0:9528:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fef7675d800 3 00010000:00080000:3.0:1788521184.604063:0:9528:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fee426dc800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.141@tcp at head 00000100:00080000:2.0:1788521184.604733:0:3642:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788521184.604747:0:3642:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788521184.604754:0:3642:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788521184.604759:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef7a7c0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788521184.604770:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875400222349824:0@lo:38: 00000100:00100000:1.0:1788521184.605839:0:9530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9530:1875400222350976:0@lo:901: 00000100:00100000:1.0:1788521184.605953:0:9530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521184.606031:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222350976 00000100:00100000:1.0:1788521184.606040:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222350976 00000100:00100000:1.0:1788521184.606120:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788521184.606132:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9530:x1875400222350976:12345-0@lo:901: 00000100:00100000:1.0:1788521184.606378:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76715180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9530:x1875400222350976:12345-0@lo:901: Request processed in 247us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521184.606387:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788521184.606420:0:9530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef767bc600 going to sleep for 11 seconds 00010000:00080000:1.0:1788521184.606457:0:9530:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef76714700 x1875400222350976/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788521200 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521184.606473:0:9530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9530:1875400222350976:0@lo:901: 00000100:00080000:2.0:1788521184.607483:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788521184.608472:0:9528:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:3.0:1788521184.608714:0:9528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1788521184.608770:0:9528:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788521184.608786:0:9528:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x411dd0ee4d2d11a0 00000100:00080000:3.0:1788521184.608799:0:9528:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788521184.608806:0:9528:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8fee426dc800 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:3.0:1788521184.608850:0:9528:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee43257800 x1875400222351104/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788521184.608872:0:9528:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788521184.609264:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1875400222351104:0@lo:38: 00000100:00100000:2.0:1788521184.609354:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521184.611848:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222351104 00000100:00100000:3.0:1788521184.611875:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222351104 00000100:00100000:3.0:1788521184.611965:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788521184.611976:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4325aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875400222351104:12345-0@lo:38: 00010000:00080000:3.0:1788521184.612016:0:6520:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:3.0:1788521184.612062:0:6520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x411dd0ee4d2d11a7 00000004:00100000:3.0:1788521184.612083:0:6520:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788521184.612133:0:6520:0:(import.c:65:import_set_state_nolock()) ffff8fee426dd800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788521184.612359:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4325aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875400222351104:12345-0@lo:38: Request processed in 383us (3004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521184.612367:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:3.0:1788521184.612523:0:9528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:3.0:1788521184.612592:0:9511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1788521184.612707:0:9511:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788521184.612728:0:9511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef40030200/0x411dd0ee4d2d1176 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d117d expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521184.612741:0:9511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef40030200/0x411dd0ee4d2d1176 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d117d expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788521184.612817:0:9511:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788521184.612820:0:9511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788521184.612821:0:9511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788521184.612823:0:9511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788521184.612824:0:9511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788521184.612825:0:9511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788521184.612827:0:9511:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788521184.612829:0:9511:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788521184.612831:0:9511:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788521184.612833:0:9511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788521184.612834:0:9511:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788521184.612839:0:9511:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788521184.612842:0:9511:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788521184.612848:0:9511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788521184.612849:0:9511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788521184.612850:0:9511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788521184.612851:0:9511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788521184.612851:0:9511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788521184.612853:0:9511:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788521184.612853:0:9511:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788521184.612854:0:9511:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788521184.612855:0:9511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788521184.612856:0:9511:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788521184.612908:0:9511:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788521184.612929:0:9511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43256a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222351232:0@lo:253: 00000100:00100000:3.0:1788521184.612987:0:9511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521184.613026:0:9511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4853ccc0 going to sleep for 11 seconds 00010000:00080000:2.0:1788521184.613383:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee43257800 x1875400222351104/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788521194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521184.613396:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788521184.613406:0:3642:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788521184.613422:0:3642:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788521184.613427:0:3642:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788521184.613431:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fee426dc800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788521184.613449:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1875400222351104:0@lo:38: 00000100:00100000:0.0:1788521184.614415:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222351232 00000100:00100000:0.0:1788521184.614428:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222351232 00000100:00100000:0.0:1788521184.614505:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788521184.614516:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:9511:x1875400222351232:12345-0@lo:253: 20000000:01000000:0.0:1788521184.614556:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788521184.614574:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788521184.625512:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788521184.625542:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788521184.625704:0:6535:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788521184.625711:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788521184.625739:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d11ae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.625762:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d10a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d109d expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.625769:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef40030c00/0x411dd0ee4d2d10ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d10e3 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.625777:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d11ae lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.625827:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef40030c00/0x411dd0ee4d2d10ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d10e3 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.625846:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef40030c00/0x411dd0ee4d2d10ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d10e3 expref: 17 pid: 6512 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521184.625861:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43259c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1875400222351360:0@lo:104: 00000100:00100000:2.0:1788521184.625981:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788521184.626041:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d10a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d109d expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.626049:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d10a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d109d expref: 17 pid: 6512 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521184.626077:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43258e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1875400222351488:0@lo:104: 00000100:00100000:2.0:1788521184.626100:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521184.626119:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee425f1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788521184.626145:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222351360 00000100:00100000:2.0:1788521184.626153:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222351360 00000100:00100000:2.0:1788521184.626218:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222351488 00000100:00100000:2.0:1788521184.626221:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222351488 00000100:00100000:3.0:1788521184.626332:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788521184.626353:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43259880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:6535:x1875400222351360:12345-0@lo:104: 00010000:00010000:3.0:1788521184.626370:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef749caa00/0x411dd0ee4d2d10e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d10ea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521184.626445:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788521184.626452:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43259880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:6535:x1875400222351360:12345-0@lo:104: Request processed in 110us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521184.626459:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788521184.626533:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788521184.626541:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4325b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:6535:x1875400222351488:12345-0@lo:104: 00010000:00010000:2.0:1788521184.626550:0:9522:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef749ca200/0x411dd0ee4d2d109d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d10a4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.626588:0:9522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788521184.626593:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4325b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:6535:x1875400222351488:12345-0@lo:104: Request processed in 53us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521184.626599:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1788521184.626728:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788521184.626736:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef749caa00/0x411dd0ee4d2d10e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d10ea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.626744:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749caa00 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:2.0:1788521184.626749:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef749caa00/0x411dd0ee4d2d10e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d10ea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.626758:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef749caa00/0x411dd0ee4d2d10e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d10ea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521184.626766:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef749caa00/0x411dd0ee4d2d10e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d10ea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521184.626783:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788521184.626824:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef749caa00/0x411dd0ee4d2d10e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d10ea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.626832:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521184.626851:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef749caa00/0x411dd0ee4d2d10e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d10ea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.626858:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef749caa00/0x411dd0ee4d2d10e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d10ea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.626874:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521184.626878:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef749ca200/0x411dd0ee4d2d109d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d10a4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.626910:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749ca200 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:2.0:1788521184.626913:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef749ca200/0x411dd0ee4d2d109d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d10a4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.626919:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef749ca200/0x411dd0ee4d2d109d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d10a4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521184.626924:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef749ca200/0x411dd0ee4d2d109d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d10a4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521184.626929:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788521184.626944:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef749ca200/0x411dd0ee4d2d109d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d10a4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.626949:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521184.626973:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef749ca200/0x411dd0ee4d2d109d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d10a4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.626979:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef749ca200/0x411dd0ee4d2d109d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d10a4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.626992:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521184.626994:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521184.626996:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521184.627003:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521184.627017:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222351616:0@lo:103: 00000100:00100000:2.0:1788521184.627053:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521184.627102:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222351744:0@lo:103: 00000100:00100000:2.0:1788521184.627126:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521184.627159:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222351616 00000100:00100000:2.0:1788521184.627164:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222351616 00010000:00010000:2.0:1788521184.627184:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef40030c00/0x411dd0ee4d2d10ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d10e3 expref: 18 pid: 6512 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521184.627204:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222351744 00000100:00100000:2.0:1788521184.627207:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222351744 00010000:00010000:2.0:1788521184.627219:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d10a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d109d expref: 19 pid: 6512 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521184.627351:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788521184.627359:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43259180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+19:3646:x1875400222351616:12345-0@lo:103: 00010000:00010000:2.0:1788521184.627370:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521184.627376:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef40030c00/0x411dd0ee4d2d10ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d10e3 expref: 19 pid: 6512 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.627399:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef40030c00/0x411dd0ee4d2d10ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d10e3 expref: 19 pid: 6512 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.627417:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521184.627500:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43259180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+19:3646:x1875400222351616:12345-0@lo:103: Request processed in 143us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521184.627507:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788521184.627521:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788521184.627527:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4325b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:3643:x1875400222351744:12345-0@lo:103: 00010000:00010000:2.0:1788521184.627534:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521184.627539:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d10a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d109d expref: 18 pid: 6512 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.627547:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d10a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d109d expref: 18 pid: 6512 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.627560:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d11ae lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.627570:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d11ae lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788521184.627584:0:6504:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010206398s 00010000:00010000:2.0:1788521184.627588:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d11ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.627596:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d11ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.627602:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d11ae lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.627680:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d11ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.627688:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef413fde00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:2.0:1788521184.627693:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d11ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.627702:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d11ae lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.627710:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d11ae lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.627722:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521184.627751:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4325b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:3643:x1875400222351744:12345-0@lo:103: Request processed in 225us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521184.627758:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788521184.627805:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222351744:0@lo:103: 00010000:00010000:2.0:1788521184.627838:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef40030c00/0x411dd0ee4d2d10ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d10e3 expref: 17 pid: 6512 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521184.627850:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43259c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1875400222351360:0@lo:104: 00010000:00010000:2.0:1788521184.627860:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d10a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d109d expref: 16 pid: 6512 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521184.627869:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43258e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1875400222351488:0@lo:104: 00010000:00010000:2.0:1788521184.627905:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d11ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.627925:0:6535:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d11ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.627932:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d11ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521184.627938:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d11ae lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521184.628446:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:9511:x1875400222351232:12345-0@lo:253: Request processed in 13921us (15448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521184.628456:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788521184.628544:0:9511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43256a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9511:1875400222351232:0@lo:253: 10000000:01000000:2.0:1788521184.628555:0:9511:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788521184.628559:0:9511:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788521184.628561:0:9511:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788521184.628562:0:9511:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521184.628563:0:9511:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521184.628564:0:9511:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521184.628566:0:9511:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521184.628568:0:9511:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788521184.628569:0:9511:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788521184.628571:0:9511:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788521184.628572:0:9511:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521184.628574:0:9511:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788521184.628586:0:9511:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788521184.629431:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222351616:0@lo:103: 00080000:10000000:2.0:1788521184.639791:0:9511:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788521184.640060:0:9511:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788521184.641802:0:9511:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788521184.642065:0:9511:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788521184.643829:0:9511:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788521184.644569:0:9511:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1788521184.645816:0:9511:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788521184.658064:0:9511:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788521184.658092:0:9511:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788521184.658138:0:9511:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788521184.658193:0:9511:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.141@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788521184.658320:0:9511:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788521184.658344:0:9511:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788521184.661503:0:9511:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788521184.663524:0:9511:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:0.0:1788521184.914034:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222351872:0@lo:13: 00000100:00100000:0.0:1788521184.914121:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521184.914228:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222351872 00000100:00100000:0.0:1788521184.914237:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222351872 00000100:00100000:0.0:1788521184.914297:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788521184.914308:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222351872:12345-0@lo:13: 00002000:00000024:0.0:1788521184.914344:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521184.914395:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222351872:12345-0@lo:13: Request processed in 87us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521184.914401:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788521184.914475:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee4244d500 x1875400222351872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521200 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521184.914496:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222351872:0@lo:13: 00000100:00100000:0.0:1788521184.922254:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222352000:0@lo:13: 00000100:00100000:0.0:1788521184.922350:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521184.922470:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222352000 00000100:00100000:1.0:1788521184.922482:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222352000 00000100:00100000:1.0:1788521184.922558:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788521184.922580:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222352000:12345-0@lo:13: 00002000:00000024:1.0:1788521184.922615:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521184.922671:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222352000:12345-0@lo:13: Request processed in 94us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521184.922678:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788521184.927597:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef76714700 x1875400222352000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521200 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521184.927636:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222352000:0@lo:13: 00010000:00010000:2.0:1788521185.487550:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788521185.790174:0:9584:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788521185.790489:0:9584:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788521186.509397:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521187.475109:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222352128:0@lo:41: 00000100:00100000:3.0:1788521187.475201:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521187.475329:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222352128 00000100:00100000:1.0:1788521187.475339:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222352128 00000100:00100000:1.0:1788521187.475399:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788521187.475411:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222352128:12345-0@lo:41: 00000004:00000024:1.0:1788521187.475463:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1788521187.475520:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222352128:12345-0@lo:41: Request processed in 111us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521187.475527:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788521187.475618:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222352128:0@lo:41: 00010000:00010000:3.0:1788521187.537269:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521187.981142:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222352256:0@lo:41: 00000100:00100000:0.0:1788521187.981316:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521187.981641:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222352256 00000100:00100000:1.0:1788521187.981652:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222352256 00000100:00100000:1.0:1788521187.981720:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788521187.981731:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222352256:12345-0@lo:41: 00000004:00000024:1.0:1788521187.981777:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788521187.981843:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222352256:12345-0@lo:41: Request processed in 114us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521187.981850:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788521187.982084:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222352256:0@lo:41: 00010000:00010000:3.0:1788521188.559765:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521189.582416:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521190.029035:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222352384:0@lo:13: 00000100:00100000:3.0:1788521190.029086:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222352640:0@lo:400: 00000100:00100000:1.0:1788521190.029103:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521190.029122:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521190.029160:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222353152:0@lo:400: 00000100:00100000:1.0:1788521190.029160:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222352512:0@lo:13: 00000100:00100000:1.0:1788521190.029182:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521190.029183:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521190.029197:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222353664:0@lo:400: 00000100:00100000:1.0:1788521190.029205:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222353024:0@lo:400: 00000100:00100000:3.0:1788521190.029218:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521190.029234:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788521190.029239:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222352768:0@lo:400: 00000100:00100000:1.0:1788521190.029240:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521190.029271:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222352640 00000100:00100000:3.0:1788521190.029278:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222352640 00000100:00100000:1.0:1788521190.029278:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222353536:0@lo:400: 00000100:00100000:1.0:1788521190.029297:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521190.029313:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788521190.029318:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222352896:0@lo:400: 00000100:00100000:3.0:1788521190.029329:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788521190.029337:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521190.029338:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:3645:x1875400222352640:12345-0@lo:400: 00000100:00100000:1.0:1788521190.029350:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875400222353408:0@lo:400: 00000100:00100000:1.0:1788521190.029368:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521190.029381:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:3645:x1875400222352640:12345-0@lo:400: Request processed in 44us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521190.029381:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875400222353920:0@lo:400: 00000100:00100000:3.0:1788521190.029388:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788521190.029417:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521190.029431:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222353152 00000100:00100000:3.0:1788521190.029435:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222353152 00000100:00100000:1.0:1788521190.029445:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222352384 00000100:00100000:1.0:1788521190.029448:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222352384 00000100:00100000:3.0:1788521190.029453:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222352896 00000100:00100000:3.0:1788521190.029455:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222352896 00000100:00100000:3.0:1788521190.029467:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788521190.029473:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222353152:12345-0@lo:400: 00000100:00100000:1.0:1788521190.029474:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222352512 00000100:00100000:1.0:1788521190.029477:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222352512 00000100:00100000:1.0:1788521190.029490:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788521190.029495:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222352384:12345-0@lo:13: 00000100:00100000:3.0:1788521190.029506:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222353152:12345-0@lo:400: Request processed in 34us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521190.029512:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788521190.029522:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00002000:00000024:1.0:1788521190.029526:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788521190.029535:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222352896:12345-0@lo:400: 00000100:00100000:3.0:1788521190.029562:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222352896:12345-0@lo:400: Request processed in 27us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521190.029562:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222352384:12345-0@lo:13: Request processed in 66us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521190.029569:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788521190.029569:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788521190.029582:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788521190.029588:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222353664 00000100:00100000:1.0:1788521190.029588:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222352512:12345-0@lo:13: 00000100:00100000:3.0:1788521190.029591:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222353664 00002000:00000024:1.0:1788521190.029598:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788521190.029611:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222353536 00000100:00100000:3.0:1788521190.029614:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222353536 00000100:00100000:1.0:1788521190.029621:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875400222352512:12345-0@lo:13: Request processed in 34us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521190.029631:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788521190.029638:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222353664:12345-0@lo:400: 00000100:00100000:1.0:1788521190.029638:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788521190.029665:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222353664:12345-0@lo:400: Request processed in 28us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521190.029665:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222353024 00000100:00100000:1.0:1788521190.029668:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222353024 00000100:00100000:3.0:1788521190.029671:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788521190.029680:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788521190.029684:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222353408 00000100:00100000:3.0:1788521190.029686:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222353536:12345-0@lo:400: 00000100:00100000:1.0:1788521190.029686:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222353408 00000100:00100000:1.0:1788521190.029698:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222353920 00000100:00100000:1.0:1788521190.029700:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222353920 00000100:00100000:3.0:1788521190.029709:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222353536:12345-0@lo:400: Request processed in 25us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521190.029714:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788521190.029731:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788521190.029739:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222353024:12345-0@lo:400: 00000100:00100000:3.0:1788521190.029765:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222353024:12345-0@lo:400: Request processed in 28us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521190.029771:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788521190.029784:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788521190.029791:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875400222353408:12345-0@lo:400: 00000100:00100000:3.0:1788521190.029815:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875400222353408:12345-0@lo:400: Request processed in 25us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521190.029825:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788521190.029850:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788521190.029858:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875400222353920:12345-0@lo:400: 00000100:00100000:3.0:1788521190.029909:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875400222353920:12345-0@lo:400: Request processed in 53us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521190.029917:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788521190.029939:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521190.029958:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875400222353280:0@lo:400: 00000100:00100000:3.0:1788521190.029984:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521190.029994:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875400222353792:0@lo:400: 00000100:00100000:3.0:1788521190.030015:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521190.030036:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222352640:0@lo:400: 00000100:00100000:3.0:1788521190.030047:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222353152:0@lo:400: 00010000:00080000:3.0:1788521190.030057:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43256300 x1875400222353664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521190.030065:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222353664:0@lo:400: 00000100:00100000:3.0:1788521190.030088:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222352768 00000100:00100000:3.0:1788521190.030091:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222352768 00000100:00100000:3.0:1788521190.030107:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222353280 00000100:00100000:3.0:1788521190.030109:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222353280 00000100:00100000:1.0:1788521190.030113:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222353792 00000100:00100000:1.0:1788521190.030115:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222353792 00000100:00100000:3.0:1788521190.030121:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788521190.030127:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222352768:12345-0@lo:400: 00000100:00100000:1.0:1788521190.030130:0:6519:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788521190.030137:0:6519:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788521190.030157:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222352768:12345-0@lo:400: Request processed in 31us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521190.030163:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788521190.030169:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788521190.030176:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788521190.030180:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788521190.030182:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875400222353280:12345-0@lo:400: 00000100:00100000:3.0:1788521190.030185:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875400222353792:12345-0@lo:400: 00000100:00100000:3.0:1788521190.030210:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875400222353792:12345-0@lo:400: Request processed in 25us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521190.030210:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875400222353280:12345-0@lo:400: Request processed in 29us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521190.030216:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788521190.030350:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43254000 x1875400222352768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521190.030359:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222352768:0@lo:400: 00010000:00080000:3.0:1788521190.030369:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43255500 x1875400222353280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521190.030376:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43255500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875400222353280:0@lo:400: 00010000:00080000:3.0:1788521190.030384:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43254700 x1875400222353792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521190.030390:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875400222353792:0@lo:400: 00000100:00100000:1.0:1788521190.030618:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1788521190.030703:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788521190.030707:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788521190.030710:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521190.030826:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43254a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222352896:0@lo:400: 00010000:00080000:1.0:1788521190.030838:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43256d80 x1875400222353408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521190.030848:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875400222353408:0@lo:400: 00010000:00080000:1.0:1788521190.030858:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43256680 x1875400222353920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521190.030866:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875400222353920:0@lo:400: 00010000:00080000:1.0:1788521190.030876:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43255180 x1875400222353024/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521190.030914:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222353024:0@lo:400: 00010000:00080000:1.0:1788521190.030930:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43254380 x1875400222353536/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521190.030938:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222353536:0@lo:400: 00010000:00080000:1.0:1788521190.030948:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef76714e00 x1875400222352384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521206 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521190.030963:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222352384:0@lo:13: 00010000:00080000:1.0:1788521190.030973:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43254e00 x1875400222352512/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521206 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521190.030983:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222352512:0@lo:13: 00010000:00010000:2.0:1788521190.606990:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788521191.058088:0:9875:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg341-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788521191.630169:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788521192.038507:0:9927:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788521192.038807:0:9927:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1788521192.589992:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788521192.590005:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fef76680800 from 39 10000000:01000000:3.0:1788521192.590013:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788521192.590079:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749cbc00/0x411dd0ee4d2d11b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521192.590093:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef749cbc00/0x411dd0ee4d2d11b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521192.590106:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef749cbc00/0x411dd0ee4d2d11b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521192.590137:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43254700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222354048:0@lo:101: 00000100:00100000:3.0:1788521192.590321:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521192.590399:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef606e3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788521192.590569:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222354048 00000100:00100000:2.0:1788521192.590579:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222354048 00000100:00100000:2.0:1788521192.590645:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788521192.590666:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:6517:x1875400222354048:12345-0@lo:101: 00010000:00010000:2.0:1788521192.590683:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521192.590701:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d11bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d11b5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521192.590733:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d11bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d11b5 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521192.590747:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d11bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d11b5 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521192.590759:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fde00, rc 0) 00000100:00100000:2.0:1788521192.590811:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:6517:x1875400222354048:12345-0@lo:101: Request processed in 147us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521192.590818:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788521192.590872:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43254700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222354048:0@lo:101: 00010000:00010000:2.0:1788521192.590917:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef749cbc00/0x411dd0ee4d2d11b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d11bc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521192.590937:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef749cbc00/0x411dd0ee4d2d11b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d11bc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521192.591008:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43258e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222354176:0@lo:501: 00000100:00100000:2.0:1788521192.591036:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521192.591057:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4853cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788521192.591072:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222354176 00000100:00100000:2.0:1788521192.591076:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222354176 00000100:00100000:2.0:1788521192.591101:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788521192.591109:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:6517:x1875400222354176:12345-0@lo:501: 00000100:00100000:1.0:1788521192.591431:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222354304:0@lo:41: 00000100:00100000:1.0:1788521192.591473:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521192.591522:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222354304 00000100:00100000:1.0:1788521192.591526:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222354304 00000100:00100000:1.0:1788521192.591558:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788521192.591564:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef81498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222354304:12345-0@lo:41: 00000004:00000024:1.0:1788521192.591597:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1788521192.591637:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef81498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222354304:12345-0@lo:41: Request processed in 73us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521192.591655:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788521192.591700:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222354304:0@lo:41: 00000100:00100000:2.0:1788521192.591943:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:6517:x1875400222354176:12345-0@lo:501: Request processed in 833us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521192.591951:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788521192.592337:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43258e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222354176:0@lo:501: 00000100:00100000:1.0:1788521192.592406:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef8149a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222354432:0@lo:503: 00000100:00100000:1.0:1788521192.592456:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521192.592490:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee423c0000 going to sleep for 11 seconds 00000100:00100000:2.0:1788521192.592537:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222354432 00000100:00100000:2.0:1788521192.592544:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222354432 00000100:00100000:2.0:1788521192.592749:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788521192.592759:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:6517:x1875400222354432:12345-0@lo:503: 00000100:00100000:2.0:1788521192.592876:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:6517:x1875400222354432:12345-0@lo:503: Request processed in 119us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521192.592950:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef8149a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222354432:0@lo:503: 00000100:00100000:1.0:1788521192.593203:0:9957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef8149a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9957:1875400222354560:0@lo:502: 00000100:00100000:1.0:1788521192.593245:0:9957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521192.593269:0:9957:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee423c0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521192.596983:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222354560 00000100:00100000:3.0:1788521192.597004:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222354560 00000100:00100000:3.0:1788521192.597070:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788521192.597084:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:9957:x1875400222354560:12345-0@lo:502: 00000100:00100000:3.0:1788521192.597350:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:9957:x1875400222354560:12345-0@lo:502: Request processed in 268us (4102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521192.597358:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788521192.597608:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788521192.597936:0:9957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef8149a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9957:1875400222354560:0@lo:502: 00000100:00100000:0.0:1788521192.598026:0:9957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9957:1875400222354688:0@lo:502: 00000100:00100000:0.0:1788521192.598079:0:9957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521192.598112:0:9957:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521192.598209:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222354688 00000100:00100000:3.0:1788521192.598215:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222354688 00000100:00100000:3.0:1788521192.598261:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788521192.598270:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:9957:x1875400222354688:12345-0@lo:502: 00000100:00100000:3.0:1788521192.598374:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:9957:x1875400222354688:12345-0@lo:502: Request processed in 106us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521192.598390:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788521192.598776:0:9957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9957:1875400222354688:0@lo:502: 00000040:00080000:2.0:1788521192.598807:0:9957:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788521192.599029:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788521192.599055:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788521192.599068:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749cbc00/0x411dd0ee4d2d11b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d11bc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521192.599080:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef749cbc00/0x411dd0ee4d2d11b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d11bc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521192.599090:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788521192.599093:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788521192.599096:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788521192.599131:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d11c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521192.599162:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d11c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521192.599179:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d11c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521192.599197:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222354816:0@lo:101: 00000100:00100000:0.0:1788521192.599245:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521192.599277:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788521192.599374:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222354816 00000100:00100000:2.0:1788521192.599389:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222354816 00000100:00100000:2.0:1788521192.599422:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788521192.599432:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:6517:x1875400222354816:12345-0@lo:101: 00010000:00010000:2.0:1788521192.599450:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521192.599465:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d11ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d11c3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521192.599493:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d11ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d11c3 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521192.599505:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d11ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d11c3 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521192.599514:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fc600, rc 0) 00000100:00100000:2.0:1788521192.599556:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:6517:x1875400222354816:12345-0@lo:101: Request processed in 126us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521192.599640:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788521192.599847:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222354816:0@lo:101: 00010000:00010000:0.0:1788521192.599863:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d11c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d11ca expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521192.599873:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d11c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d11ca expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521192.599973:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222354944:0@lo:501: 00000100:00100000:0.0:1788521192.600003:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521192.600024:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788521192.600089:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222354944 00000100:00100000:2.0:1788521192.600094:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222354944 00000100:00100000:2.0:1788521192.600131:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788521192.600146:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:6517:x1875400222354944:12345-0@lo:501: 00000100:00100000:2.0:1788521192.600415:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:6517:x1875400222354944:12345-0@lo:501: Request processed in 277us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521192.600422:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788521192.600453:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222354944:0@lo:501: 00000100:00100000:2.0:1788521192.600483:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43259c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222355072:0@lo:503: 00000100:00100000:2.0:1788521192.600526:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521192.600549:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4853c000 going to sleep for 11 seconds 00000100:00100000:3.0:1788521192.600743:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222355072 00000100:00100000:3.0:1788521192.600748:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222355072 00000100:00100000:3.0:1788521192.600777:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788521192.600784:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:6517:x1875400222355072:12345-0@lo:503: 00000100:00100000:3.0:1788521192.600878:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:6517:x1875400222355072:12345-0@lo:503: Request processed in 95us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521192.600916:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788521192.601069:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43259c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222355072:0@lo:503: 00000100:00100000:0.0:1788521192.605326:0:9958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9958:1875400222355200:0@lo:502: 00000100:00100000:0.0:1788521192.605445:0:9958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521192.605499:0:9958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521192.605637:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222355200 00000100:00100000:3.0:1788521192.605716:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222355200 00000100:00100000:3.0:1788521192.605823:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788521192.605837:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:9958:x1875400222355200:12345-0@lo:502: 00000100:00100000:3.0:1788521192.606047:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:9958:x1875400222355200:12345-0@lo:502: Request processed in 213us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521192.606056:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788521192.606679:0:9958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9958:1875400222355200:0@lo:502: 00000020:01000000:2.0:1788521192.606729:0:9958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521192.606741:0:9958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521192.606744:0:9958:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788521192.606750:0:9958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788521192.606752:0:9958:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788521192.606789:0:9958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43259c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9958:1875400222355328:0@lo:502: 00000100:00100000:2.0:1788521192.606839:0:9958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521192.607441:0:9958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4853c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788521192.607514:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222355328 00000100:00100000:0.0:1788521192.607522:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222355328 00000100:00100000:0.0:1788521192.607578:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788521192.607588:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:9958:x1875400222355328:12345-0@lo:502: 00000100:00100000:0.0:1788521192.607755:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:9958:x1875400222355328:12345-0@lo:502: Request processed in 167us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521192.607763:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788521192.608416:0:9958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43259c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9958:1875400222355328:0@lo:502: 00000020:01000000:2.0:1788521192.608452:0:9958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521192.608461:0:9958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521192.608464:0:9958:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788521192.608468:0:9958:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788521192.608764:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1788521192.608793:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788521192.608805:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d11c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d11ca expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521192.608817:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d11c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d11ca expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521192.608829:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788521192.608832:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fef81580000 from 39 10000000:01000000:0.0:1788521192.608836:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788521192.608879:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef40030e00/0x411dd0ee4d2d11d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521192.608915:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef40030e00/0x411dd0ee4d2d11d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521192.608926:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef40030e00/0x411dd0ee4d2d11d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521192.608948:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222355456:0@lo:101: 00000100:00100000:0.0:1788521192.609004:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521192.609045:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788521192.609111:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222355456 00000100:00100000:2.0:1788521192.609118:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222355456 00000100:00100000:2.0:1788521192.609284:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788521192.609295:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:6517:x1875400222355456:12345-0@lo:101: 00010000:00010000:2.0:1788521192.609309:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521192.609324:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef413fc800/0x411dd0ee4d2d11d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d11d1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521192.609352:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef413fc800/0x411dd0ee4d2d11d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d11d1 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521192.609364:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef413fc800/0x411dd0ee4d2d11d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d11d1 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521192.609374:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fc800, rc 0) 00000100:00100000:2.0:1788521192.609437:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:6517:x1875400222355456:12345-0@lo:101: Request processed in 145us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521192.609457:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788521192.609538:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222355456:0@lo:101: 00010000:00010000:0.0:1788521192.609554:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef40030e00/0x411dd0ee4d2d11d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d11d8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521192.609644:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef40030e00/0x411dd0ee4d2d11d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d11d8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521192.609786:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222355584:0@lo:501: 00000100:00100000:0.0:1788521192.609816:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521192.609843:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788521192.609959:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222355584 00000100:00100000:2.0:1788521192.609964:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222355584 00000100:00100000:2.0:1788521192.609988:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788521192.609995:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:6517:x1875400222355584:12345-0@lo:501: 00000100:00100000:2.0:1788521192.610135:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:6517:x1875400222355584:12345-0@lo:501: Request processed in 140us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521192.610141:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788521192.610351:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222355584:0@lo:501: 00000100:00100000:0.0:1788521192.610395:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222355712:0@lo:503: 00000100:00100000:0.0:1788521192.610440:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521192.610465:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788521192.610505:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222355712 00000100:00100000:2.0:1788521192.610509:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222355712 00000100:00100000:2.0:1788521192.610528:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788521192.610534:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:6517:x1875400222355712:12345-0@lo:503: 00000100:00100000:2.0:1788521192.610630:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:6517:x1875400222355712:12345-0@lo:503: Request processed in 96us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521192.610637:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788521192.610796:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222355712:0@lo:503: 00000100:00100000:0.0:1788521192.613418:0:9959:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9959:1875400222355840:0@lo:502: 00000100:00100000:0.0:1788521192.613540:0:9959:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521192.613614:0:9959:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5af00 going to sleep for 11 seconds 00000100:00100000:3.0:1788521192.613800:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222355840 00000100:00100000:3.0:1788521192.613810:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222355840 00000100:00100000:3.0:1788521192.613874:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788521192.613931:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:9959:x1875400222355840:12345-0@lo:502: 00000100:00100000:3.0:1788521192.614086:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:9959:x1875400222355840:12345-0@lo:502: Request processed in 201us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521192.614093:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788521192.615013:0:9959:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9959:1875400222355840:0@lo:502: 00000100:00100000:0.0:1788521192.615100:0:9959:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9959:1875400222355968:0@lo:502: 00000100:00100000:0.0:1788521192.615165:0:9959:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521192.615306:0:9959:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788521192.615553:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222355968 00000100:00100000:2.0:1788521192.615632:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222355968 00000100:00100000:2.0:1788521192.615755:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788521192.615767:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:9959:x1875400222355968:12345-0@lo:502: 00000100:00100000:2.0:1788521192.615932:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:9959:x1875400222355968:12345-0@lo:502: Request processed in 166us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521192.615940:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788521192.616061:0:9959:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9959:1875400222355968:0@lo:502: 00000040:00080000:3.0:1788521192.616095:0:9959:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788521192.616250:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788521192.616272:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788521192.616283:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef40030e00/0x411dd0ee4d2d11d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d11d8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521192.616296:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef40030e00/0x411dd0ee4d2d11d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d11d8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521192.616307:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788521192.616310:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fef81580000 from 6 10000000:01000000:3.0:1788521192.616314:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788521192.616353:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749ca800/0x411dd0ee4d2d11df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521192.616360:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef749ca800/0x411dd0ee4d2d11df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521192.616392:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef749ca800/0x411dd0ee4d2d11df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521192.616411:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43255500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222356096:0@lo:101: 00000100:00100000:3.0:1788521192.616450:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521192.616477:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef606e3180 going to sleep for 11 seconds 00000100:00100000:0.0:1788521192.616842:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222356096 00000100:00100000:0.0:1788521192.616851:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222356096 00000100:00100000:0.0:1788521192.616907:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788521192.616919:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:6517:x1875400222356096:12345-0@lo:101: 00010000:00010000:0.0:1788521192.616933:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521192.616952:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef40030600/0x411dd0ee4d2d11e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d11df expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521192.616987:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef40030600/0x411dd0ee4d2d11e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d11df expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521192.616998:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef40030600/0x411dd0ee4d2d11e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d11df expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521192.617008:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef40030600, rc 0) 00000100:00100000:0.0:1788521192.617053:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+19:6517:x1875400222356096:12345-0@lo:101: Request processed in 138us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521192.617059:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788521192.617090:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43255500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222356096:0@lo:101: 00010000:00010000:0.0:1788521192.617105:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef749ca800/0x411dd0ee4d2d11df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d11e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521192.617115:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef749ca800/0x411dd0ee4d2d11df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d11e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521192.617432:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222356224:0@lo:256: 00000100:00100000:0.0:1788521192.617472:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521192.617534:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521192.617555:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222356224 00000100:00100000:0.0:1788521192.617568:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222356224 00000100:00100000:1.0:1788521192.617676:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788521192.617686:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+19:6517:x1875400222356224:12345-0@lo:256: 20000000:01000000:1.0:1788521192.617704:0:6512:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788521192.617726:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788521192.617729:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788521192.617827:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+19:6517:x1875400222356224:12345-0@lo:256: Request processed in 142us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521192.617833:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788521192.617907:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222356224:0@lo:256: 10000000:01000000:3.0:1788521192.617963:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788521192.617973:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749ca800/0x411dd0ee4d2d11df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d11e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521192.617981:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef749ca800/0x411dd0ee4d2d11df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d11e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521192.617991:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788521192.617994:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1788521192.617997:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788521192.618021:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749ca200/0x411dd0ee4d2d11ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521192.618029:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef749ca200/0x411dd0ee4d2d11ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521192.618037:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef749ca200/0x411dd0ee4d2d11ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521192.618051:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222356352:0@lo:101: 00000100:00100000:3.0:1788521192.618078:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521192.618637:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef606e3840 going to sleep for 11 seconds 00000100:00100000:2.0:1788521192.618739:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222356352 00000100:00100000:2.0:1788521192.618745:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222356352 00000100:00100000:2.0:1788521192.618778:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788521192.618785:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+19:6517:x1875400222356352:12345-0@lo:101: 00010000:00010000:2.0:1788521192.618806:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521192.618821:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef413fda00/0x411dd0ee4d2d11f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d11ed expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521192.618848:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef413fda00/0x411dd0ee4d2d11f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d11ed expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521192.618861:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef413fda00/0x411dd0ee4d2d11f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d11ed expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521192.618870:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fda00, rc 0) 00000100:00100000:2.0:1788521192.618959:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:6517:x1875400222356352:12345-0@lo:101: Request processed in 174us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521192.618965:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788521192.619068:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222356352:0@lo:101: 00010000:00010000:3.0:1788521192.619084:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef749ca200/0x411dd0ee4d2d11ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d11f4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521192.619093:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef749ca200/0x411dd0ee4d2d11ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d11f4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521192.619288:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222356480:0@lo:501: 00000100:00100000:3.0:1788521192.619320:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521192.619351:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef606e3840 going to sleep for 11 seconds 00000100:00100000:2.0:1788521192.619424:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222356480 00000100:00100000:2.0:1788521192.619429:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222356480 00000100:00100000:2.0:1788521192.619450:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788521192.619456:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:6517:x1875400222356480:12345-0@lo:501: 00000100:00100000:2.0:1788521192.619749:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:6517:x1875400222356480:12345-0@lo:501: Request processed in 292us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521192.619756:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788521192.619819:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222356480:0@lo:501: 00000100:00100000:3.0:1788521192.619851:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222356608:0@lo:503: 00000100:00100000:3.0:1788521192.619926:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521192.619942:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef606e3840 going to sleep for 11 seconds 00000100:00100000:0.0:1788521192.620007:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222356608 00000100:00100000:0.0:1788521192.620013:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222356608 00000100:00100000:0.0:1788521192.620040:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788521192.620048:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:6517:x1875400222356608:12345-0@lo:503: 00000100:00100000:0.0:1788521192.620157:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:6517:x1875400222356608:12345-0@lo:503: Request processed in 109us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521192.620170:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788521192.620937:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43254000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222356608:0@lo:503: 00000100:00100000:2.0:1788521192.622112:0:9960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43259c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9960:1875400222356736:0@lo:502: 00000100:00100000:2.0:1788521192.622326:0:9960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521192.622388:0:9960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef7658e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788521192.622528:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222356736 00000100:00100000:0.0:1788521192.622537:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222356736 00000100:00100000:0.0:1788521192.622595:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788521192.622605:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:9960:x1875400222356736:12345-0@lo:502: 00000100:00100000:0.0:1788521192.622748:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:9960:x1875400222356736:12345-0@lo:502: Request processed in 145us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521192.622757:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788521192.622864:0:9960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43259c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9960:1875400222356736:0@lo:502: 00000020:01000000:2.0:1788521192.622931:0:9960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788521192.622942:0:9960:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788521192.622956:0:9960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521192.622959:0:9960:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788521192.622965:0:9960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788521192.622970:0:9960:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.141@tcp to nid 0x20000c0a8cb8d (192.168.203.141@tcp) 00000020:01000000:2.0:1788521192.622999:0:9960:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788521192.623003:0:9960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788521192.623035:0:9960:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8fef7efe8000) 00000020:00000080:2.0:1788521192.623067:0:9960:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1788521192.623075:0:9960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788521192.623185:0:9960:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788521192.623193:0:9960:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788521192.623201:0:9960:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x411dd0ee4d2d1202 00010000:00080000:2.0:1788521192.623238:0:9960:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fef81660800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.141@tcp at head 00010000:00010000:2.0:1788521192.623595:0:9960:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1788521192.623758:0:9960:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788521192.623773:0:9960:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788521192.624566:0:9960:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788521192.624717:0:9960:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788521192.629530:0:9960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788521192.629754:0:9960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788521192.632508:0:9962:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788521192.632518:0:9962:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788521192.635234:0:9960:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788521192.635313:0:9960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788521192.635369:0:9960:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788521192.635411:0:9960:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x411dd0ee4d2d1209 00000100:00080000:2.0:1788521192.635498:0:9960:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788521192.635507:0:9960:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8fef81660800 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:2.0:1788521192.635558:0:9960:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee43259c00 x1875400222356864/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788521192.635606:0:9960:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1788521192.635671:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222356864:0@lo:8: 00000020:01000000:2.0:1788521192.635673:0:9960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521192.635678:0:9960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521192.635680:0:9960:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788521192.635682:0:9960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521192.635686:0:9960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521192.635688:0:9960:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788521192.635690:0:9960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788521192.635692:0:9960:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788521192.635721:0:9960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43258a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9960:1875400222356992:0@lo:502: 00000100:00100000:2.0:1788521192.635768:0:9960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521192.635768:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521192.635813:0:9960:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef7658e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521192.635872:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef81498e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222357120:0@lo:400: 00000100:00100000:1.0:1788521192.635957:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222357376:0@lo:400: 00000100:00100000:2.0:1788521192.635979:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521192.635988:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521192.636007:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875400222357632:0@lo:400: 00000100:00100000:1.0:1788521192.636007:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222357888:0@lo:400: 00000100:00100000:2.0:1788521192.636027:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521192.636032:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875400222357504:0@lo:400: 00000100:00100000:2.0:1788521192.636043:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222358144:0@lo:400: 00000100:00100000:1.0:1788521192.636066:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521192.636099:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875400222358016:0@lo:400: 00000100:00100000:2.0:1788521192.636106:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222357120 00000100:00100000:2.0:1788521192.636113:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222357120 00000100:00100000:1.0:1788521192.636121:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521192.636151:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222357376 00000100:00100000:2.0:1788521192.636152:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222357632 00000100:00100000:2.0:1788521192.636154:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222357632 00000100:00100000:1.0:1788521192.636154:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222357376 00000100:00100000:2.0:1788521192.636177:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222357504 00000100:00100000:2.0:1788521192.636180:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222357504 00000100:00100000:2.0:1788521192.636190:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222358016 00000100:00100000:2.0:1788521192.636192:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222358016 00000100:00100000:2.0:1788521192.636215:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788521192.636224:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222357120:12345-0@lo:400: 00000100:00100000:3.0:1788521192.636328:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef8149a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875400222357248:0@lo:400: 00000100:00100000:2.0:1788521192.636341:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222357120:12345-0@lo:400: Request processed in 117us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521192.636355:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788521192.636357:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521192.636370:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222357248 00000100:00100000:3.0:1788521192.636371:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222357760:0@lo:400: 00000100:00100000:2.0:1788521192.636372:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222357248 00000100:00100000:2.0:1788521192.636399:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788521192.636416:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788521192.636428:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875400222357504:12345-0@lo:400: 00000100:00100000:3.0:1788521192.636466:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875400222357504:12345-0@lo:400: Request processed in 41us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521192.636473:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788521192.636486:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788521192.636501:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875400222358016:12345-0@lo:400: 00000100:00100000:3.0:1788521192.636529:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875400222358016:12345-0@lo:400: Request processed in 31us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521192.636535:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788521192.636547:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788521192.636554:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875400222357248:12345-0@lo:400: 00000100:00100000:3.0:1788521192.636717:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875400222357248:12345-0@lo:400: Request processed in 163us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521192.636723:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1788521192.636768:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef71520380 x1875400222357504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521192.636783:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875400222357504:0@lo:400: 00010000:00080000:3.0:1788521192.636793:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef71521880 x1875400222358016/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521192.636800:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875400222358016:0@lo:400: 00000100:00100000:1.0:1788521192.637311:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788521192.637329:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222357376:12345-0@lo:400: 00000100:00100000:2.0:1788521192.637357:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4325ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875400222357632:12345-0@lo:400: 00000100:00100000:2.0:1788521192.637400:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4325ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875400222357632:12345-0@lo:400: Request processed in 995us (1372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521192.637400:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222357376:12345-0@lo:400: Request processed in 75us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521192.637407:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788521192.637408:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788521192.637438:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788521192.637479:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef81498e00 x1875400222357120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521192.637492:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef81498e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222357120:0@lo:400: 00010000:00080000:1.0:1788521192.637515:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef71523b80 x1875400222357632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521192.637524:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875400222357632:0@lo:400: 00000100:00080000:1.0:1788521192.637542:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788521192.637548:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788521192.637848:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222358144 00000100:00100000:3.0:1788521192.637856:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222358144 00000100:00100000:3.0:1788521192.637936:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788521192.637944:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222358144:12345-0@lo:400: 00000100:00100000:3.0:1788521192.637988:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222358144:12345-0@lo:400: Request processed in 45us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521192.637994:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1788521192.638049:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef71520e00 x1875400222358144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521192.638058:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222358144:0@lo:400: 00000100:00080000:1.0:1788521192.638750:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788521192.638867:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222356992 00000100:00100000:1.0:1788521192.638874:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222356992 00000100:00100000:1.0:1788521192.638943:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788521192.638951:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:9960:x1875400222356992:12345-0@lo:502: 00000100:00100000:1.0:1788521192.639116:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:9960:x1875400222356992:12345-0@lo:502: Request processed in 166us (3347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521192.639122:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788521192.640339:0:9960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43258a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9960:1875400222356992:0@lo:502: 00000020:01000000:3.0:1788521192.640399:0:9960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521192.640410:0:9960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521192.640413:0:9960:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788521192.640418:0:9960:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:3.0:1788521192.640508:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:3.0:1788521192.640539:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788521192.640552:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749ca200/0x411dd0ee4d2d11ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d11f4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521192.640634:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef749ca200/0x411dd0ee4d2d11ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d11f4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521192.640713:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788521192.640717:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fef58328000 from 39 10000000:01000000:3.0:1788521192.640721:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788521192.640762:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749caa00/0x411dd0ee4d2d1210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521192.640771:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef749caa00/0x411dd0ee4d2d1210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521192.640781:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef749caa00/0x411dd0ee4d2d1210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521192.640802:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43256300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222358272:0@lo:101: 00000100:00100000:3.0:1788521192.640865:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521192.640927:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef606e3840 going to sleep for 11 seconds 00000100:00100000:0.0:1788521192.641944:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222356864 00000100:00100000:0.0:1788521192.641954:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222356864 00000100:00100000:0.0:1788521192.641996:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788521192.642005:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1875400222356864:12345-0@lo:8: 00010000:00080000:0.0:1788521192.642041:0:8434:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:0.0:1788521192.642077:0:8434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x411dd0ee4d2d1217 00002000:00100000:0.0:1788521192.642094:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8fef7efd2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788521192.642099:0:8434:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:0.0:1788521192.642105:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1788521192.642305:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222358272 00000100:00100000:1.0:1788521192.642310:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222358272 00000100:00100000:1.0:1788521192.642349:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788521192.642357:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:6517:x1875400222358272:12345-0@lo:101: 00010000:00010000:1.0:1788521192.642371:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521192.642407:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef821dc000/0x411dd0ee4d2d121e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d1210 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521192.642435:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef821dc000/0x411dd0ee4d2d121e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1210 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521192.642447:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef821dc000/0x411dd0ee4d2d121e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1210 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521192.642456:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef821dc000, rc 0) 00000100:00100000:1.0:1788521192.642518:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222358272:12345-0@lo:101: Request processed in 162us (1653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521192.642524:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788521192.642810:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788521192.642871:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef8149a300 x1875400222357248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521192.642910:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef8149a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875400222357248:0@lo:400: 00000100:00100000:3.0:1788521192.642937:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222357760 00000100:00100000:3.0:1788521192.642941:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222357760 00000100:00100000:3.0:1788521192.642982:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788521192.642996:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222357760:12345-0@lo:400: 00000100:00100000:3.0:1788521192.643040:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222357760:12345-0@lo:400: Request processed in 52us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521192.643047:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788521192.643069:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788521192.643091:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef71521180 x1875400222357760/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521192.643100:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222357760:0@lo:400: 00000100:00100000:3.0:1788521192.643127:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43256300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222358272:0@lo:101: 00002000:00100000:0.0:1788521192.643770:0:8434:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788521192.644009:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521192.644083:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222357376:0@lo:400: 00002000:00080000:0.0:1788521192.644491:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1788521192.644530:0:8434:0:(import.c:65:import_set_state_nolock()) ffff8fef7efd6000 : changing import state from RECOVER to FULL 00010000:00010000:3.0:1788521192.644765:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef749caa00/0x411dd0ee4d2d1210 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d121e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521192.644781:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef749caa00/0x411dd0ee4d2d1210 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d121e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521192.644868:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43256300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222358400:0@lo:501: 00000100:00100000:3.0:1788521192.644957:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521192.644991:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef606e3840 going to sleep for 11 seconds 00000100:00100000:3.0:1788521192.645011:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222357888 00000100:00100000:3.0:1788521192.645017:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222357888 00000100:00100000:3.0:1788521192.645073:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788521192.645082:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222357888:12345-0@lo:400: 00000100:00100000:3.0:1788521192.645136:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222357888:12345-0@lo:400: Request processed in 56us (1575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521192.645325:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222358400 00000100:00100000:1.0:1788521192.645330:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222358400 00000100:00100000:1.0:1788521192.645367:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788521192.645373:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222358400:12345-0@lo:501: 00000100:00100000:1.0:1788521192.645523:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222358400:12345-0@lo:501: Request processed in 149us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521192.645530:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788521192.645813:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1875400222356864:12345-0@lo:8: Request processed in 3807us (10043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521192.645821:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788521192.645900:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43259c00 x1875400222356864/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788521202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521192.645918:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788521192.645928:0:3642:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788521192.645936:0:3642:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788521192.645942:0:3642:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788521192.645946:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef81660800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788521192.645991:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788521192.646016:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788521192.646039:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef71522300 x1875400222357888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521192.646050:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222357888:0@lo:400: 00000100:00100000:3.0:1788521192.646079:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43256300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222358400:0@lo:501: 00000100:00100000:3.0:1788521192.646119:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43256300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222358528:0@lo:503: 00000100:00100000:3.0:1788521192.646305:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521192.646336:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef606e3840 going to sleep for 11 seconds 00000100:00100000:3.0:1788521192.646351:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222358528 00000100:00100000:3.0:1788521192.646356:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222358528 00000004:00080000:0.0:1788521192.646417:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788521192.646425:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222356864:0@lo:8: 00000004:00080000:0.0:1788521192.646450:0:9962:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788521192.646543:0:9962:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 242712658568ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788521192.646550:0:9962:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788521192.647751:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788521192.647775:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222358528:12345-0@lo:503: 00000100:00100000:1.0:1788521192.647994:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222358528:12345-0@lo:503: Request processed in 230us (1688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521192.648000:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788521192.648991:0:9963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43496680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9963:1875400222358656:0@lo:700: 00000100:00100000:1.0:1788521192.649068:0:9963:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521192.649102:0:9963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef7a298840 going to sleep for 11 seconds 00000100:00100000:0.0:1788521192.649750:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222358656 00000100:00100000:0.0:1788521192.649761:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222358656 00000100:00100000:0.0:1788521192.649831:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521192.649840:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9963:x1875400222358656:12345-0@lo:700: 00000100:00100000:0.0:1788521192.649910:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8444:1875400222358784:0@lo:700: 00000100:00100000:0.0:1788521192.649963:0:8444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521192.649987:0:8444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521192.650003:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222358784 00000100:00100000:0.0:1788521192.650006:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222358784 00000100:00100000:0.0:1788521192.650035:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521192.650041:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8444:x1875400222358784:12345-0@lo:700: 00000100:00100000:3.0:1788521192.650233:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43256300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222358528:0@lo:503: 00000100:00080000:1.0:1788521192.650274:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788521192.651983:0:9964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43256300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9964:1875400222358912:0@lo:502: 00000100:00100000:3.0:1788521192.652083:0:9964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521192.652136:0:9964:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef606e3240 going to sleep for 11 seconds 00000100:00100000:1.0:1788521192.653043:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222358912 00000100:00100000:1.0:1788521192.653056:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222358912 00000100:00100000:1.0:1788521192.653119:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788521192.653130:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:9964:x1875400222358912:12345-0@lo:502: 00000100:00100000:1.0:1788521192.654934:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:9964:x1875400222358912:12345-0@lo:502: Request processed in 1794us (2839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521192.654947:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00010000:00010000:0.0:1788521192.655992:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521192.657114:0:9964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43256300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9964:1875400222358912:0@lo:502: 00000100:00100000:3.0:1788521192.657512:0:9964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43256300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9964:1875400222359040:0@lo:502: 40000000:02000000:1.0:1788521192.657861:0:6526:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:3.0:1788521192.659349:0:9964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521192.659429:0:9964:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef606e3240 going to sleep for 11 seconds 00000100:00100000:0.0:1788521192.659685:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222359040 00000100:00100000:0.0:1788521192.659697:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222359040 00000100:00100000:0.0:1788521192.659765:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788521192.659778:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:9964:x1875400222359040:12345-0@lo:502: 00000100:00100000:0.0:1788521192.660001:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:9964:x1875400222359040:12345-0@lo:502: Request processed in 226us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521192.660010:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788521192.660845:0:9964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43256300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9964:1875400222359040:0@lo:502: 00000040:00080000:3.0:1788521192.660915:0:9964:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788521192.662008:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788521192.662047:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788521192.662062:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749caa00/0x411dd0ee4d2d1210 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d121e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521192.662076:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef749caa00/0x411dd0ee4d2d1210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d121e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521192.662087:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788521192.662090:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fef58328000 from 6 10000000:01000000:0.0:1788521192.662093:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788521192.662140:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef40030c00/0x411dd0ee4d2d1225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521192.662488:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef40030c00/0x411dd0ee4d2d1225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521192.662504:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef40030c00/0x411dd0ee4d2d1225 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521192.662535:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222359168:0@lo:101: 00000100:00100000:0.0:1788521192.662827:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788521192.662996:0:7450:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788521192.663131:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788521192.666297:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222359168 00000100:00100000:2.0:1788521192.666317:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222359168 00000100:00100000:2.0:1788521192.666464:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788521192.666477:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222359168:12345-0@lo:101: 00010000:00010000:2.0:1788521192.666499:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521192.666523:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef4167fe00/0x411dd0ee4d2d122c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d1225 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521192.666557:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef4167fe00/0x411dd0ee4d2d122c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1225 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521192.666582:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef4167fe00/0x411dd0ee4d2d122c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1225 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521192.666592:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef4167fe00, rc 0) 00000100:00100000:2.0:1788521192.666711:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:6517:x1875400222359168:12345-0@lo:101: Request processed in 237us (3883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521192.666719:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788521192.666824:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222359168:0@lo:101: 00010000:00010000:3.0:1788521192.666851:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef40030c00/0x411dd0ee4d2d1225 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d122c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521192.666863:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef40030c00/0x411dd0ee4d2d1225 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d122c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521192.666986:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43256300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222359296:0@lo:256: 00000100:00100000:3.0:1788521192.667032:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521192.667912:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef606e3240 going to sleep for 11 seconds 00000100:00100000:0.0:1788521192.668443:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222359296 00000100:00100000:0.0:1788521192.668453:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222359296 00000100:00100000:0.0:1788521192.668506:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788521192.668518:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:6517:x1875400222359296:12345-0@lo:256: 20000000:01000000:0.0:1788521192.668626:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788521192.668715:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788521192.668720:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788521192.668974:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8444:x1875400222358784:12345-0@lo:700: Request processed in 18931us (19008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521192.668988:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788521192.669041:0:8444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4244dc00 x1875400222358784/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788521208 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521192.669060:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8444:1875400222358784:0@lo:700: 40000000:02000000:3.0:1788521192.669072:0:8444:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:0.0:1788521192.669919:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:6517:x1875400222359296:12345-0@lo:256: Request processed in 1397us (2880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521192.669930:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788521192.674401:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43256300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222359296:0@lo:256: 10000000:01000000:0.0:1788521192.677413:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788521192.677432:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef40030c00/0x411dd0ee4d2d1225 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d122c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521192.677447:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef40030c00/0x411dd0ee4d2d1225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d122c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521192.677458:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788521192.677462:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788521192.677466:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788521192.677541:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee42411600/0x411dd0ee4d2d1233 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521192.677550:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fee42411600/0x411dd0ee4d2d1233 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521192.677848:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fee42411600/0x411dd0ee4d2d1233 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521192.677901:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222359424:0@lo:101: 00000100:00100000:0.0:1788521192.677990:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521192.678038:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5a180 going to sleep for 11 seconds 00000100:00100000:1.0:1788521192.678277:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222359424 00000100:00100000:1.0:1788521192.678288:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222359424 00000100:00100000:1.0:1788521192.678346:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788521192.678359:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:6517:x1875400222359424:12345-0@lo:101: 00010000:00010000:1.0:1788521192.678375:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521192.678400:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef821dd800/0x411dd0ee4d2d123a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d1233 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521192.678431:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef821dd800/0x411dd0ee4d2d123a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1233 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521192.678443:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef821dd800/0x411dd0ee4d2d123a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1233 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521192.678453:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef821dd800, rc 0) 00000100:00100000:1.0:1788521192.678513:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:6517:x1875400222359424:12345-0@lo:101: Request processed in 157us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521192.678531:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788521192.678843:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222359424:0@lo:101: 00010000:00010000:3.0:1788521192.678862:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fee42411600/0x411dd0ee4d2d1233 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d123a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521192.678873:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fee42411600/0x411dd0ee4d2d1233 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d123a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521192.678973:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43257480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222359552:0@lo:501: 00000100:00100000:3.0:1788521192.679005:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521192.679040:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef606e3840 going to sleep for 11 seconds 00000100:00100000:1.0:1788521192.679282:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222359552 00000100:00100000:1.0:1788521192.679288:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222359552 00000100:00100000:1.0:1788521192.679326:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788521192.679334:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:6517:x1875400222359552:12345-0@lo:501: 00000100:00100000:1.0:1788521192.679534:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:6517:x1875400222359552:12345-0@lo:501: Request processed in 200us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521192.679542:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000001:00100000:2.0:1788521192.681455:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788521192.681635:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43257480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222359552:0@lo:501: 00000100:00100000:1.0:1788521192.681923:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43495f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222359680:0@lo:503: 00000100:00100000:1.0:1788521192.682020:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521192.682063:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef7a298a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521192.682180:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222359680 00000100:00100000:0.0:1788521192.682188:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222359680 00000100:00100000:0.0:1788521192.682248:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788521192.682257:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:6517:x1875400222359680:12345-0@lo:503: 00000100:00100000:0.0:1788521192.682408:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:6517:x1875400222359680:12345-0@lo:503: Request processed in 149us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521192.682416:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788521192.682578:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43495f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222359680:0@lo:503: 00000100:00100000:3.0:1788521192.683442:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9963:x1875400222358656:12345-0@lo:700: Request processed in 33600us (34370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521192.683459:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788521192.683757:0:9965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43257480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9965:1875400222359808:0@lo:502: 00000100:00100000:3.0:1788521192.683809:0:9965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521192.683850:0:9965:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef606e3780 going to sleep for 11 seconds 00000100:00100000:2.0:1788521192.683928:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222359808 00000100:00100000:2.0:1788521192.683936:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222359808 00000100:00100000:2.0:1788521192.683980:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788521192.683989:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:9965:x1875400222359808:12345-0@lo:502: 00000100:00100000:2.0:1788521192.684118:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:9965:x1875400222359808:12345-0@lo:502: Request processed in 130us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521192.684126:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788521192.684399:0:9965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43257480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9965:1875400222359808:0@lo:502: 00000020:01000000:3.0:1788521192.684431:0:9965:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788521192.684442:0:9965:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788521192.684451:0:9965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521192.684454:0:9965:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788521192.684459:0:9965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788521192.684463:0:9965:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.141@tcp to nid 0x20000c0a8cb8d (192.168.203.141@tcp) 00000020:01000000:3.0:1788521192.684502:0:9965:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788521192.684506:0:9965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788521192.684525:0:9965:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8fee426d3380) 00000020:00000080:3.0:1788521192.684556:0:9965:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1788521192.684564:0:9965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788521192.684745:0:9965:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788521192.684753:0:9965:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788521192.684761:0:9965:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x411dd0ee4d2d1248 00010000:00080000:3.0:1788521192.684796:0:9965:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fef7ef47000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.141@tcp at head 00010000:00010000:3.0:1788521192.685125:0:9965:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1788521192.685483:0:9965:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788521192.685499:0:9965:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788521192.685789:0:9965:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788521192.687099:0:9965:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00080000:1.0:1788521192.688364:0:9963:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43496680 x1875400222358656/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788521208 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521192.688397:0:9963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43496680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9963:1875400222358656:0@lo:700: 00000040:00080000:3.0:1788521192.688999:0:9965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788521192.689118:0:9965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788521192.690507:0:9966:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788521192.690513:0:9966:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788521192.691300:0:9965:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788521192.691316:0:9965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788521192.691365:0:9965:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788521192.691409:0:9965:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x411dd0ee4d2d124f 00000100:00080000:0.0:1788521192.691423:0:9965:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788521192.691431:0:9965:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8fef7ef47000 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:0.0:1788521192.691482:0:9965:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee4244f800 x1875400222359936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788521192.691553:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222359936:0@lo:8: 00000100:00080000:0.0:1788521192.691718:0:9965:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788521192.691798:0:9965:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521192.691803:0:9965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521192.691805:0:9965:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788521192.691808:0:9965:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521192.691812:0:9965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521192.691813:0:9965:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788521192.691816:0:9965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788521192.691818:0:9965:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788521192.691847:0:9965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9965:1875400222360064:0@lo:502: 00000100:00100000:0.0:1788521192.691932:0:9965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521192.691975:0:9965:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788521192.692076:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222360064 00000100:00100000:1.0:1788521192.692085:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222360064 00000100:00100000:1.0:1788521192.692140:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788521192.692277:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:9965:x1875400222360064:12345-0@lo:502: 00000100:00100000:1.0:1788521192.692442:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:9965:x1875400222360064:12345-0@lo:502: Request processed in 168us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521192.692450:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788521192.692553:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521192.692774:0:9965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:9965:1875400222360064:0@lo:502: 00000020:01000000:0.0:1788521192.692813:0:9965:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521192.692819:0:9965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521192.692821:0:9965:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788521192.692826:0:9965:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000100:00100000:1.0:1788521192.692951:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222359936 00000100:00100000:1.0:1788521192.692956:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222359936 00000100:00100000:1.0:1788521192.693157:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788521192.693181:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43258380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3642:x1875400222359936:12345-0@lo:8: 00010000:00080000:1.0:1788521192.693213:0:8875:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:1.0:1788521192.693244:0:8875:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x411dd0ee4d2d1256 00002000:00100000:1.0:1788521192.693263:0:8875:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8fee4211f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788521192.693267:0:8875:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788521192.693271:0:8875:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788521192.693368:0:8875:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788521192.693408:0:8875:0:(import.c:65:import_set_state_nolock()) ffff8fee4211b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788521192.693483:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43258380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3642:x1875400222359936:12345-0@lo:8: Request processed in 302us (1837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521192.693490:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788521192.693562:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4244f800 x1875400222359936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788521202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521192.693577:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788521192.693585:0:3642:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788521192.693594:0:3642:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788521192.693601:0:3642:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788521192.693603:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef7ef47000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788521192.693620:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788521192.693625:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222359936:0@lo:8: 00000020:01000000:2.0:1788521192.693858:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1788521192.693918:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788521192.693930:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee42411600/0x411dd0ee4d2d1233 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d123a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521192.693943:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fee42411600/0x411dd0ee4d2d1233 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d123a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521192.693955:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788521192.693958:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8fef4e780000 from 1 10000000:01000000:2.0:1788521192.693961:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788521192.693995:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef4167f800/0x411dd0ee4d2d125d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521192.694004:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef4167f800/0x411dd0ee4d2d125d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521192.694013:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef4167f800/0x411dd0ee4d2d125d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521192.694059:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4325a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222360192:0@lo:101: 00000100:00100000:2.0:1788521192.694110:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521192.694144:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee434e1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521192.694163:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222360192 00000100:00100000:2.0:1788521192.694180:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222360192 00000100:00100000:2.0:1788521192.694218:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788521192.694227:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:6517:x1875400222360192:12345-0@lo:101: 00010000:00010000:2.0:1788521192.694239:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521192.694254:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef4167fa00/0x411dd0ee4d2d1264 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d125d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521192.694280:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef4167fa00/0x411dd0ee4d2d1264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d125d expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521192.694291:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef4167fa00/0x411dd0ee4d2d1264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d125d expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521192.694301:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef4167fa00, rc 0) 00000100:00100000:2.0:1788521192.694333:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:6517:x1875400222360192:12345-0@lo:101: Request processed in 108us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521192.694340:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788521192.694389:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4325a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222360192:0@lo:101: 00010000:00010000:2.0:1788521192.694403:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef4167f800/0x411dd0ee4d2d125d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1264 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521192.694413:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef4167f800/0x411dd0ee4d2d125d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d1264 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521192.694482:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4325a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222360320:0@lo:501: 00000100:00100000:2.0:1788521192.694508:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521192.694523:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee434e1cc0 going to sleep for 11 seconds 00000004:00080000:3.0:1788521192.694832:0:9966:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788521192.694942:0:9966:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 242761057915ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788521192.694951:0:9966:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788521192.695975:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222360320 00000100:00100000:2.0:1788521192.695989:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222360320 00000100:00100000:2.0:1788521192.696048:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788521192.696059:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:6517:x1875400222360320:12345-0@lo:501: 00000100:00100000:2.0:1788521192.696366:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:6517:x1875400222360320:12345-0@lo:501: Request processed in 308us (1855us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788521192.696376:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788521192.696479:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4325a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222360320:0@lo:501: 10000000:01000000:3.0:1788521192.696529:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788521192.696542:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef4167f800/0x411dd0ee4d2d125d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1264 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521192.696553:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef4167f800/0x411dd0ee4d2d125d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1264 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788521192.698399:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788521192.698570:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788521192.698596:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222360448:0@lo:13: 00000100:00100000:2.0:1788521192.698746:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788521192.698801:0:9967:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788521192.698827:0:9967:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4325bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9967:1875400222360576:0@lo:7: 00000100:00100000:2.0:1788521192.698857:0:9967:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521192.698910:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222360576 00000100:00100000:2.0:1788521192.698918:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222360576 00000100:00100000:2.0:1788521192.698983:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788521192.698994:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4325a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9967:x1875400222360576:12345-0@lo:7: 00000100:00100000:0.0:1788521192.699954:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222360448 00000100:00100000:0.0:1788521192.699964:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222360448 00000100:00100000:0.0:1788521192.700019:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788521192.700029:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4325a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875400222360448:12345-0@lo:13: 00002000:00000024:0.0:1788521192.700056:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923939328 avail 3692417024 00000100:00100000:0.0:1788521192.700134:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4325a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875400222360448:12345-0@lo:13: Request processed in 106us (1388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521192.700153:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788521192.700301:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43258700 x1875400222360448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521192.700326:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222360448:0@lo:13: 00000100:00080000:1.0:1788521192.701423:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788521192.701974:0:9967:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee434e1600 going to sleep for 11 seconds 00000004:00080000:0.0:1788521192.711413:0:9963:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788521192.711464:0:9963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9963:1875400222360832:0@lo:7: 00000100:00100000:0.0:1788521192.711554:0:9963:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521192.711588:0:9963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788521192.711748:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222360704:0@lo:13: 00000100:00100000:3.0:1788521192.711788:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521192.711848:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222360832 00000100:00100000:3.0:1788521192.711859:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222360832 00000100:00100000:3.0:1788521192.711945:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788521192.711958:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9963:x1875400222360832:12345-0@lo:7: 00000100:00100000:0.0:1788521192.714366:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222360704 00000100:00100000:0.0:1788521192.714395:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222360704 00000100:00100000:0.0:1788521192.714460:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788521192.714473:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875400222360704:12345-0@lo:13: 00002000:00000024:0.0:1788521192.714504:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923939328 avail 3692417024 00000100:00100000:0.0:1788521192.714607:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3643:x1875400222360704:12345-0@lo:13: Request processed in 137us (2818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521192.714615:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788521192.714924:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4244f800 x1875400222360704/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521192.714951:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222360704:0@lo:13: 00002000:00080000:2.0:1788521192.722631:0:8437:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788521192.722645:0:8437:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788521192.722782:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4325a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9967:x1875400222360576:12345-0@lo:7: Request processed in 23783us (23917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521192.722796:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788521192.723389:0:9967:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4325bb80 x1875400222360576/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788521208 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521192.723409:0:9967:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4325bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9967:1875400222360576:0@lo:7: 00000004:00080000:0.0:1788521192.723428:0:9967:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788521192.723481:0:9967:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9967:1875400222360960:0@lo:5: 00000100:00100000:0.0:1788521192.723535:0:9967:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521192.723571:0:9967:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788521192.724767:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222360960 00000100:00100000:2.0:1788521192.724779:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222360960 00000100:00100000:2.0:1788521192.727503:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788521192.727528:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9967:x1875400222360960:12345-0@lo:5: 00002000:00080000:2.0:1788521192.727575:0:8436:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788521192.727581:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00002000:00080000:3.0:1788521192.731525:0:8434:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788521192.731540:0:8434:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788521192.731675:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9963:x1875400222360832:12345-0@lo:7: Request processed in 19713us (20114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521192.731687:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788521192.733836:0:9963:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4244df80 x1875400222360832/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788521208 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521192.733862:0:9963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9963:1875400222360832:0@lo:7: 00000004:00080000:0.0:1788521192.733896:0:9963:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788521192.733961:0:9963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9963:1875400222361088:0@lo:5: 00000100:00100000:0.0:1788521192.734031:0:9963:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521192.734073:0:9963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788521192.734791:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222361088 00000100:00100000:3.0:1788521192.734801:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222361088 00000100:00100000:3.0:1788521192.734873:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788521192.734903:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9963:x1875400222361088:12345-0@lo:5: 00002000:00080000:3.0:1788521192.734956:0:8875:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1788521192.735014:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9963:x1875400222361088:12345-0@lo:5: Request processed in 131us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521192.735021:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788521192.735135:0:9963:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4244df80 x1875400222361088/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788521208 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521192.735278:0:9963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9963:1875400222361088:0@lo:5: 00000004:00080000:0.0:1788521192.735293:0:9963:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788521192.735334:0:9963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9963:1875400222361216:0@lo:5: 00000100:00100000:0.0:1788521192.735365:0:9963:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521192.735400:0:9963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788521192.735441:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222361216 00000100:00100000:3.0:1788521192.735446:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222361216 00000100:00100000:3.0:1788521192.735481:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788521192.735488:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9963:x1875400222361216:12345-0@lo:5: 00002000:00080000:3.0:1788521192.735519:0:8434:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000001:00080000:2.0:1788521192.762914:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1788521192.762936:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788521192.763126:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9967:x1875400222360960:12345-0@lo:5: Request processed in 35599us (39581us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788521192.763141:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788521192.763453:0:9967:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4244d880 x1875400222360960/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788521208 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521192.763467:0:9967:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788521192.763475:0:9967:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9967:1875400222360960:0@lo:5: 00000004:00080000:0.0:1788521192.763496:0:9967:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788521192.763562:0:9967:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9967:1875400222361344:0@lo:700: 00000100:00100000:0.0:1788521192.763609:0:9967:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521192.763666:0:9967:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788521192.764773:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222361344 00000100:00100000:2.0:1788521192.764786:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222361344 00000100:00100000:2.0:1788521192.764864:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788521192.764875:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9967:x1875400222361344:12345-0@lo:700: 00000100:00100000:3.0:1788521192.769929:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9963:x1875400222361216:12345-0@lo:5: Request processed in 34430us (34551us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788521192.769944:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788521192.770814:0:9963:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4244df80 x1875400222361216/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788521208 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521192.770838:0:9963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9963:1875400222361216:0@lo:5: 00000004:00080000:1.0:1788521192.770857:0:9963:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788521192.770938:0:9963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43496680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9963:1875400222361472:0@lo:900: 00000100:00100000:1.0:1788521192.770997:0:9963:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521192.771030:0:9963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef767bc3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521192.771318:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222361472 00000100:00100000:3.0:1788521192.771327:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222361472 00000100:00100000:3.0:1788521192.771410:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788521192.771421:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9963:x1875400222361472:12345-0@lo:900: 00000100:00100000:3.0:1788521192.771490:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9963:x1875400222361472:12345-0@lo:900: Request processed in 70us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521192.771497:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788521192.772319:0:9963:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43496680 x1875400222361472/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788521208 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521192.772337:0:9963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43496680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9963:1875400222361472:0@lo:900: 00000001:00080000:2.0:1788521192.777417:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1788521192.777878:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9967:x1875400222361344:12345-0@lo:700: Request processed in 12997us (14261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521192.777919:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788521192.778375:0:9967:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4244d880 x1875400222361344/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788521208 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521192.778405:0:9967:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9967:1875400222361344:0@lo:700: 00000004:02000040:1.0:1788521192.793439:0:9967:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1788521192.804433:0:9967:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43496680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9967:1875400222361600:0@lo:5: 00000100:00100000:1.0:1788521192.804540:0:9967:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521192.804617:0:9967:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef767bc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521192.808926:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222361600 00000100:00100000:0.0:1788521192.808945:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222361600 00000100:00100000:0.0:1788521192.809046:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788521192.809058:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9967:x1875400222361600:12345-0@lo:5: 00002000:00080000:0.0:1788521192.815190:0:8437:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788521192.815218:0:8437:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00010000:00080000:0.0:1788521192.819345:0:9967:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43496680 x1875400222361600/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788521208 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521192.819396:0:9967:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43496680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9967:1875400222361600:0@lo:5: 00000004:00080000:0.0:1788521192.819418:0:9967:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000100:00100000:1.0:1788521192.822597:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9967:x1875400222361600:12345-0@lo:5: Request processed in 10106us (14627us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788521192.822627:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000001:00080000:0.0:1788521192.945448:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:0.0:1788521193.101621:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222361728:0@lo:41: 00000100:00100000:0.0:1788521193.101727:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521193.101938:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222361728 00000100:00100000:2.0:1788521193.101948:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222361728 00000100:00100000:2.0:1788521193.102013:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788521193.102024:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222361728:12345-0@lo:41: 00000004:00000024:2.0:1788521193.102086:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788521193.102153:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222361728:12345-0@lo:41: Request processed in 130us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521193.102160:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788521193.102643:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222361728:0@lo:41: 00010000:00010000:2.0:1788521193.677187:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521194.704838:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788521195.064591:0:10038:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788521195.065171:0:10038:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788521195.149986:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222361856:0@lo:13: 00000100:00100000:0.0:1788521195.149986:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222361984:0@lo:13: 00000100:00100000:0.0:1788521195.150097:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521195.150280:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222361984 00000100:00100000:1.0:1788521195.150289:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222361984 00000100:00100000:1.0:1788521195.150354:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788521195.150376:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222361984:12345-0@lo:13: 00002000:00000024:1.0:1788521195.150412:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521195.150468:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222361984:12345-0@lo:13: Request processed in 104us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521195.150475:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788521195.150603:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521195.150762:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222361856 00000100:00100000:1.0:1788521195.150767:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222361856 00000100:00100000:1.0:1788521195.150796:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788521195.150803:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43259c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222361856:12345-0@lo:13: 00002000:00000024:1.0:1788521195.150815:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521195.150847:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43259c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222361856:12345-0@lo:13: Request processed in 45us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521195.150854:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788521195.151482:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788521195.151536:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4244d880 x1875400222361984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521211 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521195.151562:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222361984:0@lo:13: 00010000:00080000:2.0:1788521195.151814:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43496a00 x1875400222361856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521211 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521195.151845:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222361856:0@lo:13: 00010000:00010000:0.0:1788521195.738019:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788521196.187144:0:10087:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788521196.187164:0:10087:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1788521196.675091:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521196.675144:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201339008 00000100:00100000:0.0:1788521196.675157:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201339008 00000100:00100000:0.0:1788521196.675211:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 184 00000100:00100000:0.0:1788521196.675221:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2392:x1875400201339008:12345-192.168.203.41@tcp:250: 00010000:00080000:0.0:1788521196.675258:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f234d90e-c25e-4162-a7b5-1cc50583b917@192.168.203.41@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:0.0:1788521196.675294:0:6512:0:(genops.c:1385:class_connect()) connect: client f234d90e-c25e-4162-a7b5-1cc50583b917, cookie 0x411dd0ee4d2d126b 00000100:00080000:2.0:1788521196.675507:0:6512:0:(import.c:65:import_set_state_nolock()) ffff8fee4326c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788521196.675599:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+5:2392:x1875400201339008:12345-192.168.203.41@tcp:250: Request processed in 378us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521196.675608:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 184 00000100:00100000:1.0:1788521196.690438:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521196.690579:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201339136 00000100:00100000:0.0:1788521196.690593:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201339136 00000100:00100000:0.0:1788521196.690678:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 185 00000100:00100000:0.0:1788521196.690691:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4813ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+5:6155:x1875400201339136:12345-192.168.203.41@tcp:101: 00010000:00010000:0.0:1788521196.690712:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521196.690750:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fee42411a00/0x411dd0ee4d2d1272 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed465 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521196.690788:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fee42411a00/0x411dd0ee4d2d1272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed465 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521196.690800:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fee42411a00/0x411dd0ee4d2d1272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed465 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521196.690811:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411a00, rc 0) 00000100:00100000:0.0:1788521196.690928:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4813ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+6:6155:x1875400201339136:12345-192.168.203.41@tcp:101: Request processed in 239us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521196.690935:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 185 00000100:00100000:2.0:1788521196.697875:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521196.698097:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201339264 00000100:00100000:0.0:1788521196.698110:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201339264 00000100:00100000:0.0:1788521196.698289:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 186 00000100:00100000:0.0:1788521196.698302:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4813d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+6:6155:x1875400201339264:12345-192.168.203.41@tcp:501: 00000100:00100000:0.0:1788521196.698526:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4813d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+6:6155:x1875400201339264:12345-192.168.203.41@tcp:501: Request processed in 226us (667us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788521196.698536:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 186 00000100:00100000:1.0:1788521196.704945:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521196.705041:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201339392 00000100:00100000:2.0:1788521196.705054:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201339392 00000100:00100000:2.0:1788521196.705120:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 187 00000100:00100000:2.0:1788521196.705132:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4813f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+6:6155:x1875400201339392:12345-192.168.203.41@tcp:101: 00010000:00010000:2.0:1788521196.705164:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521196.705189:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef4167fc00/0x411dd0ee4d2d1279 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed46c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521196.705227:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef4167fc00/0x411dd0ee4d2d1279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed46c expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521196.705239:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef4167fc00/0x411dd0ee4d2d1279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed46c expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521196.705249:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef4167fc00, rc 0) 00000100:00100000:2.0:1788521196.705327:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4813f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+7:6155:x1875400201339392:12345-192.168.203.41@tcp:101: Request processed in 196us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521196.705335:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 187 00000100:00100000:3.0:1788521196.708496:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521196.712486:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201339520 00000100:00100000:1.0:1788521196.712510:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201339520 00000100:00100000:1.0:1788521196.712605:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 188 00000100:00100000:1.0:1788521196.712620:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71ec6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+7:6155:x1875400201339520:12345-192.168.203.41@tcp:501: 00000100:00100000:1.0:1788521196.713480:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71ec6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+8:6155:x1875400201339520:12345-192.168.203.41@tcp:501: Request processed in 858us (4994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521196.713491:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 188 00000100:00100000:3.0:1788521196.717787:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521196.718081:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201339648 00000100:00100000:0.0:1788521196.718094:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201339648 00000100:00100000:0.0:1788521196.718176:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 189 00000100:00100000:0.0:1788521196.718187:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71ec7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+8:6155:x1875400201339648:12345-192.168.203.41@tcp:503: 00000100:00100000:0.0:1788521196.718368:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71ec7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+8:6155:x1875400201339648:12345-192.168.203.41@tcp:503: Request processed in 182us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521196.718377:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 189 00000100:00100000:0.0:1788521196.726056:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521196.726269:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201339776 00000100:00100000:1.0:1788521196.726282:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201339776 00000100:00100000:1.0:1788521196.726367:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 190 00000100:00100000:1.0:1788521196.726379:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4875b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+8:6174:x1875400201339776:12345-192.168.203.41@tcp:502: 00000100:00100000:1.0:1788521196.726575:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4875b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+8:6174:x1875400201339776:12345-192.168.203.41@tcp:502: Request processed in 197us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521196.726584:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 190 00010000:00010000:2.0:1788521196.750277:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521196.775318:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521196.775685:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201339904 00000100:00100000:2.0:1788521196.775717:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201339904 00000100:00100000:2.0:1788521196.775791:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 191 00000100:00100000:2.0:1788521196.775803:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef48759050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+8:6174:x1875400201339904:12345-192.168.203.41@tcp:502: 00000100:00100000:2.0:1788521196.776051:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef48759050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+8:6174:x1875400201339904:12345-192.168.203.41@tcp:502: Request processed in 250us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521196.776060:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 191 00000100:00100000:3.0:1788521196.779020:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521196.780966:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201340032 00000100:00100000:2.0:1788521196.780984:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201340032 00000100:00100000:2.0:1788521196.781057:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 192 00000100:00100000:2.0:1788521196.781080:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+8:6155:x1875400201340032:12345-192.168.203.41@tcp:101: 00010000:00010000:2.0:1788521196.781103:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521196.781135:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef4167f400/0x411dd0ee4d2d1280 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed49d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521196.781261:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef4167f400/0x411dd0ee4d2d1280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed49d expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521196.781274:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef4167f400/0x411dd0ee4d2d1280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed49d expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521196.781285:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef4167f400, rc 0) 00000100:00100000:2.0:1788521196.781374:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+9:6155:x1875400201340032:12345-192.168.203.41@tcp:101: Request processed in 298us (2369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521196.781382:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 192 00000100:00100000:0.0:1788521196.786274:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521196.786398:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201340160 00000100:00100000:1.0:1788521196.786413:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201340160 00000100:00100000:1.0:1788521196.786494:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 193 00000100:00100000:1.0:1788521196.786506:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+9:6155:x1875400201340160:12345-192.168.203.41@tcp:256: 20000000:01000000:1.0:1788521196.786542:0:6514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788521196.786576:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788521196.786581:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788521196.786584:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788521196.786588:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788521196.786595:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1788521196.789418:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+9:6155:x1875400201340160:12345-192.168.203.41@tcp:256: Request processed in 2899us (3287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521196.789434:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 193 00000100:00100000:3.0:1788521196.792995:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521196.793367:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201340288 00000100:00100000:0.0:1788521196.793381:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201340288 00000100:00100000:0.0:1788521196.793465:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 194 00000100:00100000:0.0:1788521196.793478:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+9:6155:x1875400201340288:12345-192.168.203.41@tcp:101: 00010000:00010000:0.0:1788521196.793501:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521196.793530:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fee42411800/0x411dd0ee4d2d1287 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed4a4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521196.793575:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fee42411800/0x411dd0ee4d2d1287 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed4a4 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521196.793592:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fee42411800/0x411dd0ee4d2d1287 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed4a4 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521196.793606:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411800, rc 0) 00000100:00100000:0.0:1788521196.793749:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+10:6155:x1875400201340288:12345-192.168.203.41@tcp:101: Request processed in 272us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521196.793760:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 194 00000100:00100000:0.0:1788521196.796636:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521196.796764:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201340416 00000100:00100000:1.0:1788521196.796777:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201340416 00000100:00100000:1.0:1788521196.796852:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 195 00000100:00100000:1.0:1788521196.796865:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+10:6155:x1875400201340416:12345-192.168.203.41@tcp:501: 00000100:00100000:1.0:1788521196.797447:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+10:6155:x1875400201340416:12345-192.168.203.41@tcp:501: Request processed in 582us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521196.797457:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 195 00000100:00100000:3.0:1788521196.800571:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521196.803023:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201340544 00000100:00100000:2.0:1788521196.803047:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201340544 00000100:00100000:2.0:1788521196.803316:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 196 00000100:00100000:2.0:1788521196.803330:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+10:6155:x1875400201340544:12345-192.168.203.41@tcp:503: 00000100:00100000:2.0:1788521196.803608:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+10:6155:x1875400201340544:12345-192.168.203.41@tcp:503: Request processed in 280us (3053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521196.803619:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 196 00000100:00100000:2.0:1788521196.810418:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521196.810535:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201340672 00000100:00100000:1.0:1788521196.810549:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201340672 00000100:00100000:1.0:1788521196.810657:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 197 00000100:00100000:1.0:1788521196.810670:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+10:6181:x1875400201340672:12345-192.168.203.41@tcp:502: 00000100:00100000:1.0:1788521196.810929:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+10:6181:x1875400201340672:12345-192.168.203.41@tcp:502: Request processed in 260us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521196.810938:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 197 00000100:00100000:1.0:1788521196.814465:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521196.814876:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201340800 00000100:00100000:2.0:1788521196.816106:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201340800 00000100:00100000:2.0:1788521196.816328:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 198 00000100:00100000:2.0:1788521196.816341:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+10:6181:x1875400201340800:12345-192.168.203.41@tcp:502: 00000100:00100000:2.0:1788521196.816576:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+10:6181:x1875400201340800:12345-192.168.203.41@tcp:502: Request processed in 237us (2194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521196.816585:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 198 00000100:00100000:2.0:1788521196.822314:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521196.823139:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521196.823271:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201340928 00000100:00100000:2.0:1788521196.823284:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201340928 00000100:00100000:2.0:1788521196.823334:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201341184 00000100:00100000:2.0:1788521196.823338:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201341184 00000100:00100000:2.0:1788521196.823376:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 7 00000100:00100000:2.0:1788521196.823387:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2392:x1875400201340928:12345-192.168.203.41@tcp:38: 00010000:00080000:2.0:1788521196.823425:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from fc75e887-507e-4861-8203-e266d82f5177@192.168.203.41@tcp t0 exp 0000000000000000 cur 246 last 0 00000100:00100000:0.0:1788521196.823468:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 8 00000100:00100000:0.0:1788521196.823474:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2392:x1875400201341184:12345-192.168.203.41@tcp:38: 00010000:00080000:0.0:1788521196.823491:0:6520:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from fc75e887-507e-4861-8203-e266d82f5177@192.168.203.41@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:0.0:1788521196.823528:0:6520:0:(genops.c:1385:class_connect()) connect: client fc75e887-507e-4861-8203-e266d82f5177, cookie 0x411dd0ee4d2d1295 00000020:00000080:2.0:1788521196.823529:0:6521:0:(genops.c:1385:class_connect()) connect: client fc75e887-507e-4861-8203-e266d82f5177, cookie 0x411dd0ee4d2d128e 00000004:00100000:2.0:1788521196.823562:0:6521:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788521196.824124:0:6521:0:(import.c:65:import_set_state_nolock()) ffff8fee4326a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788521196.824307:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+6:2392:x1875400201340928:12345-192.168.203.41@tcp:38: Request processed in 919us (2006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521196.824317:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 7 00000004:00100000:0.0:1788521196.827420:0:6520:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788521196.827768:0:6520:0:(import.c:65:import_set_state_nolock()) ffff8fef7efd7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788521196.827873:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+6:2392:x1875400201341184:12345-192.168.203.41@tcp:38: Request processed in 4395us (4736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521196.827909:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 8 00000100:00100000:1.0:1788521197.709179:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7ef88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222362112:0@lo:13: 00000100:00100000:1.0:1788521197.709275:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521197.709342:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222362368:0@lo:400: 00000100:00100000:1.0:1788521197.709387:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521197.709409:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521197.709469:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875400222362496:0@lo:400: 00000100:00100000:2.0:1788521197.709519:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521197.709558:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222362496 00000100:00100000:2.0:1788521197.709568:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222362496 00000100:00100000:2.0:1788521197.709637:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788521197.709640:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7ef89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222362240:0@lo:41: 00000100:00100000:2.0:1788521197.709652:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4325bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875400222362496:12345-0@lo:400: 00000100:00100000:1.0:1788521197.709677:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521197.709734:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4325bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875400222362496:12345-0@lo:400: Request processed in 86us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521197.709742:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1788521197.709787:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43258000 x1875400222362496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521197.709801:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875400222362496:0@lo:400: 00000100:00100000:2.0:1788521197.709872:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222362880:0@lo:400: 00000100:00100000:1.0:1788521197.709904:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222362624:0@lo:400: 00000100:00100000:2.0:1788521197.709936:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521197.709969:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222362240 00000100:00100000:1.0:1788521197.709983:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222362240 00000100:00100000:2.0:1788521197.709999:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875400222363008:0@lo:400: 00000100:00100000:1.0:1788521197.710012:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222362880 00000100:00100000:1.0:1788521197.710016:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222362880 00000100:00100000:2.0:1788521197.710031:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521197.710035:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788521197.710045:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222362240:12345-0@lo:41: 00000100:00100000:2.0:1788521197.710071:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222363008 00000100:00100000:2.0:1788521197.710076:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222363008 00000004:00000024:1.0:1788521197.710081:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788521197.710119:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788521197.710127:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875400222363008:12345-0@lo:400: 00000100:00100000:2.0:1788521197.710862:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875400222363008:12345-0@lo:400: Request processed in 731us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521197.710872:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1788521197.710940:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee41aab800 x1875400222363008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521197.710969:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875400222363008:0@lo:400: 00000100:00100000:2.0:1788521197.711029:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222363392:0@lo:400: 00000100:00100000:2.0:1788521197.711061:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521197.711098:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222363392 00000100:00100000:2.0:1788521197.711103:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222363392 00000100:00100000:2.0:1788521197.711137:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788521197.711145:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222363392:12345-0@lo:400: 00000100:00100000:2.0:1788521197.711184:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222363392:12345-0@lo:400: Request processed in 41us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521197.711190:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788521197.711211:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222362752:0@lo:400: 00010000:00080000:2.0:1788521197.711213:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee41aa9c00 x1875400222363392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521197.711221:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222363392:0@lo:400: 00000100:00100000:2.0:1788521197.711253:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875400222363520:0@lo:400: 00000100:00100000:2.0:1788521197.711291:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521197.711552:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222363520 00000100:00100000:2.0:1788521197.711558:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222363520 00000100:00100000:2.0:1788521197.711590:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788521197.711597:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875400222363520:12345-0@lo:400: 00000100:00100000:2.0:1788521197.711634:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875400222363520:12345-0@lo:400: Request processed in 38us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521197.711640:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1788521197.711670:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee41aa9c00 x1875400222363520/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521197.711691:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875400222363520:0@lo:400: 00000100:00100000:0.0:1788521197.711903:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222362112 00000100:00100000:0.0:1788521197.711909:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222362112 00000100:00100000:0.0:1788521197.711943:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788521197.711951:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222362112:12345-0@lo:13: 00002000:00000024:0.0:1788521197.711978:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521197.712017:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222362112:12345-0@lo:13: Request processed in 68us (2744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521197.712024:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788521197.712042:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521197.712047:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788521197.712050:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521197.712068:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222362368 00000100:00100000:0.0:1788521197.712072:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222362368 00000100:00100000:0.0:1788521197.712103:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788521197.712110:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3645:x1875400222362368:12345-0@lo:400: 00000100:00100000:0.0:1788521197.712173:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3645:x1875400222362368:12345-0@lo:400: Request processed in 63us (2764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521197.712181:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788521197.712220:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222362368:0@lo:400: 00000100:00100000:0.0:1788521197.712253:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788521197.712288:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7ef88a80 x1875400222362112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521197.712296:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1788521197.712312:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7ef88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222362112:0@lo:13: 00000100:00100000:0.0:1788521197.712359:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222363136:0@lo:400: 00000100:00100000:0.0:1788521197.712387:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521197.712402:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875400222363648:0@lo:400: 00000100:00100000:0.0:1788521197.712428:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521197.712443:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788521197.712448:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222363776:0@lo:400: 00000100:00100000:0.0:1788521197.712470:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521197.712699:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222363776 00000100:00100000:2.0:1788521197.712704:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222363776 00000100:00100000:2.0:1788521197.712747:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788521197.712754:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222363776:12345-0@lo:400: 00000100:00100000:2.0:1788521197.712796:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222363776:12345-0@lo:400: Request processed in 42us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521197.712803:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788521197.712823:0:6524:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788521197.712832:0:6524:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1788521197.712849:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222363136 00000100:00100000:2.0:1788521197.712852:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222363136 00000100:00100000:2.0:1788521197.712876:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222363648 00000100:00100000:2.0:1788521197.712879:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222363648 00000100:00100000:2.0:1788521197.712922:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788521197.712928:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222363136:12345-0@lo:400: 00000100:00100000:2.0:1788521197.712960:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222363136:12345-0@lo:400: Request processed in 32us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521197.712966:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788521197.712977:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788521197.712983:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875400222363648:12345-0@lo:400: 00000100:00100000:2.0:1788521197.713008:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875400222363648:12345-0@lo:400: Request processed in 26us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521197.713013:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1788521197.713267:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788521197.713272:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788521197.713296:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef767d2d80 x1875400222363776/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521197.713306:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788521197.713321:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222363776:0@lo:400: 00010000:00080000:0.0:1788521197.713355:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee41aab800 x1875400222363136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521197.713364:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222363136:0@lo:400: 00010000:00080000:0.0:1788521197.713375:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef767d1500 x1875400222363648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521197.713383:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875400222363648:0@lo:400: 00000100:00100000:1.0:1788521197.714365:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222362240:12345-0@lo:41: Request processed in 4303us (4668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521197.714390:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521197.714435:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222363264:0@lo:400: 00000100:00100000:1.0:1788521197.714512:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788521197.714628:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222362624 00000100:00100000:0.0:1788521197.714633:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7ef89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222362240:0@lo:41: 00000100:00100000:1.0:1788521197.714636:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222362624 00000100:00100000:1.0:1788521197.714674:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788521197.714678:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222362752 00000100:00100000:0.0:1788521197.714683:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222362752 00000100:00100000:1.0:1788521197.714688:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222362880:12345-0@lo:400: 00000100:00100000:0.0:1788521197.714724:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788521197.714725:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521197.714733:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222362752:12345-0@lo:400: 00000100:00100000:1.0:1788521197.714759:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222362880:12345-0@lo:400: Request processed in 73us (4822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521197.714767:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788521197.714790:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222363264 00000100:00100000:3.0:1788521197.714795:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222363264 00000100:00100000:1.0:1788521197.714807:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222362880:0@lo:400: 00000100:00100000:1.0:1788521197.714834:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788521197.714841:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222362624:12345-0@lo:400: 00000100:00100000:3.0:1788521197.714932:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788521197.714939:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222363264:12345-0@lo:400: 00000100:00080000:2.0:1788521197.714987:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521197.716762:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222362752:12345-0@lo:400: Request processed in 2018us (2362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521197.716777:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788521197.718987:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222362624:12345-0@lo:400: Request processed in 4132us (6719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521197.719006:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788521197.719158:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222363264:12345-0@lo:400: Request processed in 4216us (4430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521197.719169:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788521197.719361:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43258700 x1875400222362752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521197.719405:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43258700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222362752:0@lo:400: 00010000:00080000:2.0:1788521197.719426:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee41aaad80 x1875400222363264/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521197.719435:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222363264:0@lo:400: 00000100:00100000:0.0:1788521197.721277:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222362624:0@lo:400: 00010000:00010000:2.0:1788521197.773193:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521197.834793:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521197.834845:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521197.834920:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521197.835016:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201341312 00000100:00100000:1.0:1788521197.835029:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201341312 00000100:00100000:1.0:1788521197.835137:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201341056 00000100:00100000:1.0:1788521197.835141:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201341056 00000100:00100000:1.0:1788521197.835157:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201341440 00000100:00100000:1.0:1788521197.835160:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201341440 00000100:00100000:1.0:1788521197.835204:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 9 00000100:00100000:1.0:1788521197.835214:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+6:0:x1875400201341312:12345-192.168.203.41@tcp:41: 00000004:00000024:1.0:1788521197.835263:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788521197.835352:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+6:0:x1875400201341312:12345-192.168.203.41@tcp:41: Request processed in 129us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521197.835360:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 9 00000100:00100000:1.0:1788521197.835383:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 10 00000100:00100000:1.0:1788521197.835390:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+7:0:x1875400201341056:12345-192.168.203.41@tcp:41: 00000004:00000024:1.0:1788521197.835409:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788521197.835442:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+7:0:x1875400201341056:12345-192.168.203.41@tcp:41: Request processed in 51us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521197.835449:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 10 00000100:00100000:1.0:1788521197.835461:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 11 00000100:00100000:1.0:1788521197.835467:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+6:6155:x1875400201341440:12345-192.168.203.41@tcp:41: 00000004:00000024:1.0:1788521197.835477:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788521197.835498:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+6:6155:x1875400201341440:12345-192.168.203.41@tcp:41: Request processed in 30us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521197.835504:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 11 00000100:00080000:2.0:1788521197.835717:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788521197.835723:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788521197.845307:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521197.847726:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201341568 00000100:00100000:1.0:1788521197.847748:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201341568 00000100:00100000:1.0:1788521197.847855:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 12 00000100:00100000:1.0:1788521197.847867:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+6:6155:x1875400201341568:12345-192.168.203.41@tcp:40: 00000100:00100000:1.0:1788521197.848030:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+6:6155:x1875400201341568:12345-192.168.203.41@tcp:40: Request processed in 165us (2738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521197.848039:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 12 00000100:00100000:0.0:1788521197.851959:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521197.852096:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201341696 00000100:00100000:2.0:1788521197.852118:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201341696 00000100:00100000:2.0:1788521197.852172:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 16 00000100:00100000:2.0:1788521197.852182:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2392:x1875400201341696:12345-192.168.203.41@tcp:8: 00010000:00080000:2.0:1788521197.852223:0:8875:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from fc75e887-507e-4861-8203-e266d82f5177@192.168.203.41@tcp t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:2.0:1788521197.852262:0:8875:0:(genops.c:1385:class_connect()) connect: client fc75e887-507e-4861-8203-e266d82f5177, cookie 0x411dd0ee4d2d129c 00002000:00100000:2.0:1788521197.852277:0:8875:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fc75e887-507e-4861-8203-e266d82f5177/ffff8fef816f0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788521197.852300:0:8875:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788521197.852532:0:8875:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788521197.852593:0:8875:0:(import.c:65:import_set_state_nolock()) ffff8fef7f058000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788521197.852970:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+6:2392:x1875400201341696:12345-192.168.203.41@tcp:8: Request processed in 787us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521197.852980:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 16 00000100:00100000:3.0:1788521197.854303:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521197.854656:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201341824 00000100:00100000:0.0:1788521197.854676:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201341824 00000100:00100000:0.0:1788521197.854728:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 17 00000100:00100000:0.0:1788521197.854737:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1875400201341824:12345-192.168.203.41@tcp:8: 00010000:00080000:0.0:1788521197.854774:0:8434:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from fc75e887-507e-4861-8203-e266d82f5177@192.168.203.41@tcp t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:0.0:1788521197.854813:0:8434:0:(genops.c:1385:class_connect()) connect: client fc75e887-507e-4861-8203-e266d82f5177, cookie 0x411dd0ee4d2d12a3 00002000:00100000:0.0:1788521197.854828:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fc75e887-507e-4861-8203-e266d82f5177/ffff8fef7efd3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788521197.854840:0:8434:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788521197.855081:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788521197.855132:0:8434:0:(import.c:65:import_set_state_nolock()) ffff8fef7efd5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788521197.855203:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+6:2392:x1875400201341824:12345-192.168.203.41@tcp:8: Request processed in 465us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521197.855212:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 17 00000100:00100000:0.0:1788521197.863385:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521197.867929:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201341952 00000100:00100000:3.0:1788521197.867949:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201341952 00000100:00100000:3.0:1788521197.868034:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 4 00000100:00100000:3.0:1788521197.868048:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fc75e887-507e-4861-8203-e266d82f5177+6:6155:x1875400201341952:12345-192.168.203.41@tcp:900: 00000100:00100000:3.0:1788521197.868914:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fc75e887-507e-4861-8203-e266d82f5177+6:6155:x1875400201341952:12345-192.168.203.41@tcp:900: Request processed in 862us (5537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521197.868926:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 4 00000100:00100000:2.0:1788521197.869103:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521197.871451:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201342080 00000100:00100000:3.0:1788521197.871470:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201342080 00000100:00100000:3.0:1788521197.871559:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 200 00000100:00100000:3.0:1788521197.871572:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+10:2393:x1875400201342080:12345-192.168.203.41@tcp:400: 00000100:00100000:3.0:1788521197.871876:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+10:2393:x1875400201342080:12345-192.168.203.41@tcp:400: Request processed in 306us (2773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521197.871928:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 200 00000100:00100000:0.0:1788521197.872279:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521197.873294:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201342208 00000100:00100000:1.0:1788521197.873306:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201342208 00000100:00100000:1.0:1788521197.873374:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 0 00000100:00100000:1.0:1788521197.873385:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+6:6155:x1875400201342208:12345-192.168.203.41@tcp:33: 00000004:00080000:2.0:1788521197.921376:0:6522:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 47872us 00000004:00200000:2.0:1788521197.973074:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788521197.973250:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+6:6155:x1875400201342208:12345-192.168.203.41@tcp:33: Request processed in 99858us (100963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521197.973269:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 0 00000100:00100000:2.0:1788521198.221521:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222364032:0@lo:13: 00000100:00100000:2.0:1788521198.221631:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521198.221731:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788521198.221739:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222363904:0@lo:41: 00000100:00100000:2.0:1788521198.221769:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521198.221861:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222364032 00000100:00100000:1.0:1788521198.221872:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222364032 00000100:00100000:1.0:1788521198.221965:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788521198.221976:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222364032:12345-0@lo:13: 00002000:00000024:1.0:1788521198.222005:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521198.222063:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222364032:12345-0@lo:13: Request processed in 88us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521198.222071:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788521198.223685:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43494e00 x1875400222364032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521198.223717:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222364032:0@lo:13: 00000100:00100000:3.0:1788521198.224785:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222363904 00000100:00100000:3.0:1788521198.224799:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222363904 00000100:00100000:3.0:1788521198.224924:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788521198.224937:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222363904:12345-0@lo:41: 00000004:00000024:3.0:1788521198.224986:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788521198.225100:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222363904:12345-0@lo:41: Request processed in 166us (3329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521198.225108:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788521198.225208:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222363904:0@lo:41: 00000100:00100000:2.0:1788521198.266621:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521198.266740:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201342336 00000100:00100000:0.0:1788521198.266752:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201342336 00000100:00100000:0.0:1788521198.266829:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 13 00000100:00100000:0.0:1788521198.266840:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+6:6199:x1875400201342336:12345-192.168.203.41@tcp:101: 00010000:00010000:0.0:1788521198.266941:0:9815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521198.266977:0:9815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411400/0x411dd0ee4d2d12aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed4d5 expref: -99 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521198.267060:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d12b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521198.267077:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d12b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521198.267094:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d12b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521198.267153:0:9815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788521198.267157:0:9815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788521198.267174:0:9815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d12b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521198.267202:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411400/0x411dd0ee4d2d12aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed4d5 expref: 8 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521198.267235:0:9815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d12b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed4d5 expref: 7 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521198.267245:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fee42476f00) 00010000:00010000:0.0:1788521198.267248:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788521198.267253:0:9815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42410000, rc 0) 00000100:00100000:0.0:1788521198.267317:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+7:6199:x1875400201342336:12345-192.168.203.41@tcp:101: Request processed in 478us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521198.267324:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 13 00010000:00010000:0.0:1788521198.797805:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521199.821258:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521200.269213:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788521200.269251:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7ef88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222364160:0@lo:13: 00000100:00100000:3.0:1788521200.269374:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521200.269779:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222364160 00000100:00100000:3.0:1788521200.269791:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222364160 00000100:00100000:3.0:1788521200.270455:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788521200.270478:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222364160:12345-0@lo:13: 00002000:00000024:3.0:1788521200.270515:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788521200.270586:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222364160:12345-0@lo:13: Request processed in 120us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521200.270593:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788521200.270645:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7ef88700 x1875400222364160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521216 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521200.270668:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7ef88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222364160:0@lo:13: 00000100:00080000:0.0:1788521200.272156:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521200.279427:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788521200.279477:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222364288:0@lo:13: 00000100:00100000:0.0:1788521200.280214:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521200.280378:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222364288 00000100:00100000:3.0:1788521200.280389:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222364288 00000100:00100000:3.0:1788521200.280494:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788521200.280525:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222364288:12345-0@lo:13: 00002000:00000024:3.0:1788521200.280556:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788521200.280636:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222364288:12345-0@lo:13: Request processed in 115us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521200.280643:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788521200.280713:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788521200.280984:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43497480 x1875400222364288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521216 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521200.281010:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222364288:0@lo:13: 00000100:00100000:1.0:1788521200.366692:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521200.366865:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201342464 00000100:00100000:0.0:1788521200.366874:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201342464 00000100:00100000:0.0:1788521200.367042:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 14 00000100:00100000:0.0:1788521200.367053:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+7:6251:x1875400201342464:12345-192.168.203.41@tcp:41: 00000004:00000024:0.0:1788521200.367089:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788521200.367160:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+7:6251:x1875400201342464:12345-192.168.203.41@tcp:41: Request processed in 109us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521200.367168:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 14 00000100:00080000:2.0:1788521200.372251:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521200.375550:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521200.375666:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201342592 00000100:00100000:0.0:1788521200.375675:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201342592 00000100:00100000:0.0:1788521200.375763:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 15 00000100:00100000:0.0:1788521200.375774:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+6:6251:x1875400201342592:12345-192.168.203.41@tcp:41: 00000004:00000024:0.0:1788521200.375814:0:9815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788521200.375903:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+6:6251:x1875400201342592:12345-192.168.203.41@tcp:41: Request processed in 112us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521200.375911:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 15 00000100:00080000:2.0:1788521200.378300:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788521200.383040:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521200.383380:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201342720 00000100:00100000:1.0:1788521200.383391:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201342720 00000100:00100000:1.0:1788521200.383466:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 18 00000100:00100000:1.0:1788521200.383475:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fc75e887-507e-4861-8203-e266d82f5177+6:6251:x1875400201342720:12345-192.168.203.41@tcp:13: 00002000:00000024:1.0:1788521200.383501:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521200.383583:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fc75e887-507e-4861-8203-e266d82f5177+6:6251:x1875400201342720:12345-192.168.203.41@tcp:13: Request processed in 109us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521200.383590:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 18 00000100:00080000:2.0:1788521200.383764:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521200.386263:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521200.386459:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201342848 00000100:00100000:1.0:1788521200.386469:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201342848 00000100:00100000:1.0:1788521200.386549:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 19 00000100:00100000:1.0:1788521200.386560:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fc75e887-507e-4861-8203-e266d82f5177+6:6251:x1875400201342848:12345-192.168.203.41@tcp:13: 00002000:00000024:1.0:1788521200.386590:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521200.386676:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fc75e887-507e-4861-8203-e266d82f5177+6:6251:x1875400201342848:12345-192.168.203.41@tcp:13: Request processed in 118us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521200.386683:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 19 00000100:00080000:2.0:1788521200.387081:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788521200.846497:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788521201.825206:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fc75e887-507e-4861-8203-e266d82f5177 00010000:00010000:0.0:1788521201.869097:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521202.834015:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222364672:0@lo:400: 00000100:00100000:2.0:1788521202.834109:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521202.834176:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222365184:0@lo:400: 00000100:00100000:2.0:1788521202.834206:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521202.834226:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222365696:0@lo:400: 00000100:00100000:2.0:1788521202.834262:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521202.834283:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222366208:0@lo:400: 00000100:00100000:2.0:1788521202.834306:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521202.834344:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788521202.834350:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222364800:0@lo:400: 00000100:00100000:2.0:1788521202.834376:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521202.834395:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875400222365312:0@lo:400: 00000100:00100000:2.0:1788521202.835848:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521202.835925:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222365824:0@lo:400: 00000100:00100000:2.0:1788521202.835981:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521202.836036:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222365696 00000100:00100000:2.0:1788521202.836046:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222365696 00000100:00100000:2.0:1788521202.836114:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222366208 00000100:00100000:2.0:1788521202.836117:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222366208 00000100:00100000:2.0:1788521202.836143:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788521202.836153:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222365696:12345-0@lo:400: 00000100:00100000:2.0:1788521202.836213:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222365696:12345-0@lo:400: Request processed in 62us (1950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521202.836221:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788521202.836241:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788521202.836248:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43507480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222366208:12345-0@lo:400: 00000100:00100000:2.0:1788521202.836276:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43507480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222366208:12345-0@lo:400: Request processed in 29us (1969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521202.836294:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788521202.836323:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521202.836327:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788521202.836377:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef767d1500 x1875400222365696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521202.836394:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222365696:0@lo:400: 00010000:00080000:2.0:1788521202.836407:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee41aab800 x1875400222366208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521202.836735:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7ef8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222364416:0@lo:13: 00000100:00100000:0.0:1788521202.836776:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521202.836800:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222364928:0@lo:400: 00000100:00100000:0.0:1788521202.836826:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521202.836861:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875400222365440:0@lo:400: 00000100:00100000:3.0:1788521202.836864:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222365184 00000100:00100000:3.0:1788521202.836870:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222365184 00000100:00100000:0.0:1788521202.836898:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521202.836916:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222365952:0@lo:400: 00000100:00100000:3.0:1788521202.836922:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222364928 00000100:00100000:3.0:1788521202.836925:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222364928 00000100:00100000:0.0:1788521202.836936:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521202.836940:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788521202.836947:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222365184:12345-0@lo:400: 00000100:00100000:0.0:1788521202.836953:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788521202.836958:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222364544:0@lo:41: 00000100:00100000:0.0:1788521202.836978:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521202.836986:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222365184:12345-0@lo:400: Request processed in 40us (2779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521202.836988:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222365056:0@lo:400: 00000100:00100000:3.0:1788521202.836993:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788521202.837004:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222364544 00000100:00100000:3.0:1788521202.837007:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222364544 00000100:00100000:0.0:1788521202.837007:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521202.837017:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222365568:0@lo:400: 00000100:00100000:3.0:1788521202.837019:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788521202.837024:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1875400222364928:12345-0@lo:400: 00000100:00100000:0.0:1788521202.837038:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521202.837048:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1875400222364928:12345-0@lo:400: Request processed in 24us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521202.837053:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222366080:0@lo:400: 00000100:00100000:3.0:1788521202.837054:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788521202.837065:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788521202.837072:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521202.837095:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222364928:0@lo:400: 00000100:00100000:0.0:1788521202.837132:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222364672 00000100:00100000:0.0:1788521202.837137:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222364672 00000100:00100000:0.0:1788521202.837167:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788521202.837174:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3643:x1875400222364672:12345-0@lo:400: 00000100:00100000:0.0:1788521202.837206:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3643:x1875400222364672:12345-0@lo:400: Request processed in 34us (3098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521202.837213:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788521202.837243:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222365568 00000100:00100000:0.0:1788521202.837246:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222365568 00000100:00100000:0.0:1788521202.837269:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222366080 00000100:00100000:0.0:1788521202.837272:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222366080 00000100:00100000:0.0:1788521202.837287:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788521202.837503:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222366208:0@lo:400: 00000100:00100000:2.0:1788521202.837532:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222364672:0@lo:400: 00000100:00100000:2.0:1788521202.837544:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222365184:0@lo:400: 00000100:00100000:2.0:1788521202.837567:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788521202.837575:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222366080:12345-0@lo:400: 00000100:00100000:2.0:1788521202.837614:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222366080:12345-0@lo:400: Request processed in 41us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521202.837620:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788521202.837649:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee41aa9180 x1875400222366080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521202.837660:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222366080:0@lo:400: 00000100:00080000:2.0:1788521202.837676:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521202.837679:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521202.837852:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222364800 00000100:00100000:1.0:1788521202.837857:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222364800 00000100:00100000:1.0:1788521202.837909:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222365312 00000100:00100000:1.0:1788521202.837913:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222365312 00000100:00100000:1.0:1788521202.837936:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222365824 00000100:00100000:1.0:1788521202.837939:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222365824 00000100:00100000:1.0:1788521202.837953:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222365440 00000100:00100000:1.0:1788521202.837956:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222365440 00000100:00100000:1.0:1788521202.837968:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222365952 00000100:00100000:1.0:1788521202.837970:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222365952 00000100:00100000:1.0:1788521202.837983:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222365056 00000100:00100000:1.0:1788521202.837985:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222365056 00000100:00100000:1.0:1788521202.838000:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788521202.838006:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222364800:12345-0@lo:400: 00000100:00100000:1.0:1788521202.838053:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222364800:12345-0@lo:400: Request processed in 47us (3676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521202.838060:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788521202.838366:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222364544:12345-0@lo:41: 00000004:00000024:3.0:1788521202.838403:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788521202.838407:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222365568:12345-0@lo:400: 00000100:00100000:0.0:1788521202.838477:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222365568:12345-0@lo:400: Request processed in 1184us (1438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521202.838485:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788521202.838513:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788521202.838520:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875400222365312:12345-0@lo:400: 00000100:00100000:0.0:1788521202.838549:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875400222365312:12345-0@lo:400: Request processed in 31us (4133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521202.838556:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1788521202.838563:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef767d1180 x1875400222365568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521202.838569:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788521202.838574:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222365824:12345-0@lo:400: 00000100:00100000:2.0:1788521202.838576:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222365568:0@lo:400: 00000100:00100000:0.0:1788521202.838614:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222365824:12345-0@lo:400: Request processed in 39us (2633us total) trans 0 rc 0/0 00000100:00080000:2.0:1788521202.838619:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788521202.838620:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1788521202.838622:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521202.838670:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788521202.838679:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875400222365440:12345-0@lo:400: 00000100:00100000:0.0:1788521202.838810:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788521202.838820:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222365952:12345-0@lo:400: 00000100:00100000:0.0:1788521202.838865:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222365952:12345-0@lo:400: Request processed in 49us (1928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521202.838871:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788521202.838907:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788521202.838913:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222365056:12345-0@lo:400: 00000100:00100000:0.0:1788521202.838940:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222365056:12345-0@lo:400: Request processed in 28us (1931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521202.838945:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788521202.839054:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222365056:0@lo:400: 00010000:00080000:2.0:1788521202.839065:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee41aaad80 x1875400222365952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521202.839143:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222365952:0@lo:400: 00000100:00100000:1.0:1788521202.839476:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875400222365440:12345-0@lo:400: Request processed in 797us (2576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521202.839484:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788521202.839524:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222364416 00000100:00100000:1.0:1788521202.839531:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222364416 00000100:00100000:1.0:1788521202.839570:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788521202.839576:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222364416:12345-0@lo:13: 00002000:00000024:1.0:1788521202.839610:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521202.839644:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222364416:12345-0@lo:13: Request processed in 68us (2868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521202.839651:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788521202.839985:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222364800:0@lo:400: 00000100:00100000:1.0:1788521202.840000:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875400222365312:0@lo:400: 00000100:00100000:1.0:1788521202.840012:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222365824:0@lo:400: 00000100:00100000:3.0:1788521202.840806:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222364544:12345-0@lo:41: Request processed in 3729us (3821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521202.840826:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1788521202.847186:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef767d0a80 x1875400222365440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521202.847210:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875400222365440:0@lo:400: 00000100:00100000:2.0:1788521202.847254:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222364544:0@lo:41: 00010000:00080000:2.0:1788521202.847266:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7ef8bb80 x1875400222364416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521202.847277:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7ef8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222364416:0@lo:13: 00000001:00100000:1.0:1788521202.850034:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fc75e887-507e-4861-8203-e266d82f5177 00000001:00100000:2.0:1788521202.856472:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fc75e887-507e-4861-8203-e266d82f5177 00010000:00010000:2.0:1788521202.896625:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788521203.204849:0:10186:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788521203.304610:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521203.304670:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521203.304724:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521203.304744:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521203.304774:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521203.304807:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201343104 00000100:00100000:0.0:1788521203.304819:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201343104 00000100:00100000:0.0:1788521203.304920:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201343232 00000100:00100000:0.0:1788521203.304924:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201343232 00000100:00100000:0.0:1788521203.304950:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 60 00000100:00100000:0.0:1788521203.304961:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+6:2395:x1875400201343104:12345-192.168.203.41@tcp:400: 00000100:00100000:0.0:1788521203.305055:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+6:2395:x1875400201343104:12345-192.168.203.41@tcp:400: Request processed in 95us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521203.305062:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 60 00000100:00100000:0.0:1788521203.305093:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 61 00000100:00100000:0.0:1788521203.305100:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201343232:12345-192.168.203.41@tcp:400: 00000100:00100000:0.0:1788521203.305126:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201343232:12345-192.168.203.41@tcp:400: Request processed in 26us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521203.305132:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 61 00000100:00100000:0.0:1788521203.305152:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201343360 00000100:00100000:0.0:1788521203.305156:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201343360 00000100:00100000:0.0:1788521203.305191:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201343488 00000100:00100000:0.0:1788521203.305194:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201343488 00000100:00100000:0.0:1788521203.305213:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 16 00000100:00100000:0.0:1788521203.305218:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+6:2395:x1875400201343360:12345-192.168.203.41@tcp:400: 00000100:00100000:0.0:1788521203.305244:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+6:2395:x1875400201343360:12345-192.168.203.41@tcp:400: Request processed in 26us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521203.305250:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 16 00000100:00100000:0.0:1788521203.305261:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 17 00000100:00100000:0.0:1788521203.305276:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201343488:12345-192.168.203.41@tcp:400: 00000100:00100000:0.0:1788521203.305302:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201343488:12345-192.168.203.41@tcp:400: Request processed in 27us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521203.305317:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 17 00000100:00080000:0.0:1788521203.305334:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521203.305339:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788521203.305342:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788521203.305344:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521203.305494:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201342976 00000100:00100000:3.0:1788521203.305499:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201342976 00000100:00100000:3.0:1788521203.305544:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 202 00000100:00100000:3.0:1788521203.305555:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+10:2395:x1875400201342976:12345-192.168.203.41@tcp:400: 00000100:00100000:3.0:1788521203.305583:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+10:2395:x1875400201342976:12345-192.168.203.41@tcp:400: Request processed in 31us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521203.305588:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 202 00000100:00100000:2.0:1788521203.343521:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521203.343555:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222366336:0@lo:13: 00000100:00100000:2.0:1788521203.343659:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521203.343737:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222366336 00000100:00100000:2.0:1788521203.343747:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222366336 00000100:00100000:2.0:1788521203.343806:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788521203.343816:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222366336:12345-0@lo:13: 00002000:00000024:2.0:1788521203.343844:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521203.343916:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222366336:12345-0@lo:13: Request processed in 101us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521203.343933:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788521203.343987:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43507100 x1875400222366336/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521203.344009:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222366336:0@lo:13: 00000100:00100000:3.0:1788521203.345229:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222366464:0@lo:41: 00000100:00100000:3.0:1788521203.345301:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521203.349201:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222366464 00000100:00100000:0.0:1788521203.349222:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222366464 00000100:00100000:0.0:1788521203.349360:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788521203.349373:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222366464:12345-0@lo:41: 00000004:00000024:0.0:1788521203.349447:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788521203.353230:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222366464:12345-0@lo:41: Request processed in 3844us (7912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521203.353252:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788521203.353790:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222366464:0@lo:41: 00000001:00100000:0.0:1788521203.856020:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fc75e887-507e-4861-8203-e266d82f5177 00010000:00010000:2.0:1788521203.919696:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521204.941000:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521205.389951:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222366592:0@lo:13: 00000100:00100000:2.0:1788521205.390017:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521205.390128:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222366592 00000100:00100000:1.0:1788521205.390137:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222366592 00000100:00100000:1.0:1788521205.390196:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788521205.390205:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222366592:12345-0@lo:13: 00002000:00000024:1.0:1788521205.390234:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521205.390279:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222366592:12345-0@lo:13: Request processed in 76us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521205.390287:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788521205.390415:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788521205.390446:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43495180 x1875400222366592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521221 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521205.390475:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222366592:0@lo:13: 00000100:00100000:3.0:1788521205.390823:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788521205.395800:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222366720:0@lo:13: 00000100:00100000:3.0:1788521205.396078:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521205.401025:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222366720 00000100:00100000:1.0:1788521205.401043:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222366720 00000100:00100000:0.0:1788521205.403727:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788521205.403740:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222366720:12345-0@lo:13: 00002000:00000024:0.0:1788521205.403767:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521205.403858:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222366720:12345-0@lo:13: Request processed in 121us (7780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521205.403865:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788521205.403927:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43497100 x1875400222366720/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521221 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521205.403947:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222366720:0@lo:13: 00000100:00080000:2.0:1788521205.404174:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788521205.971969:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521206.989356:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788521207.279175:0:10333:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffeb1eb730 20000000:00000080:1.0:1788521207.279192:0:10333:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8fee433a4000 uarg=0000000000000000 20000000:01000000:1.0:1788521207.279230:0:10333:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788521207.279232:0:10333:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788521207.279235:0:10333:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788521207.279240:0:10333:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788521207.279245:0:10333:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788521207.279322:0:10333:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788521207.279325:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788521207.286383:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1788521207.287493:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1788521207.288018:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1788521207.288040:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1788521207.288056:0:10333:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788521207.288060:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788521207.288704:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1788521207.291180:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1788521207.291215:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1788521207.291229:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1788521207.291240:0:10333:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788521207.291243:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788521207.295470:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1788521207.301026:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1788521207.301401:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1788521207.301421:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:1.0:1788521207.301436:0:10333:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788521207.301439:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788521207.303719:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1788521207.304621:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:1.0:1788521207.304653:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:1.0:1788521207.304669:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:1.0:1788521207.304679:0:10333:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788521207.304682:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788521207.318404:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:0.0:1788521207.327118:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:0.0:1788521207.327154:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:0.0:1788521207.327168:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 10000000:01000000:0.0:1788521207.327191:0:10333:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788521207.327209:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fee42411200/0x411dd0ee4d2d12b8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521207.327228:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef821dd600/0x411dd0ee4d2d1153 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d114c expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521207.327236:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef821ddc00/0x411dd0ee4d2d117d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1176 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521207.327244:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d11bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d11b5 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521207.327251:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d11ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d11c3 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521207.327258:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef413fc800/0x411dd0ee4d2d11d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d11d1 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521207.327275:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef413fda00/0x411dd0ee4d2d11f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d11ed expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521207.327291:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef821dc000/0x411dd0ee4d2d121e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1210 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521207.327316:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef821dd800/0x411dd0ee4d2d123a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1233 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521207.327324:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef4167fa00/0x411dd0ee4d2d1264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d125d expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521207.327334:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fee42411a00/0x411dd0ee4d2d1272 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed465 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521207.327341:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef4167fc00/0x411dd0ee4d2d1279 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed46c expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521207.327348:0:10333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fee42411200/0x411dd0ee4d2d12b8 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521207.327387:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef4167fc00/0x411dd0ee4d2d1279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed46c expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521207.327401:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fef4167fc00/0x411dd0ee4d2d1279 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed46c expref: 9 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521207.327416:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1875400222366848:192.168.203.41@tcp:104: 00010000:00010000:0.0:1788521207.327538:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fee42411a00/0x411dd0ee4d2d1272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed465 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521207.327546:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fee42411a00/0x411dd0ee4d2d1272 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed465 expref: 9 pid: 6514 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521207.327554:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1875400222366976:192.168.203.41@tcp:104: 00010000:00010000:0.0:1788521207.327595:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef4167fa00/0x411dd0ee4d2d1264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d125d expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521207.327604:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef4167fa00/0x411dd0ee4d2d1264 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d125d expref: 23 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521207.327612:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1875400222367104:0@lo:104: 00000100:00100000:0.0:1788521207.327647:0:10333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788521207.327686:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef821dd800/0x411dd0ee4d2d123a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d1233 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521207.327695:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef821dd800/0x411dd0ee4d2d123a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1233 expref: 23 pid: 6514 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521207.327703:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1875400222367232:0@lo:104: 00000100:00100000:0.0:1788521207.327725:0:10333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788521207.327750:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef821dc000/0x411dd0ee4d2d121e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d1210 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521207.327758:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef821dc000/0x411dd0ee4d2d121e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1210 expref: 23 pid: 6512 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521207.327765:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1875400222367360:0@lo:104: 00000100:00100000:0.0:1788521207.327785:0:10333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788521207.327804:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef413fda00/0x411dd0ee4d2d11f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d11ed expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521207.327812:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef413fda00/0x411dd0ee4d2d11f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d11ed expref: 23 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521207.327831:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1875400222367488:0@lo:104: 00000100:00100000:0.0:1788521207.327854:0:10333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788521207.327917:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef413fc800/0x411dd0ee4d2d11d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d11d1 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521207.327925:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef413fc800/0x411dd0ee4d2d11d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d11d1 expref: 23 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521207.327933:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1875400222367616:0@lo:104: 00010000:00010000:0.0:1788521207.327962:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d11ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d11c3 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521207.327969:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d11ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d11c3 expref: 23 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521207.327978:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43258000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1875400222367744:0@lo:104: 00010000:00010000:0.0:1788521207.327999:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d11bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d11b5 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521207.328006:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d11bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d11b5 expref: 23 pid: 6514 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521207.328014:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43258700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1875400222367872:0@lo:104: 00010000:00010000:0.0:1788521207.328033:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef821ddc00/0x411dd0ee4d2d117d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d1176 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521207.328040:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef821ddc00/0x411dd0ee4d2d117d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1176 expref: 23 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521207.328059:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43258e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1875400222368000:0@lo:104: 00010000:00010000:0.0:1788521207.328106:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef821dd600/0x411dd0ee4d2d1153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d114c expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521207.328113:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef821dd600/0x411dd0ee4d2d1153 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d114c expref: 23 pid: 6514 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521207.328122:0:10333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ec380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1875400222368128:0@lo:104: 00000100:00100000:0.0:1788521207.328141:0:10333:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef42ec6240 going to sleep for 11 seconds 00000100:00100000:2.0:1788521207.328295:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788521207.328315:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521207.328335:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521207.328343:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521207.328352:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521207.328360:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521207.328368:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222367104 00000100:00100000:2.0:1788521207.328374:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222367104 00000100:00100000:2.0:1788521207.328409:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222367232 00000100:00100000:2.0:1788521207.328412:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222367232 00000100:00100000:2.0:1788521207.328424:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222367360 00000100:00100000:2.0:1788521207.328426:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222367360 00000100:00100000:2.0:1788521207.328435:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222367488 00000100:00100000:2.0:1788521207.328438:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222367488 00000100:00100000:2.0:1788521207.328447:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222367616 00000100:00100000:2.0:1788521207.328449:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222367616 00000100:00100000:2.0:1788521207.328458:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222367744 00000100:00100000:2.0:1788521207.328460:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222367744 00000100:00100000:2.0:1788521207.328469:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222367872 00000100:00100000:2.0:1788521207.328471:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222367872 00000100:00100000:2.0:1788521207.328480:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222368000 00000100:00100000:2.0:1788521207.328483:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222368000 00000100:00100000:2.0:1788521207.328491:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222368128 00000100:00100000:2.0:1788521207.328493:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222368128 00000100:00100000:2.0:1788521207.328505:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788521207.328513:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+11:10333:x1875400222367104:12345-0@lo:104: 00010000:00010000:2.0:1788521207.328527:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef4167f800/0x411dd0ee4d2d125d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d1264 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.328579:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788521207.328584:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+11:10333:x1875400222367104:12345-0@lo:104: Request processed in 72us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521207.328591:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788521207.328607:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788521207.328620:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+10:10333:x1875400222367232:12345-0@lo:104: 00010000:00010000:2.0:1788521207.328629:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fee42411600/0x411dd0ee4d2d1233 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d123a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.328663:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788521207.328668:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+10:10333:x1875400222367232:12345-0@lo:104: Request processed in 50us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521207.328674:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788521207.328688:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788521207.328694:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+9:10333:x1875400222367360:12345-0@lo:104: 00010000:00010000:2.0:1788521207.328702:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef749caa00/0x411dd0ee4d2d1210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d121e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.328730:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788521207.328735:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+9:10333:x1875400222367360:12345-0@lo:104: Request processed in 43us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521207.328741:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788521207.328753:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788521207.328759:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef4f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+8:10333:x1875400222367488:12345-0@lo:104: 00010000:00010000:2.0:1788521207.328766:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef749ca200/0x411dd0ee4d2d11ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d11f4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.328791:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788521207.328796:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef4f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+8:10333:x1875400222367488:12345-0@lo:104: Request processed in 38us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521207.328801:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788521207.328831:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788521207.328844:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43504380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+7:10333:x1875400222367616:12345-0@lo:104: 00010000:00010000:2.0:1788521207.328852:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef40030e00/0x411dd0ee4d2d11d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d11d8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.328879:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788521207.328906:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43504380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+7:10333:x1875400222367616:12345-0@lo:104: Request processed in 64us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521207.328912:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788521207.328925:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788521207.328930:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43506300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+6:10333:x1875400222367744:12345-0@lo:104: 00010000:00010000:2.0:1788521207.328937:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d11c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d11ca expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.328962:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788521207.328967:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43506300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+6:10333:x1875400222367744:12345-0@lo:104: Request processed in 37us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521207.328972:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788521207.328985:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788521207.328990:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43504700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+5:10333:x1875400222367872:12345-0@lo:104: 00010000:00010000:2.0:1788521207.328997:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef749cbc00/0x411dd0ee4d2d11b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d11bc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329021:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1788521207.329025:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43504700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+5:10333:x1875400222367872:12345-0@lo:104: Request processed in 36us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521207.329031:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788521207.329043:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788521207.329056:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43506680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+4:10333:x1875400222368000:12345-0@lo:104: 00010000:00010000:2.0:1788521207.329063:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef40030200/0x411dd0ee4d2d1176 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d117d expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329091:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:2.0:1788521207.329096:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43506680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+4:10333:x1875400222368000:12345-0@lo:104: Request processed in 42us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521207.329102:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788521207.329259:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788521207.329266:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43507b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:10333:x1875400222368128:12345-0@lo:104: 00010000:00010000:2.0:1788521207.329274:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef749cbe00/0x411dd0ee4d2d114c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d1153 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329316:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:2.0:1788521207.329321:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43507b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:10333:x1875400222368128:12345-0@lo:104: Request processed in 56us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521207.329326:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1788521207.329346:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1788521207.329352:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef4167f800/0x411dd0ee4d2d125d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d1264 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329359:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef4167f800 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:2.0:1788521207.329364:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef4167f800/0x411dd0ee4d2d125d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d1264 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329373:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef4167f800/0x411dd0ee4d2d125d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d1264 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521207.329381:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef4167f800/0x411dd0ee4d2d125d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d1264 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521207.329394:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788521207.329421:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef4167f800/0x411dd0ee4d2d125d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d1264 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329428:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521207.329449:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef4167f800/0x411dd0ee4d2d125d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d1264 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329456:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef4167f800/0x411dd0ee4d2d125d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d1264 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329470:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1788521207.329474:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fee42411600/0x411dd0ee4d2d1233 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d123a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329480:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42411600 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:2.0:1788521207.329483:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fee42411600/0x411dd0ee4d2d1233 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d123a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329490:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fee42411600/0x411dd0ee4d2d1233 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d123a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521207.329496:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fee42411600/0x411dd0ee4d2d1233 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d123a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521207.329511:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788521207.329525:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fee42411600/0x411dd0ee4d2d1233 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d123a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329532:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521207.329558:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fee42411600/0x411dd0ee4d2d1233 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d123a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329566:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fee42411600/0x411dd0ee4d2d1233 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d123a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329575:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788521207.329578:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef749caa00/0x411dd0ee4d2d1210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d121e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329584:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749caa00 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:2.0:1788521207.329587:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef749caa00/0x411dd0ee4d2d1210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d121e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329594:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef749caa00/0x411dd0ee4d2d1210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d121e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521207.329600:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef749caa00/0x411dd0ee4d2d1210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d121e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521207.329606:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788521207.329620:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef749caa00/0x411dd0ee4d2d1210 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d121e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329625:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521207.329631:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef749caa00/0x411dd0ee4d2d1210 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d121e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329637:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef749caa00/0x411dd0ee4d2d1210 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d121e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329646:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788521207.329655:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef749ca200/0x411dd0ee4d2d11ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d11f4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329661:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749ca200 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:2.0:1788521207.329664:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef749ca200/0x411dd0ee4d2d11ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d11f4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329670:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef749ca200/0x411dd0ee4d2d11ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d11f4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521207.329677:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef749ca200/0x411dd0ee4d2d11ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d11f4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521207.329682:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788521207.329696:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef749ca200/0x411dd0ee4d2d11ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d11f4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329702:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521207.329707:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef749ca200/0x411dd0ee4d2d11ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d11f4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329713:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef749ca200/0x411dd0ee4d2d11ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d11f4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329721:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788521207.329724:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef40030e00/0x411dd0ee4d2d11d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d11d8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329730:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40030e00 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:2.0:1788521207.329733:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef40030e00/0x411dd0ee4d2d11d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d11d8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329750:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef40030e00/0x411dd0ee4d2d11d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d11d8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521207.329756:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef40030e00/0x411dd0ee4d2d11d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d11d8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521207.329761:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788521207.329774:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef40030e00/0x411dd0ee4d2d11d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d11d8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329780:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521207.329784:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef40030e00/0x411dd0ee4d2d11d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d11d8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329791:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef40030e00/0x411dd0ee4d2d11d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d11d8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329800:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788521207.329803:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d11c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d11ca expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329808:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40031a00 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:2.0:1788521207.329810:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d11c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d11ca expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329817:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d11c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d11ca expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521207.329823:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d11c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d11ca expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521207.329835:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788521207.329849:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d11c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d11ca expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329855:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521207.329859:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d11c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d11ca expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329866:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d11c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d11ca expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329876:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788521207.329880:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef749cbc00/0x411dd0ee4d2d11b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d11bc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329905:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cbc00 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:2.0:1788521207.329909:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef749cbc00/0x411dd0ee4d2d11b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d11bc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329916:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef749cbc00/0x411dd0ee4d2d11b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d11bc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521207.329923:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef749cbc00/0x411dd0ee4d2d11b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d11bc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521207.329929:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788521207.329941:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef749cbc00/0x411dd0ee4d2d11b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d11bc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329947:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521207.329957:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef749cbc00/0x411dd0ee4d2d11b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d11bc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329963:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef749cbc00/0x411dd0ee4d2d11b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d11bc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329972:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788521207.329975:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef40030200/0x411dd0ee4d2d1176 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d117d expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329981:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40030200 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:2.0:1788521207.329983:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef40030200/0x411dd0ee4d2d1176 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d117d expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.329990:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef40030200/0x411dd0ee4d2d1176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d117d expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521207.329996:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef40030200/0x411dd0ee4d2d1176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d117d expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521207.330001:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788521207.330014:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef40030200/0x411dd0ee4d2d1176 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d117d expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.330020:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521207.330024:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef40030200/0x411dd0ee4d2d1176 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d117d expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.330031:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef40030200/0x411dd0ee4d2d1176 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d117d expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.330039:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521207.330048:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef749cbe00/0x411dd0ee4d2d114c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d1153 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.330054:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cbe00 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:2.0:1788521207.330057:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef749cbe00/0x411dd0ee4d2d114c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d1153 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.330064:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef749cbe00/0x411dd0ee4d2d114c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d1153 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521207.330070:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef749cbe00/0x411dd0ee4d2d114c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d1153 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521207.330075:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788521207.330088:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef749cbe00/0x411dd0ee4d2d114c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d1153 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.330094:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521207.330098:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef749cbe00/0x411dd0ee4d2d114c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d1153 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.331731:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521207.331920:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef749cbe00/0x411dd0ee4d2d114c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d1153 expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.331944:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521207.331946:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521207.331948:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521207.331955:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521207.331973:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222368256:0@lo:103: 00000100:00100000:2.0:1788521207.332025:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521207.332059:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222368768:0@lo:103: 00000100:00100000:2.0:1788521207.332097:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521207.332127:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4325b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222369280:0@lo:103: 00000100:00100000:2.0:1788521207.332148:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521207.332171:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788521207.332178:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222368640:0@lo:103: 00000100:00100000:2.0:1788521207.332198:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521207.332207:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222369152:0@lo:103: 00000100:00100000:2.0:1788521207.332224:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521207.332247:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222368512:0@lo:103: 00000100:00100000:2.0:1788521207.332286:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521207.332297:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222369024:0@lo:103: 00000100:00100000:2.0:1788521207.332313:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521207.332323:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788521207.332327:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222368384:0@lo:103: 00000100:00100000:2.0:1788521207.332341:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521207.332348:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222368896:0@lo:103: 00000100:00100000:2.0:1788521207.332375:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521207.332397:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222368256 00000100:00100000:2.0:1788521207.332403:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222368256 00010000:00010000:2.0:1788521207.332431:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef4167fa00/0x411dd0ee4d2d1264 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d125d expref: 24 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521207.332983:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1875400222367104:0@lo:104: 00000100:00100000:0.0:1788521207.332994:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1875400222367232:0@lo:104: 00000100:00100000:0.0:1788521207.333002:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1875400222367360:0@lo:104: 00000100:00100000:0.0:1788521207.333011:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1875400222367488:0@lo:104: 00000100:00100000:0.0:1788521207.333019:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1875400222367616:0@lo:104: 00000100:00100000:0.0:1788521207.333026:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43258000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1875400222367744:0@lo:104: 00000100:00100000:0.0:1788521207.333033:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43258700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1875400222367872:0@lo:104: 00000100:00100000:0.0:1788521207.333051:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43258e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1875400222368000:0@lo:104: 00000100:00100000:0.0:1788521207.333060:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ec380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1875400222368128:0@lo:104: 00000100:00100000:1.0:1788521207.333124:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222368768 00000100:00100000:1.0:1788521207.333129:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222368768 00010000:00010000:1.0:1788521207.333150:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef413fc800/0x411dd0ee4d2d11d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d11d1 expref: 25 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521207.333164:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222369280 00000100:00100000:1.0:1788521207.333167:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222369280 00010000:00010000:1.0:1788521207.333177:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef821dd600/0x411dd0ee4d2d1153 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d114c expref: 26 pid: 6514 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521207.333188:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222368640 00000100:00100000:1.0:1788521207.333191:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222368640 00010000:00010000:1.0:1788521207.333201:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef413fda00/0x411dd0ee4d2d11f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d11ed expref: 27 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521207.333210:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222369152 00000100:00100000:1.0:1788521207.333213:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222369152 00010000:00010000:1.0:1788521207.333237:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef821ddc00/0x411dd0ee4d2d117d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1176 expref: 28 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521207.333249:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222368512 00000100:00100000:1.0:1788521207.333269:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222368512 00010000:00010000:1.0:1788521207.333291:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef821dc000/0x411dd0ee4d2d121e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1210 expref: 29 pid: 6512 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521207.333303:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222369024 00000100:00100000:1.0:1788521207.333305:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222369024 00010000:00010000:1.0:1788521207.333315:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d11bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d11b5 expref: 30 pid: 6514 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521207.333323:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222368384 00000100:00100000:1.0:1788521207.333326:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222368384 00010000:00010000:1.0:1788521207.333334:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef821dd800/0x411dd0ee4d2d123a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1233 expref: 31 pid: 6514 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521207.333343:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222368896 00000100:00100000:1.0:1788521207.333345:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222368896 00010000:00010000:1.0:1788521207.333352:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d11ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d11c3 expref: 32 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521207.333363:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788521207.333370:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6d47b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+32:3644:x1875400222368256:12345-0@lo:103: 00010000:00010000:1.0:1788521207.333382:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521207.333386:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef4167fa00/0x411dd0ee4d2d1264 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d125d expref: 32 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.333395:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef4167fa00/0x411dd0ee4d2d1264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d125d expref: 32 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.333411:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef4167fa00/0x411dd0ee4d2d1264 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d125d expref: 32 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.333425:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521207.333490:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6d47b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+31:3644:x1875400222368256:12345-0@lo:103: Request processed in 119us (1464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521207.333497:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788521207.333548:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788521207.333553:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+30:3644:x1875400222368768:12345-0@lo:103: 00010000:00010000:1.0:1788521207.333561:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521207.333565:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef413fc800/0x411dd0ee4d2d11d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d11d1 expref: 30 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.333574:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef413fc800/0x411dd0ee4d2d11d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d11d1 expref: 30 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.333582:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef413fc800/0x411dd0ee4d2d11d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d11d1 expref: 30 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.333592:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521207.333614:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+29:3644:x1875400222368768:12345-0@lo:103: Request processed in 60us (1515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521207.333619:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788521207.333633:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788521207.333639:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+28:3644:x1875400222369280:12345-0@lo:103: 00010000:00010000:1.0:1788521207.333645:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521207.333650:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef821dd600/0x411dd0ee4d2d1153 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d114c expref: 28 pid: 6514 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.333657:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef821dd600/0x411dd0ee4d2d1153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d114c expref: 28 pid: 6514 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.333665:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef821dd600/0x411dd0ee4d2d1153 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d114c expref: 28 pid: 6514 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.333680:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521207.333703:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+27:3644:x1875400222369280:12345-0@lo:103: Request processed in 64us (1554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521207.333709:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788521207.333721:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788521207.333726:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+26:3644:x1875400222368640:12345-0@lo:103: 00010000:00010000:1.0:1788521207.333732:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521207.333736:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef413fda00/0x411dd0ee4d2d11f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d11ed expref: 26 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.333744:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef413fda00/0x411dd0ee4d2d11f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d11ed expref: 26 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.333754:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef413fda00/0x411dd0ee4d2d11f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d11ed expref: 26 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.333764:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521207.333785:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+25:3644:x1875400222368640:12345-0@lo:103: Request processed in 59us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521207.333791:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788521207.333803:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788521207.333808:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3644:x1875400222369152:12345-0@lo:103: 00010000:00010000:1.0:1788521207.333815:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521207.333819:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef821ddc00/0x411dd0ee4d2d117d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1176 expref: 24 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.333827:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef821ddc00/0x411dd0ee4d2d117d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1176 expref: 24 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.333844:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef821ddc00/0x411dd0ee4d2d117d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d1176 expref: 24 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.333852:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521207.334234:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:3644:x1875400222369152:12345-0@lo:103: Request processed in 424us (2007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521207.334241:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788521207.334255:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788521207.334273:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:3646:x1875400222368512:12345-0@lo:103: 00010000:00010000:1.0:1788521207.334290:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521207.334295:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef821dc000/0x411dd0ee4d2d121e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1210 expref: 22 pid: 6512 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.334304:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef821dc000/0x411dd0ee4d2d121e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1210 expref: 22 pid: 6512 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.334314:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef821dc000/0x411dd0ee4d2d121e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d1210 expref: 22 pid: 6512 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.334324:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521207.334356:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:3646:x1875400222368512:12345-0@lo:103: Request processed in 84us (2076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521207.334363:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788521207.334375:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788521207.334381:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:3646:x1875400222369024:12345-0@lo:103: 00010000:00010000:1.0:1788521207.334389:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521207.334393:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d11bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d11b5 expref: 20 pid: 6514 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.334408:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d11bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d11b5 expref: 20 pid: 6514 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.334418:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d11bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d11b5 expref: 20 pid: 6514 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.334428:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521207.334463:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+19:3646:x1875400222369024:12345-0@lo:103: Request processed in 82us (2148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521207.334470:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788521207.334483:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788521207.334489:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4e7e1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:3646:x1875400222368384:12345-0@lo:103: 00010000:00010000:1.0:1788521207.334496:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521207.334500:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef821dd800/0x411dd0ee4d2d123a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1233 expref: 18 pid: 6514 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521207.334821:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222368640:0@lo:103: 00000100:00100000:0.0:1788521207.334831:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222369152:0@lo:103: 00000100:00100000:0.0:1788521207.334839:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222368256:0@lo:103: 00000100:00100000:0.0:1788521207.334848:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43505880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222368768:0@lo:103: 00010000:00010000:1.0:1788521207.334940:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef821dd800/0x411dd0ee4d2d123a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1233 expref: 18 pid: 6514 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.334953:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef821dd800/0x411dd0ee4d2d123a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d1233 expref: 18 pid: 6514 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.334963:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521207.334990:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4e7e1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:3646:x1875400222368384:12345-0@lo:103: Request processed in 502us (2647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521207.334997:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788521207.335031:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788521207.335362:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4325b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222369280:0@lo:103: 00000100:00100000:1.0:1788521207.335420:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43519f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:3646:x1875400222368896:12345-0@lo:103: 00010000:00010000:1.0:1788521207.335438:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521207.335444:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d11ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d11c3 expref: 16 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.335580:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d11ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d11c3 expref: 16 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.335592:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d11ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d11c3 expref: 16 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.335602:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521207.335631:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43519f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:3646:x1875400222368896:12345-0@lo:103: Request processed in 593us (3254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521207.335637:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788521207.335669:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222368384:0@lo:103: 00000100:00100000:1.0:1788521207.335676:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43507100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222368896:0@lo:103: 00000100:00100000:1.0:1788521207.335684:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43506a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222368512:0@lo:103: 00000100:00100000:1.0:1788521207.335690:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222369024:0@lo:103: 00000100:00100000:1.0:1788521207.339341:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521207.339423:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521207.339462:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201343744 00000100:00100000:1.0:1788521207.339471:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201343744 00010000:00010000:1.0:1788521207.339521:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fee42411a00/0x411dd0ee4d2d1272 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed465 expref: 10 pid: 6514 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521207.339552:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201343616 00000100:00100000:1.0:1788521207.339555:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201343616 00010000:00010000:1.0:1788521207.339582:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef4167fc00/0x411dd0ee4d2d1279 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed46c expref: 11 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521207.339598:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 33 00000100:00100000:1.0:1788521207.339606:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43495500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f234d90e-c25e-4162-a7b5-1cc50583b917+11:2396:x1875400201343744:12345-192.168.203.41@tcp:103: 00010000:00010000:1.0:1788521207.339619:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521207.339625:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fee42411a00/0x411dd0ee4d2d1272 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed465 expref: 11 pid: 6514 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.339637:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fee42411a00/0x411dd0ee4d2d1272 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed465 expref: 11 pid: 6514 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.339657:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521207.339701:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43495500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f234d90e-c25e-4162-a7b5-1cc50583b917+11:2396:x1875400201343744:12345-192.168.203.41@tcp:103: Request processed in 96us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521207.339708:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 33 00000100:00100000:1.0:1788521207.339727:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 34 00000100:00100000:1.0:1788521207.339733:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43497100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f234d90e-c25e-4162-a7b5-1cc50583b917+10:2396:x1875400201343616:12345-192.168.203.41@tcp:103: 00010000:00010000:1.0:1788521207.339741:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521207.339746:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef4167fc00/0x411dd0ee4d2d1279 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed46c expref: 10 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.339755:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef4167fc00/0x411dd0ee4d2d1279 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed46c expref: 10 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.339767:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fee42411200/0x411dd0ee4d2d12b8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.339776:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fee42411200/0x411dd0ee4d2d12b8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.339798:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fee42411200/0x411dd0ee4d2d12b8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.339807:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fee42411200/0x411dd0ee4d2d12b8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.339813:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fee42411200/0x411dd0ee4d2d12b8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.339820:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fee42411200/0x411dd0ee4d2d12b8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.339826:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42411200 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:1.0:1788521207.339830:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fee42411200/0x411dd0ee4d2d12b8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.339838:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fee42411200/0x411dd0ee4d2d12b8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.339847:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fee42411200/0x411dd0ee4d2d12b8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521207.339870:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521207.339914:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43497100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f234d90e-c25e-4162-a7b5-1cc50583b917+10:2396:x1875400201343616:12345-192.168.203.41@tcp:103: Request processed in 181us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521207.339920:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 34 00010000:00010000:2.0:1788521207.340081:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef4167fc00/0x411dd0ee4d2d1279 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed46c expref: 9 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521207.340096:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1875400222366848:192.168.203.41@tcp:104: 00010000:00010000:2.0:1788521207.340118:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fee42411a00/0x411dd0ee4d2d1272 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed465 expref: 8 pid: 6514 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521207.340128:0:10333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1875400222366976:192.168.203.41@tcp:104: 00010000:00010000:2.0:1788521207.340177:0:10333:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fee42411200/0x411dd0ee4d2d12b8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.340187:0:10333:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fee42411200/0x411dd0ee4d2d12b8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.340193:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fee42411200/0x411dd0ee4d2d12b8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521207.340199:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fee42411200/0x411dd0ee4d2d12b8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521207.949367:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222369408:0@lo:400: 00000100:00100000:0.0:1788521207.949437:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222369792:0@lo:400: 00000100:00100000:2.0:1788521207.949446:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521207.949518:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222369920:0@lo:400: 00000100:00100000:2.0:1788521207.949548:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521207.949566:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222370432:0@lo:400: 00000100:00100000:0.0:1788521207.949578:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521207.949593:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521207.949605:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222370304:0@lo:400: 00000100:00100000:2.0:1788521207.949621:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222370944:0@lo:400: 00000100:00100000:0.0:1788521207.949648:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521207.949660:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222369664:0@lo:400: 00000100:00100000:0.0:1788521207.949680:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222370816:0@lo:400: 00000100:00100000:3.0:1788521207.949739:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222369920 00000100:00100000:3.0:1788521207.949746:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222369920 00000100:00100000:3.0:1788521207.949807:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788521207.949816:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4351b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222369920:12345-0@lo:400: 00000100:00100000:2.0:1788521207.950404:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521207.950430:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222370176:0@lo:400: 00000100:00100000:2.0:1788521207.950454:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521207.950491:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875400222370688:0@lo:400: 00000100:00100000:2.0:1788521207.950525:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521207.950564:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222369408 00000100:00100000:2.0:1788521207.950569:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222369408 00000100:00100000:2.0:1788521207.950600:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788521207.950608:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:3645:x1875400222369408:12345-0@lo:400: 00000100:00100000:2.0:1788521207.950642:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:3645:x1875400222369408:12345-0@lo:400: Request processed in 35us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521207.950648:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788521207.950682:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222370432 00000100:00100000:2.0:1788521207.950686:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222370432 00000100:00100000:2.0:1788521207.950717:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222370304 00000100:00100000:2.0:1788521207.950720:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222370304 00000100:00100000:2.0:1788521207.950742:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788521207.950750:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4351aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222370432:12345-0@lo:400: 00000100:00100000:2.0:1788521207.950780:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4351aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222370432:12345-0@lo:400: Request processed in 32us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521207.950786:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788521207.950798:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788521207.950804:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee435ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222370304:12345-0@lo:400: 00000100:00100000:2.0:1788521207.950829:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee435ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222370304:12345-0@lo:400: Request processed in 27us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521207.950836:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788521207.950853:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222369792 00000100:00100000:2.0:1788521207.950856:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222369792 00000100:00100000:2.0:1788521207.950907:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222370176 00000100:00100000:2.0:1788521207.950911:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222370176 00000100:00100000:2.0:1788521207.950924:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222370688 00000100:00100000:2.0:1788521207.950932:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222370688 00000100:00100000:2.0:1788521207.950952:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788521207.950958:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee435ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222369792:12345-0@lo:400: 00000100:00100000:2.0:1788521207.950991:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee435ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222369792:12345-0@lo:400: Request processed in 33us (1415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521207.950996:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788521207.951007:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788521207.951012:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222370176:12345-0@lo:400: 00000100:00100000:2.0:1788521207.951053:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222370176:12345-0@lo:400: Request processed in 41us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521207.951059:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788521207.951071:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788521207.951077:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875400222370688:12345-0@lo:400: 00000100:00100000:2.0:1788521207.951103:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875400222370688:12345-0@lo:400: Request processed in 28us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521207.951108:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1788521207.951123:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788521207.951128:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788521207.951159:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee435eea00 x1875400222370176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521207.951173:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222370176:0@lo:400: 00010000:00080000:2.0:1788521207.951183:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee435ef480 x1875400222370688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521207.951191:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875400222370688:0@lo:400: 00000100:00100000:2.0:1788521207.951215:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521207.951239:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222369408:0@lo:400: 00010000:00080000:2.0:1788521207.951265:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee435ed880 x1875400222370432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521207.951281:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222370432:0@lo:400: 00000100:00100000:2.0:1788521207.951289:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788521207.951296:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222369536:0@lo:400: 00000100:00100000:2.0:1788521207.951319:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521207.951336:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875400222370048:0@lo:400: 00000100:00100000:2.0:1788521207.951355:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521207.951370:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875400222370560:0@lo:400: 00000100:00100000:2.0:1788521207.951389:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521207.951399:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222371072:0@lo:41: 00000100:00100000:2.0:1788521207.951417:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521207.951436:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222369536 00000100:00100000:2.0:1788521207.951439:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222369536 00000100:00100000:2.0:1788521207.951455:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222370048 00000100:00100000:2.0:1788521207.951458:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222370048 00000100:00100000:2.0:1788521207.951474:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222370560 00000100:00100000:2.0:1788521207.951476:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222370560 00000100:00100000:2.0:1788521207.951488:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788521207.951493:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222369536:12345-0@lo:400: 00000100:00100000:2.0:1788521207.951525:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222369536:12345-0@lo:400: Request processed in 31us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521207.951531:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788521207.951542:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788521207.951563:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875400222370048:12345-0@lo:400: 00000100:00100000:2.0:1788521207.951590:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875400222370048:12345-0@lo:400: Request processed in 42us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521207.951602:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788521207.951615:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788521207.951621:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875400222370560:12345-0@lo:400: 00000100:00100000:2.0:1788521207.951650:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875400222370560:12345-0@lo:400: Request processed in 29us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521207.951656:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1788521207.951669:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521207.951676:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222370944 00000100:00100000:2.0:1788521207.951680:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222370944 00000100:00100000:2.0:1788521207.951702:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788521207.951709:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4351b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222370944:12345-0@lo:400: 00000100:00100000:2.0:1788521207.951739:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4351b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222370944:12345-0@lo:400: Request processed in 31us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521207.951746:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788521207.951759:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521207.951777:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222369536:0@lo:400: 00000100:00100000:2.0:1788521207.951788:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875400222370048:0@lo:400: 00000100:00100000:2.0:1788521207.951797:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875400222370560:0@lo:400: 00010000:00080000:2.0:1788521207.951807:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee435eca80 x1875400222370944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521207.951816:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222370944:0@lo:400: 00000100:00100000:2.0:1788521207.951858:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222369664 00000100:00100000:2.0:1788521207.951862:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222369664 00000100:00100000:2.0:1788521207.951877:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222371072 00000100:00100000:2.0:1788521207.951879:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222371072 00000100:00100000:2.0:1788521207.951924:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788521207.951929:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875400222369664:12345-0@lo:400: 00000100:00100000:2.0:1788521207.951966:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875400222369664:12345-0@lo:400: Request processed in 37us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521207.951972:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788521207.951983:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788521207.951989:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4351b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222371072:12345-0@lo:41: 00000004:00000024:2.0:1788521207.952013:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788521207.952043:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4351b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222371072:12345-0@lo:41: Request processed in 55us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521207.952048:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788521207.952070:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222369664:0@lo:400: 00000100:00100000:2.0:1788521207.952094:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222371072:0@lo:41: 00000100:00100000:0.0:1788521207.953311:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521207.953591:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222369792:0@lo:400: 00010000:00080000:0.0:1788521207.953608:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee435edc00 x1875400222370304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521207.953618:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222370304:0@lo:400: 00000100:00100000:0.0:1788521207.953652:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222370816 00000100:00100000:0.0:1788521207.953657:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222370816 00000100:00100000:0.0:1788521207.953903:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788521207.953911:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee435ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222370816:12345-0@lo:400: 00000100:00100000:0.0:1788521207.953960:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee435ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222370816:12345-0@lo:400: Request processed in 50us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521207.953967:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788521207.953987:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788521207.954003:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee435ec000 x1875400222370816/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521207.954013:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222370816:0@lo:400: 00000100:00100000:1.0:1788521207.956116:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788521207.956138:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222371200:0@lo:13: 00000100:00100000:1.0:1788521207.956199:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521207.958065:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222371200 00000100:00100000:0.0:1788521207.958079:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222371200 00000100:00100000:0.0:1788521207.958167:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788521207.958179:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222371200:12345-0@lo:13: 00002000:00000024:0.0:1788521207.958216:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521207.960497:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222371200:12345-0@lo:13: Request processed in 2313us (4288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521207.960511:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788521207.961521:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43495180 x1875400222371200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521207.961547:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222371200:0@lo:13: 00000100:00100000:3.0:1788521207.963771:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4351b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222369920:12345-0@lo:400: Request processed in 13948us (14213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521207.963795:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788521207.965033:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222369920:0@lo:400: 00010000:00010000:1.0:1788521208.013081:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521208.423791:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521208.423840:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521208.423880:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521208.423952:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521208.423981:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521208.424002:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201344256 00000100:00100000:3.0:1788521208.424014:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201344256 00000100:00100000:0.0:1788521208.424067:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201343872 00000100:00100000:0.0:1788521208.424073:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201343872 00000100:00100000:3.0:1788521208.424099:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201344384 00000100:00100000:3.0:1788521208.424104:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201344384 00000100:00100000:0.0:1788521208.424115:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 204 00000100:00100000:0.0:1788521208.424127:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+8:2396:x1875400201343872:12345-192.168.203.41@tcp:400: 00000100:00100000:3.0:1788521208.424137:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 22 00000100:00100000:3.0:1788521208.424168:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+5:2396:x1875400201344256:12345-192.168.203.41@tcp:400: 00000100:00100000:0.0:1788521208.424205:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+8:2396:x1875400201343872:12345-192.168.203.41@tcp:400: Request processed in 80us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521208.424210:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+5:2396:x1875400201344256:12345-192.168.203.41@tcp:400: Request processed in 49us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521208.424219:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 204 00000100:00100000:3.0:1788521208.424234:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 22 00000100:00100000:3.0:1788521208.424253:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 23 00000100:00100000:3.0:1788521208.424261:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+5:2396:x1875400201344384:12345-192.168.203.41@tcp:400: 00000100:00100000:3.0:1788521208.424298:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+5:2396:x1875400201344384:12345-192.168.203.41@tcp:400: Request processed in 38us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521208.424305:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 23 00000100:00100000:2.0:1788521208.424584:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201344000 00000100:00100000:2.0:1788521208.424589:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201344000 00000100:00100000:2.0:1788521208.424628:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201344128 00000100:00100000:2.0:1788521208.424631:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201344128 00000100:00100000:2.0:1788521208.424653:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 68 00000100:00100000:2.0:1788521208.424666:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+6:2396:x1875400201344000:12345-192.168.203.41@tcp:400: 00000100:00080000:1.0:1788521208.424692:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788521208.424697:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788521208.424700:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788521208.424702:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521208.424709:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+6:2396:x1875400201344000:12345-192.168.203.41@tcp:400: Request processed in 48us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521208.424715:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 68 00000100:00100000:1.0:1788521208.424732:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 69 00000100:00100000:1.0:1788521208.424995:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2396:x1875400201344128:12345-192.168.203.41@tcp:400: 00000100:00100000:1.0:1788521208.425027:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2396:x1875400201344128:12345-192.168.203.41@tcp:400: Request processed in 288us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521208.445556:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 69 00000100:00100000:0.0:1788521208.461385:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43519500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222371328:0@lo:41: 00000100:00100000:0.0:1788521208.461467:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521208.461669:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222371456:0@lo:13: 00000100:00100000:1.0:1788521208.461704:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521208.461758:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222371456 00000100:00100000:1.0:1788521208.461766:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222371456 00000100:00100000:1.0:1788521208.461818:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788521208.461827:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222371456:12345-0@lo:13: 00002000:00000024:1.0:1788521208.461849:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521208.461920:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222371456:12345-0@lo:13: Request processed in 93us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521208.461944:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788521208.461988:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef767d0000 x1875400222371456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521208.462004:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222371456:0@lo:13: 00000100:00100000:3.0:1788521208.462086:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222371328 00000100:00100000:3.0:1788521208.462090:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222371328 00000100:00100000:3.0:1788521208.462135:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788521208.462142:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee435ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222371328:12345-0@lo:41: 00000004:00000024:3.0:1788521208.462169:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788521208.462563:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee435ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222371328:12345-0@lo:41: Request processed in 420us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521208.462569:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788521208.465971:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43519500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222371328:0@lo:41: 00010000:00010000:2.0:1788521209.037094:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788521209.229825:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788521209.229833:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fef7675d800 from 48 10000000:01000000:2.0:1788521209.229853:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788521209.229918:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6a00/0x411dd0ee4d2d12bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521209.229929:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6a00/0x411dd0ee4d2d12bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521209.229940:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6a00/0x411dd0ee4d2d12bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521209.229962:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4351ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222371584:0@lo:101: 00000100:00100000:2.0:1788521209.230028:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521209.230102:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef767bccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521209.230241:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222371584 00000100:00100000:3.0:1788521209.230250:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222371584 00000100:00100000:3.0:1788521209.230319:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788521209.230340:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+15:6517:x1875400222371584:12345-0@lo:101: 00010000:00010000:3.0:1788521209.230353:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521209.230367:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef749cba00/0x411dd0ee4d2d12c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d12bf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521209.230390:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef749cba00/0x411dd0ee4d2d12c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d12bf expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521209.230408:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef749cba00/0x411dd0ee4d2d12c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d12bf expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521209.230417:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749cba00, rc 0) 00000100:00100000:3.0:1788521209.230465:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:6517:x1875400222371584:12345-0@lo:101: Request processed in 127us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521209.230472:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788521209.230866:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4351ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222371584:0@lo:101: 00010000:00010000:2.0:1788521209.230881:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6a00/0x411dd0ee4d2d12bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d12c6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521209.230909:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6a00/0x411dd0ee4d2d12bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d12c6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521209.230971:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4351ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222371712:0@lo:501: 00000100:00100000:2.0:1788521209.230999:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521209.231031:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef767bccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521209.231482:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222371712 00000100:00100000:0.0:1788521209.231489:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222371712 00000100:00100000:0.0:1788521209.231527:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788521209.231534:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:6517:x1875400222371712:12345-0@lo:501: 00000100:00100000:0.0:1788521209.231664:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:6517:x1875400222371712:12345-0@lo:501: Request processed in 130us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521209.231671:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788521209.231768:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4351ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222371712:0@lo:501: 00000100:00100000:1.0:1788521209.231801:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222371840:0@lo:503: 00000100:00100000:1.0:1788521209.231845:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521209.231866:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef816c20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521209.232021:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222371840 00000100:00100000:0.0:1788521209.232026:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222371840 00000100:00100000:0.0:1788521209.232044:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788521209.232049:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:6517:x1875400222371840:12345-0@lo:503: 00000100:00100000:0.0:1788521209.232157:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:6517:x1875400222371840:12345-0@lo:503: Request processed in 106us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521209.232163:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788521209.232296:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222371840:0@lo:503: 00000100:00100000:1.0:1788521209.232683:0:10350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10350:1875400222371968:0@lo:502: 00000100:00100000:1.0:1788521209.232719:0:10350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521209.232753:0:10350:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef816c2840 going to sleep for 11 seconds 00000100:00100000:0.0:1788521209.232915:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222371968 00000100:00100000:0.0:1788521209.232919:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222371968 00000100:00100000:0.0:1788521209.232950:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788521209.232957:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:10350:x1875400222371968:12345-0@lo:502: 00000100:00100000:0.0:1788521209.233044:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:10350:x1875400222371968:12345-0@lo:502: Request processed in 88us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521209.233051:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788521209.233360:0:10350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10350:1875400222371968:0@lo:502: 00000100:00100000:1.0:1788521209.233404:0:10350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10350:1875400222372096:0@lo:502: 00000100:00100000:1.0:1788521209.233437:0:10350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521209.233462:0:10350:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef816c2840 going to sleep for 11 seconds 00000100:00100000:0.0:1788521209.233535:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222372096 00000100:00100000:0.0:1788521209.233540:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222372096 00000100:00100000:0.0:1788521209.233566:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788521209.233572:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:10350:x1875400222372096:12345-0@lo:502: 00000100:00100000:0.0:1788521209.233643:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:10350:x1875400222372096:12345-0@lo:502: Request processed in 70us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521209.233650:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788521209.233861:0:10350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10350:1875400222372096:0@lo:502: 00000040:00080000:1.0:1788521209.233881:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788521209.240167:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788521209.240210:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788521209.240223:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6a00/0x411dd0ee4d2d12bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d12c6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521209.240237:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6a00/0x411dd0ee4d2d12bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d12c6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521209.240247:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788521209.240251:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788521209.240254:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788521209.240316:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee42411400/0x411dd0ee4d2d12cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521209.240336:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fee42411400/0x411dd0ee4d2d12cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521209.240346:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fee42411400/0x411dd0ee4d2d12cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521209.240368:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435edc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222372224:0@lo:101: 00000100:00100000:0.0:1788521209.240431:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521209.240479:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef42ec6000 going to sleep for 11 seconds 00000100:00100000:2.0:1788521209.240554:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222372224 00000100:00100000:2.0:1788521209.240561:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222372224 00000100:00100000:2.0:1788521209.240616:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788521209.240624:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+16:6517:x1875400222372224:12345-0@lo:101: 00010000:00010000:2.0:1788521209.240637:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521209.240650:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef6d7b6400/0x411dd0ee4d2d12d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d12cd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521209.240680:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef6d7b6400/0x411dd0ee4d2d12d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d12cd expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521209.240691:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef6d7b6400/0x411dd0ee4d2d12d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d12cd expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521209.240700:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b6400, rc 0) 00000100:00100000:2.0:1788521209.240752:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:6517:x1875400222372224:12345-0@lo:101: Request processed in 129us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521209.240759:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788521209.240948:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435edc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222372224:0@lo:101: 00010000:00010000:1.0:1788521209.240962:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fee42411400/0x411dd0ee4d2d12cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d12d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521209.240971:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fee42411400/0x411dd0ee4d2d12cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d12d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521209.241030:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222372352:0@lo:501: 00000100:00100000:1.0:1788521209.241055:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521209.241086:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef816c20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521209.241163:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222372352 00000100:00100000:0.0:1788521209.241168:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222372352 00000100:00100000:0.0:1788521209.241190:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788521209.241196:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:6517:x1875400222372352:12345-0@lo:501: 00000100:00100000:0.0:1788521209.241310:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:6517:x1875400222372352:12345-0@lo:501: Request processed in 114us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521209.241317:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788521209.241364:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222372352:0@lo:501: 00000100:00100000:0.0:1788521209.241390:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222372480:0@lo:503: 00000100:00100000:0.0:1788521209.241430:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521209.241443:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef42ec6780 going to sleep for 11 seconds 00000100:00100000:0.0:1788521209.241453:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222372480 00000100:00100000:0.0:1788521209.241456:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222372480 00000100:00100000:0.0:1788521209.241472:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788521209.241478:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:6517:x1875400222372480:12345-0@lo:503: 00000100:00100000:0.0:1788521209.241551:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:6517:x1875400222372480:12345-0@lo:503: Request processed in 73us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521209.241564:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788521209.241600:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222372480:0@lo:503: 00000100:00100000:3.0:1788521209.245444:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10351:1875400222372608:0@lo:502: 00000100:00100000:3.0:1788521209.245531:0:10351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521209.245568:0:10351:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee4226ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521209.247777:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222372608 00000100:00100000:0.0:1788521209.247792:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222372608 00000100:00100000:0.0:1788521209.247859:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788521209.247869:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:10351:x1875400222372608:12345-0@lo:502: 00000100:00100000:0.0:1788521209.248079:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:10351:x1875400222372608:12345-0@lo:502: Request processed in 210us (2547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521209.248086:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788521209.248284:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10351:1875400222372608:0@lo:502: 00000020:01000000:1.0:1788521209.248320:0:10351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788521209.248344:0:10351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521209.248347:0:10351:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788521209.248352:0:10351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788521209.248388:0:10351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10351:1875400222372736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521209.248430:0:10351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521209.248465:0:10351:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef816c2840 going to sleep for 11 seconds 00000100:00100000:2.0:1788521209.248613:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222372736 00000100:00100000:2.0:1788521209.248618:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222372736 00000100:00100000:2.0:1788521209.248650:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788521209.248658:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:10351:x1875400222372736:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521209.248749:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:10351:x1875400222372736:12345-0@lo:502:llog_process_th.0 Request processed in 91us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521209.248756:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788521209.248921:0:10351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10351:1875400222372736:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788521209.248941:0:10351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788521209.248945:0:10351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521209.248947:0:10351:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788521209.248951:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1788521209.249112:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788521209.249134:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788521209.249143:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee42411400/0x411dd0ee4d2d12cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d12d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521209.249154:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fee42411400/0x411dd0ee4d2d12cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d12d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521209.249163:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788521209.249166:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fef76680800 from 48 10000000:01000000:2.0:1788521209.249176:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788521209.249199:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6c00/0x411dd0ee4d2d12db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521209.249207:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6c00/0x411dd0ee4d2d12db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521209.249217:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6c00/0x411dd0ee4d2d12db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521209.249230:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43518380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222372864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788521209.249259:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521209.249308:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef767bc9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521209.249417:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222372864 00000100:00100000:0.0:1788521209.249422:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222372864 00000100:00100000:0.0:1788521209.249443:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788521209.249449:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+17:6517:x1875400222372864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521209.249457:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521209.249469:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fee42411000/0x411dd0ee4d2d12e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d12db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521209.249490:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fee42411000/0x411dd0ee4d2d12e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d12db expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521209.249501:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fee42411000/0x411dd0ee4d2d12e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d12db expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521209.249509:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411000, rc 0) 00000100:00100000:0.0:1788521209.249537:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:6517:x1875400222372864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521209.249543:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788521209.249627:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43518380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222372864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521209.249639:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6c00/0x411dd0ee4d2d12db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d12e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521209.249649:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6c00/0x411dd0ee4d2d12db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d12e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521209.249698:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43518380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222372992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521209.249723:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521209.249747:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef767bc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521209.249850:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222372992 00000100:00100000:1.0:1788521209.249855:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222372992 00000100:00100000:1.0:1788521209.249873:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788521209.249879:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:6517:x1875400222372992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521209.250002:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:6517:x1875400222372992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521209.250009:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788521209.250120:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43518380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222372992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521209.250148:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43518380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222373120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521209.250185:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521209.250209:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef767bc9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521209.250393:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222373120 00000100:00100000:0.0:1788521209.250398:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222373120 00000100:00100000:0.0:1788521209.250426:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788521209.250432:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:6517:x1875400222373120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521209.250512:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:6517:x1875400222373120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521209.250518:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788521209.250619:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43518380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222373120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521209.252494:0:10352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43518380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10352:1875400222373248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521209.252557:0:10352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521209.252593:0:10352:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef767bc180 going to sleep for 11 seconds 00000100:00100000:0.0:1788521209.252665:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222373248 00000100:00100000:0.0:1788521209.252670:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222373248 00000100:00100000:0.0:1788521209.252708:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788521209.252717:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:10352:x1875400222373248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521209.252837:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:10352:x1875400222373248:12345-0@lo:502:llog_process_th.0 Request processed in 121us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521209.252845:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788521209.253056:0:10352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43518380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10352:1875400222373248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521209.253099:0:10352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43518380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10352:1875400222373376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521209.253130:0:10352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521209.253163:0:10352:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef767bc180 going to sleep for 11 seconds 00000100:00100000:1.0:1788521209.253201:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222373376 00000100:00100000:1.0:1788521209.253206:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222373376 00000100:00100000:1.0:1788521209.253240:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788521209.253254:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:10352:x1875400222373376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521209.253330:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:10352:x1875400222373376:12345-0@lo:502:llog_process_th.0 Request processed in 77us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521209.253337:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788521209.253453:0:10352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43518380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10352:1875400222373376:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788521209.253469:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788521209.253596:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788521209.253617:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788521209.253626:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6c00/0x411dd0ee4d2d12db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d12e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521209.253636:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6c00/0x411dd0ee4d2d12db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d12e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521209.253644:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788521209.253647:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788521209.253650:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788521209.253672:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d12e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521209.253680:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d12e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521209.253687:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d12e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521209.253699:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222373504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788521209.253725:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521209.253751:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef816c2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788521209.253851:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222373504 00000100:00100000:3.0:1788521209.253856:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222373504 00000100:00100000:3.0:1788521209.253917:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788521209.253925:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+18:6517:x1875400222373504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521209.253933:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521209.253944:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef749cb000/0x411dd0ee4d2d12f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d12e9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521209.253964:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef749cb000/0x411dd0ee4d2d12f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d12e9 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521209.253975:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef749cb000/0x411dd0ee4d2d12f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d12e9 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521209.253983:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749cb000, rc 0) 00000100:00100000:3.0:1788521209.254012:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+19:6517:x1875400222373504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521209.254029:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788521209.254151:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222373504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521209.254168:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d12e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d12f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521209.254175:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d12e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d12f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521209.254217:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222373632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521209.254242:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521209.254258:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef816c2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788521209.254363:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222373632 00000100:00100000:3.0:1788521209.254368:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222373632 00000100:00100000:3.0:1788521209.254395:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788521209.254402:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+19:6517:x1875400222373632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521209.254506:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+19:6517:x1875400222373632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521209.254512:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788521209.254594:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222373632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521209.254618:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222373760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521209.254652:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521209.254674:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef816c2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788521209.254714:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222373760 00000100:00100000:2.0:1788521209.254718:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222373760 00000100:00100000:2.0:1788521209.254752:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788521209.254758:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+19:6517:x1875400222373760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521209.254833:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+19:6517:x1875400222373760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521209.254840:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788521209.255016:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222373760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521209.255473:0:10353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10353:1875400222373888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521209.255513:0:10353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521209.255541:0:10353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef816c2240 going to sleep for 11 seconds 00000100:00100000:2.0:1788521209.255579:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222373888 00000100:00100000:2.0:1788521209.255584:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222373888 00000100:00100000:2.0:1788521209.255617:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788521209.255722:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+19:10353:x1875400222373888:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521209.256006:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+19:10353:x1875400222373888:12345-0@lo:502:llog_process_th.0 Request processed in 382us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521209.256013:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788521209.266171:0:10353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10353:1875400222373888:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788521209.266227:0:10353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521209.266241:0:10353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521209.266243:0:10353:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788521209.266250:0:10353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788521209.266303:0:10353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71520e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10353:1875400222374016:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521209.266388:0:10353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521209.266440:0:10353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee4226b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788521209.266521:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222374016 00000100:00100000:2.0:1788521209.266528:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222374016 00000100:00100000:2.0:1788521209.266581:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788521209.266591:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+19:10353:x1875400222374016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521209.266716:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+19:10353:x1875400222374016:12345-0@lo:502:llog_process_th.0 Request processed in 126us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521209.266723:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788521209.267457:0:10353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71520e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10353:1875400222374016:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788521209.267486:0:10353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521209.267493:0:10353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521209.267495:0:10353:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788521209.267499:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1788521209.267657:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788521209.267677:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788521209.267688:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d12e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d12f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521209.267700:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d12e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d12f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521209.267711:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788521209.267713:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fef81580000 from 48 10000000:01000000:2.0:1788521209.267716:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788521209.267756:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7e00/0x411dd0ee4d2d12f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521209.267765:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7e00/0x411dd0ee4d2d12f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521209.267774:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7e00/0x411dd0ee4d2d12f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521209.267792:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43518380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222374144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788521209.267832:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521209.267876:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef767bc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521209.267967:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222374144 00000100:00100000:1.0:1788521209.267973:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222374144 00000100:00100000:1.0:1788521209.268013:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788521209.268021:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+19:6517:x1875400222374144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521209.268031:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521209.268043:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fee434ab000/0x411dd0ee4d2d12fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d12f7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521209.268065:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fee434ab000/0x411dd0ee4d2d12fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d12f7 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521209.268083:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fee434ab000/0x411dd0ee4d2d12fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d12f7 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521209.268091:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434ab000, rc 0) 00000100:00100000:1.0:1788521209.268130:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:6517:x1875400222374144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521209.268147:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788521209.268377:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43518380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222374144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521209.268389:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7e00/0x411dd0ee4d2d12f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d12fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521209.268397:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7e00/0x411dd0ee4d2d12f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d12fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521209.268456:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71520e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222374272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521209.268480:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521209.268507:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee4226b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788521209.268544:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222374272 00000100:00100000:1.0:1788521209.268548:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222374272 00000100:00100000:1.0:1788521209.268576:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788521209.268582:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:6517:x1875400222374272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521209.268683:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:6517:x1875400222374272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521209.268689:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788521209.268760:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71520e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222374272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521209.268789:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222374400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521209.268827:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521209.268847:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef42ec69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521209.268949:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222374400 00000100:00100000:3.0:1788521209.268954:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222374400 00000100:00100000:3.0:1788521209.268976:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788521209.268982:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:6517:x1875400222374400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521209.269068:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:6517:x1875400222374400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521209.269075:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788521209.269157:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222374400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521209.270093:0:10354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4351a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10354:1875400222374528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521209.270162:0:10354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521209.270196:0:10354:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef767bc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521209.270241:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222374528 00000100:00100000:3.0:1788521209.270247:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222374528 00000100:00100000:3.0:1788521209.270305:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788521209.270312:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:10354:x1875400222374528:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521209.270420:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:10354:x1875400222374528:12345-0@lo:502:llog_process_th.0 Request processed in 108us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521209.270427:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788521209.271851:0:10354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4351a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10354:1875400222374528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521209.271933:0:10354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435efb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10354:1875400222374656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521209.271986:0:10354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521209.272018:0:10354:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef42ec69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521209.272224:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222374656 00000100:00100000:1.0:1788521209.272231:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222374656 00000100:00100000:1.0:1788521209.272278:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788521209.272288:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:10354:x1875400222374656:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521209.272383:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:10354:x1875400222374656:12345-0@lo:502:llog_process_th.0 Request processed in 96us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521209.272390:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788521209.272915:0:10354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435efb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10354:1875400222374656:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788521209.272945:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788521209.275960:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788521209.276007:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788521209.276019:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7e00/0x411dd0ee4d2d12f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d12fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521209.276031:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7e00/0x411dd0ee4d2d12f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d12fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521209.276043:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788521209.276046:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1788521209.276049:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788521209.276085:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee42411200/0x411dd0ee4d2d1305 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521209.276094:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fee42411200/0x411dd0ee4d2d1305 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521209.276103:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fee42411200/0x411dd0ee4d2d1305 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521209.276127:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222374784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788521209.276189:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521209.276231:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef42ec69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521209.276302:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222374784 00000100:00100000:2.0:1788521209.276309:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222374784 00000100:00100000:2.0:1788521209.276439:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788521209.276448:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:6517:x1875400222374784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521209.276462:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521209.276475:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef6d7b7a00/0x411dd0ee4d2d130c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d1305 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521209.276499:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef6d7b7a00/0x411dd0ee4d2d130c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1305 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521209.276510:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef6d7b7a00/0x411dd0ee4d2d130c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1305 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521209.276520:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7a00, rc 0) 00000100:00100000:2.0:1788521209.276568:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222374784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521209.276576:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788521209.276768:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222374784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521209.276781:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fee42411200/0x411dd0ee4d2d1305 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d130c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521209.276791:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fee42411200/0x411dd0ee4d2d1305 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d130c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521209.276859:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222374912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521209.276912:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521209.276929:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef42ec69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521209.276976:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222374912 00000100:00100000:3.0:1788521209.276981:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222374912 00000100:00100000:3.0:1788521209.277009:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788521209.277016:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222374912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521209.277146:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222374912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521209.277153:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788521209.279500:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222374912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521209.279566:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222375040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521209.279665:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521209.279689:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef42ec69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521209.279769:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222375040 00000100:00100000:3.0:1788521209.279782:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222375040 00000100:00100000:3.0:1788521209.279835:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788521209.279845:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222375040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521209.279974:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222375040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521209.279982:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788521209.280314:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222375040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521209.280640:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43518700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10355:1875400222375168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521209.280682:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521209.280706:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef767bccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521209.280754:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222375168 00000100:00100000:3.0:1788521209.280760:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222375168 00000100:00100000:3.0:1788521209.280794:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788521209.280802:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:10355:x1875400222375168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521209.280920:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:10355:x1875400222375168:12345-0@lo:502:llog_process_th.0 Request processed in 119us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521209.280927:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788521209.281090:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43518700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10355:1875400222375168:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788521209.281116:0:10355:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521209.281142:0:10355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521209.281145:0:10355:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788521209.281152:0:10355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788521209.281174:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43518700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10355:1875400222375296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521209.281209:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521209.281232:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef816b7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788521209.281383:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222375296 00000100:00100000:0.0:1788521209.281388:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222375296 00000100:00100000:0.0:1788521209.281419:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788521209.281426:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:10355:x1875400222375296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521209.281513:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:10355:x1875400222375296:12345-0@lo:502:llog_process_th.0 Request processed in 88us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521209.281520:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788521209.281586:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43518700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10355:1875400222375296:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788521209.281605:0:10355:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521209.281609:0:10355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521209.281610:0:10355:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788521209.281614:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1788521209.281753:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1788521209.281773:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788521209.281782:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee42411200/0x411dd0ee4d2d1305 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d130c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521209.281793:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fee42411200/0x411dd0ee4d2d1305 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d130c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521209.281803:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788521209.281812:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fef58328000 from 48 10000000:01000000:0.0:1788521209.281814:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788521209.281837:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee42411a00/0x411dd0ee4d2d1313 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521209.281846:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fee42411a00/0x411dd0ee4d2d1313 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521209.281854:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fee42411a00/0x411dd0ee4d2d1313 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521209.281867:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222375424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788521209.281924:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521209.281942:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef42ec66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521209.282047:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222375424 00000100:00100000:2.0:1788521209.282052:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222375424 00000100:00100000:2.0:1788521209.282083:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788521209.282092:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222375424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521209.282100:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521209.282113:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef6d7b6600/0x411dd0ee4d2d131a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d1313 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521209.282145:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef6d7b6600/0x411dd0ee4d2d131a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1313 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521209.282157:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef6d7b6600/0x411dd0ee4d2d131a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1313 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521209.282166:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b6600, rc 0) 00000100:00100000:2.0:1788521209.282196:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:6517:x1875400222375424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521209.282202:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788521209.282333:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222375424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521209.282346:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fee42411a00/0x411dd0ee4d2d1313 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d131a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521209.282356:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fee42411a00/0x411dd0ee4d2d1313 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d131a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521209.282405:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222375552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521209.282430:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521209.282451:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef42ec66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521209.282823:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222375552 00000100:00100000:3.0:1788521209.282829:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222375552 00000100:00100000:3.0:1788521209.282863:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788521209.282871:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:6517:x1875400222375552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521209.282999:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:6517:x1875400222375552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521209.283006:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788521209.283075:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222375552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521209.283101:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222375680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521209.283147:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521209.283164:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef42ec66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521209.283727:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222375680 00000100:00100000:3.0:1788521209.283801:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222375680 00000100:00100000:3.0:1788521209.283838:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788521209.283846:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:6517:x1875400222375680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521209.283962:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:6517:x1875400222375680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521209.283979:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788521209.284114:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222375680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521209.284853:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43518700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10356:1875400222375808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521209.285079:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521209.285146:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef816b7780 going to sleep for 11 seconds 00000100:00100000:3.0:1788521209.285222:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222375808 00000100:00100000:3.0:1788521209.285227:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222375808 00000100:00100000:3.0:1788521209.285299:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788521209.285307:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:10356:x1875400222375808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521209.285425:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:10356:x1875400222375808:12345-0@lo:502:llog_process_th.0 Request processed in 118us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521209.285432:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788521209.285495:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43518700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10356:1875400222375808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521209.285537:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435efb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10356:1875400222375936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521209.285572:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521209.285758:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef42ec66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521209.285876:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222375936 00000100:00100000:2.0:1788521209.285910:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222375936 00000100:00100000:2.0:1788521209.285933:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788521209.285940:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:10356:x1875400222375936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521209.286017:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:10356:x1875400222375936:12345-0@lo:502:llog_process_th.0 Request processed in 77us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521209.286024:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788521209.286097:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435efb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10356:1875400222375936:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788521209.286117:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788521209.286599:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788521209.286623:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788521209.286632:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee42411a00/0x411dd0ee4d2d1313 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d131a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521209.286642:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fee42411a00/0x411dd0ee4d2d1313 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d131a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521209.286653:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788521209.286655:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:2.0:1788521209.286658:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788521209.286684:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6200/0x411dd0ee4d2d1321 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521209.286692:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6200/0x411dd0ee4d2d1321 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521209.286699:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6200/0x411dd0ee4d2d1321 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521209.286807:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4351a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222376064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788521209.286845:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521209.286973:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef81704e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788521209.287142:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222376064 00000100:00100000:3.0:1788521209.287149:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222376064 00000100:00100000:0.0:1788521209.287277:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788521209.287287:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:6517:x1875400222376064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521209.287299:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521209.287313:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fee42411600/0x411dd0ee4d2d1328 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d1321 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521209.287489:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fee42411600/0x411dd0ee4d2d1328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1321 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521209.287501:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fee42411600/0x411dd0ee4d2d1328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1321 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521209.287510:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411600, rc 0) 00000100:00100000:0.0:1788521209.287554:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:6517:x1875400222376064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 268us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521209.287560:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788521209.287630:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4351a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222376064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521209.287644:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6200/0x411dd0ee4d2d1321 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1328 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521209.287653:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6200/0x411dd0ee4d2d1321 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d1328 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521209.287706:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4351a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222376192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521209.287746:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521209.287765:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef81704e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788521209.287862:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222376192 00000100:00100000:0.0:1788521209.287867:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222376192 00000100:00100000:0.0:1788521209.287945:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788521209.287962:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:6517:x1875400222376192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521209.288069:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:6517:x1875400222376192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521209.288076:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788521209.288151:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4351a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222376192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521209.288186:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4351a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222376320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521209.288220:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521209.288238:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef81704e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788521209.288585:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222376320 00000100:00100000:0.0:1788521209.288589:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222376320 00000100:00100000:0.0:1788521209.288606:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788521209.288612:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:6517:x1875400222376320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521209.288703:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:6517:x1875400222376320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521209.288711:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788521209.288846:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4351a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222376320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521209.290871:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4351a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10357:1875400222376448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521209.298973:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521209.299014:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef81704600 going to sleep for 11 seconds 00000100:00100000:1.0:1788521209.299097:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222376448 00000100:00100000:1.0:1788521209.299106:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222376448 00000100:00100000:1.0:1788521209.299174:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788521209.299184:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:10357:x1875400222376448:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521209.299513:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:10357:x1875400222376448:12345-0@lo:502:llog_process_th.0 Request processed in 329us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521209.299521:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788521209.299620:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4351a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10357:1875400222376448:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788521209.299651:0:10357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521209.299664:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521209.299667:0:10357:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788521209.299672:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788521209.299702:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4351a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10357:1875400222376576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521209.300292:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521209.300551:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222376576 00000100:00100000:0.0:1788521209.300559:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222376576 00000100:00100000:0.0:1788521209.300598:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788521209.300607:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:10357:x1875400222376576:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521209.300705:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:10357:x1875400222376576:12345-0@lo:502:llog_process_th.0 Request processed in 99us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521209.300711:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788521209.300999:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef81704600 going to sleep for 11 seconds 00000100:00100000:0.0:1788521209.301019:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4351a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10357:1875400222376576:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788521209.301045:0:10357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521209.301052:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521209.301054:0:10357:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788521209.301059:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788521209.301223:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1788521209.301243:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788521209.301253:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6200/0x411dd0ee4d2d1321 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1328 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521209.301274:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6200/0x411dd0ee4d2d1321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1328 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521209.301285:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788521209.301288:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8fef4e780000 from 1 10000000:01000000:1.0:1788521209.301291:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788521209.301318:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434ab400/0x411dd0ee4d2d132f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521209.301389:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fee434ab400/0x411dd0ee4d2d132f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521209.301398:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fee434ab400/0x411dd0ee4d2d132f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521209.301416:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222376704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788521209.301451:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521209.301482:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef816c2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788521209.301533:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222376704 00000100:00100000:3.0:1788521209.301538:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222376704 00000100:00100000:3.0:1788521209.301582:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788521209.301592:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:6517:x1875400222376704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521209.301601:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521209.301613:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef749ca600/0x411dd0ee4d2d1336 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d132f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521209.301634:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef749ca600/0x411dd0ee4d2d1336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d132f expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521209.301644:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef749ca600/0x411dd0ee4d2d1336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d132f expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521209.301652:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749ca600, rc 0) 00000100:00100000:3.0:1788521209.301683:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:6517:x1875400222376704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521209.301689:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788521209.301925:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222376704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521209.301938:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fee434ab400/0x411dd0ee4d2d132f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1336 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521209.301953:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fee434ab400/0x411dd0ee4d2d132f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d1336 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521209.302006:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222376832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521209.302033:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521209.302055:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef816c2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788521209.302166:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222376832 00000100:00100000:0.0:1788521209.302171:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222376832 00000100:00100000:0.0:1788521209.302205:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788521209.302219:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:6517:x1875400222376832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521209.302300:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:6517:x1875400222376832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (267us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788521209.302307:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788521209.303697:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222376832:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788521209.303798:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788521209.303806:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434ab400/0x411dd0ee4d2d132f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1336 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521209.303816:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fee434ab400/0x411dd0ee4d2d132f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1336 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521210.061106:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521210.509224:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222376960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521210.509304:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521210.509567:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222376960 00000100:00100000:1.0:1788521210.509575:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222376960 00000100:00100000:1.0:1788521210.509640:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788521210.509650:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4351bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222376960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788521210.509679:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521210.509724:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4351bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222376960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521210.509732:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788521210.509835:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521210.510091:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788521210.510104:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222377088:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788521210.510136:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521210.510304:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222377088 00000100:00100000:1.0:1788521210.510309:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222377088 00000100:00100000:1.0:1788521210.510348:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788521210.510355:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee435efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222377088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788521210.510377:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521210.510404:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee435efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222377088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521210.510411:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788521210.511235:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef767d2a00 x1875400222376960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521226 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521210.511268:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222376960:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788521210.511521:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788521210.511546:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef767d1180 x1875400222377088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521226 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521210.511561:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222377088:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788521211.086470:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521212.007980:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521212.008396:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201344512 00000100:00100000:0.0:1788521212.008406:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201344512 00000100:00100000:0.0:1788521212.008462:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 247 00000100:00100000:0.0:1788521212.008472:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+8:6169:x1875400201344512:12345-192.168.203.41@tcp:101: 00010000:00010000:0.0:1788521212.008487:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521212.008507:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fee42410e00/0x411dd0ee4d2d133d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed4dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521212.008536:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fee42410e00/0x411dd0ee4d2d133d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed4dc expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521212.008547:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fee42410e00/0x411dd0ee4d2d133d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed4dc expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521212.008556:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42410e00, rc 0) 00000100:00100000:0.0:1788521212.008629:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+9:6169:x1875400201344512:12345-192.168.203.41@tcp:101: Request processed in 158us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521212.008636:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 247 00000100:00100000:3.0:1788521212.021450:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521212.021586:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201344640 00000100:00100000:0.0:1788521212.021600:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201344640 00000100:00100000:0.0:1788521212.021690:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 248 00000100:00100000:0.0:1788521212.021715:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+9:6169:x1875400201344640:12345-192.168.203.41@tcp:501: 00000100:00100000:0.0:1788521212.021967:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+9:6169:x1875400201344640:12345-192.168.203.41@tcp:501: Request processed in 265us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521212.021976:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 248 00000100:00100000:1.0:1788521212.025635:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521212.026333:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201344768 00000100:00100000:3.0:1788521212.026345:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201344768 00000100:00100000:3.0:1788521212.035005:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 249 00000100:00100000:3.0:1788521212.035031:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4813ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+9:6169:x1875400201344768:12345-192.168.203.41@tcp:503: 00000100:00100000:3.0:1788521212.035225:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4813ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+9:6169:x1875400201344768:12345-192.168.203.41@tcp:503: Request processed in 208us (9605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521212.035233:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 249 00000100:00100000:2.0:1788521212.050281:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521212.050844:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201344896 00000100:00100000:1.0:1788521212.050853:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201344896 00000100:00100000:1.0:1788521212.050935:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 250 00000100:00100000:1.0:1788521212.050945:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4813d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+9:6670:x1875400201344896:12345-192.168.203.41@tcp:502: 00000100:00100000:1.0:1788521212.051112:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4813d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+9:6670:x1875400201344896:12345-192.168.203.41@tcp:502: Request processed in 168us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521212.051120:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 250 00000100:00100000:1.0:1788521212.055051:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521212.056144:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201345024 00000100:00100000:3.0:1788521212.056157:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201345024 00000100:00100000:3.0:1788521212.056221:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 251 00000100:00100000:3.0:1788521212.056232:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4813f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+9:6670:x1875400201345024:12345-192.168.203.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788521212.059767:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4813f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+9:6670:x1875400201345024:12345-192.168.203.41@tcp:502:llog_process_th.0 Request processed in 3514us (4704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521212.059783:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 251 00000100:00100000:3.0:1788521212.067722:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521212.067957:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201345152 00000100:00100000:2.0:1788521212.067967:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201345152 00000100:00100000:2.0:1788521212.070301:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 252 00000100:00100000:2.0:1788521212.070325:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71ec6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+9:6169:x1875400201345152:12345-192.168.203.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521212.070343:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521212.070364:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef6d7b7400/0x411dd0ee4d2d1344 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed4e3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521212.070396:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef6d7b7400/0x411dd0ee4d2d1344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed4e3 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521212.070407:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef6d7b7400/0x411dd0ee4d2d1344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed4e3 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521212.070417:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7400, rc 0) 00000100:00100000:2.0:1788521212.070490:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71ec6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+10:6169:x1875400201345152:12345-192.168.203.41@tcp:101:ll_cfg_requeue.0 Request processed in 176us (2778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521212.070512:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 252 00000100:00100000:3.0:1788521212.076075:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521212.076171:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201345280 00000100:00100000:0.0:1788521212.076180:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201345280 00000100:00100000:0.0:1788521212.076236:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 253 00000100:00100000:0.0:1788521212.076259:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71ec7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+10:6169:x1875400201345280:12345-192.168.203.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521212.076372:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71ec7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+10:6169:x1875400201345280:12345-192.168.203.41@tcp:501:ll_cfg_requeue.0 Request processed in 127us (306us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788521212.076380:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 253 00010000:00010000:2.0:1788521212.109174:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521213.069304:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788521213.069334:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222377216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521213.069411:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521213.069589:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222377216 00000100:00100000:0.0:1788521213.069597:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222377216 00000100:00100000:0.0:1788521213.069664:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788521213.069674:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222377216:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788521213.070030:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1788521213.070147:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521213.070213:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71523b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222377216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 540us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521213.070220:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1788521213.070313:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee435eed80 x1875400222377216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521213.070346:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222377216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521213.070673:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43518700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875400222377472:0@lo:400:kworker.0 00000100:00100000:2.0:1788521213.070712:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521213.070738:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43519500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875400222377984:0@lo:400:kworker.0 00000100:00100000:2.0:1788521213.070763:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521213.070789:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875400222378496:0@lo:400:kworker.0 00000100:00100000:2.0:1788521213.070810:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521213.070829:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788521213.070835:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4351a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222377344:0@lo:400:kworker.0 00000100:00100000:2.0:1788521213.070862:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521213.070898:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4351ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222377856:0@lo:400:kworker.0 00000100:00100000:3.0:1788521213.073278:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222378880:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788521213.073382:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521213.073444:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222378880 00000100:00100000:3.0:1788521213.073451:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222378880 00000100:00100000:3.0:1788521213.073502:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788521213.073511:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222378880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788521213.073543:0:10099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788521213.073585:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222378880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521213.073591:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788521213.073628:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222378880:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788521213.073646:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4351a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222377600:0@lo:400:kworker.0 00000100:00100000:3.0:1788521213.073679:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521213.073695:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222378112:0@lo:400:kworker.0 00000100:00100000:3.0:1788521213.073716:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521213.073728:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875400222378624:0@lo:400:kworker.0 00000100:00100000:3.0:1788521213.073743:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521213.073754:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788521213.073759:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43518380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875400222377728:0@lo:400:kworker.0 00000100:00100000:3.0:1788521213.073777:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521213.073794:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222378240:0@lo:400:kworker.0 00000100:00100000:3.0:1788521213.073832:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521213.073853:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222378752:0@lo:400:kworker.0 00000100:00100000:3.0:1788521213.073873:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521213.073936:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222377600 00000100:00100000:3.0:1788521213.073939:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222377600 00000100:00100000:3.0:1788521213.073966:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788521213.073971:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222377600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521213.074002:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222377600:12345-0@lo:400:kworker.0 Request processed in 31us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521213.074009:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788521213.074024:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222378240 00000100:00100000:3.0:1788521213.074027:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222378240 00000100:00100000:3.0:1788521213.074053:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222378752 00000100:00100000:3.0:1788521213.074056:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222378752 00000100:00100000:3.0:1788521213.074085:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788521213.074091:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222378240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521213.074118:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222378240:12345-0@lo:400:kworker.0 Request processed in 28us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521213.074124:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788521213.074133:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788521213.074138:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222378752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521213.074159:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222378752:12345-0@lo:400:kworker.0 Request processed in 21us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521213.074164:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1788521213.074183:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788521213.074187:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788521213.074205:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7a4fce00 x1875400222378240/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521213.074216:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222378240:0@lo:400:kworker.0 00010000:00080000:3.0:1788521213.074225:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7a4fd180 x1875400222378752/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521213.074233:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222378752:0@lo:400:kworker.0 00000100:00100000:3.0:1788521213.074260:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4351a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222377600:0@lo:400:kworker.0 00000100:00100000:3.0:1788521213.074298:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222377472 00000100:00100000:3.0:1788521213.074301:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222377472 00000100:00100000:3.0:1788521213.074318:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222377984 00000100:00100000:3.0:1788521213.074320:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222377984 00000100:00100000:3.0:1788521213.074333:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222378496 00000100:00100000:3.0:1788521213.074335:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222378496 00000100:00100000:3.0:1788521213.074345:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222378112 00000100:00100000:3.0:1788521213.074347:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222378112 00000100:00100000:3.0:1788521213.074355:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222378624 00000100:00100000:3.0:1788521213.074357:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222378624 00000100:00100000:3.0:1788521213.074367:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222377728 00000100:00100000:3.0:1788521213.074369:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222377728 00000100:00100000:3.0:1788521213.074381:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788521213.074386:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875400222377472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521213.074419:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875400222377472:12345-0@lo:400:kworker.0 Request processed in 33us (3706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521213.074424:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788521213.074436:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788521213.074442:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875400222377984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521213.074469:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875400222377984:12345-0@lo:400:kworker.0 Request processed in 28us (3705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521213.074474:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788521213.074484:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788521213.074490:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875400222378496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521213.074516:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875400222378496:12345-0@lo:400:kworker.0 Request processed in 27us (3705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521213.074521:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788521213.074538:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788521213.074544:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222378112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521213.074577:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222378112:12345-0@lo:400:kworker.0 Request processed in 34us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521213.074583:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788521213.074593:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788521213.074599:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875400222378624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521213.074621:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875400222378624:12345-0@lo:400:kworker.0 Request processed in 24us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521213.074626:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788521213.074635:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788521213.074640:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875400222377728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521213.074662:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875400222377728:12345-0@lo:400:kworker.0 Request processed in 23us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521213.074667:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1788521213.074682:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788521213.074685:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521213.074701:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43518380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875400222377728:0@lo:400:kworker.0 00010000:00080000:3.0:1788521213.074710:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4244df80 x1875400222378112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521213.074718:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222378112:0@lo:400:kworker.0 00010000:00080000:3.0:1788521213.074727:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7a4fca80 x1875400222378624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521213.074734:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875400222378624:0@lo:400:kworker.0 00000100:00100000:1.0:1788521213.075301:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222377344 00000100:00100000:1.0:1788521213.075309:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222377344 00000100:00100000:1.0:1788521213.075365:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788521213.075372:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4875b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3646:x1875400222377344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521213.075416:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4875b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3646:x1875400222377344:12345-0@lo:400:kworker.0 Request processed in 45us (4553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521213.075422:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788521213.079567:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521213.081644:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222378368:0@lo:400:kworker.0 00000100:00100000:2.0:1788521213.081706:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521213.081777:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43518700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875400222377472:0@lo:400:kworker.0 00000100:00100000:2.0:1788521213.081792:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43519500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875400222377984:0@lo:400:kworker.0 00000100:00100000:2.0:1788521213.081807:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875400222378496:0@lo:400:kworker.0 00000100:00100000:1.0:1788521213.081815:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222378368 00000100:00100000:1.0:1788521213.081834:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222378368 00000100:00100000:2.0:1788521213.081839:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4351a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222377344:0@lo:400:kworker.0 00000100:00100000:1.0:1788521213.081935:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788521213.081946:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222378368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521213.082030:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222378368:12345-0@lo:400:kworker.0 Request processed in 87us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521213.082039:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788521213.082065:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521213.082517:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222377856 00000100:00100000:3.0:1788521213.082524:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222377856 00000100:00100000:3.0:1788521213.082576:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788521213.082585:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222377856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521213.082632:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222377856:12345-0@lo:400:kworker.0 Request processed in 50us (3074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521213.082639:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788521213.083114:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4351ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222377856:0@lo:400:kworker.0 00010000:00080000:2.0:1788521213.083130:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7a4ff480 x1875400222378368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521213.083158:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222378368:0@lo:400:kworker.0 00010000:00010000:2.0:1788521213.133165:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521213.546135:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521213.546204:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521213.546254:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521213.546276:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521213.546320:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201345792 00000100:00100000:0.0:1788521213.546339:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201345792 00000100:00100000:0.0:1788521213.546410:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 27 00000100:00100000:0.0:1788521213.546419:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201345792:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521213.546488:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201345792:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 70us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521213.546496:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 27 00000100:00080000:0.0:1788521213.546517:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521213.547988:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521213.548022:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201345408 00000100:00100000:2.0:1788521213.548029:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201345408 00000100:00100000:2.0:1788521213.548068:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 255 00000100:00100000:2.0:1788521213.548077:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef48759050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+10:2395:x1875400201345408:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521213.548128:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef48759050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+10:2395:x1875400201345408:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 53us (1874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521213.548136:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 255 00000100:00100000:2.0:1788521213.548167:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201345920 00000100:00100000:2.0:1788521213.548170:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201345920 00000100:00100000:2.0:1788521213.548211:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 28 00000100:00100000:2.0:1788521213.548218:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201345920:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521213.548260:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201345920:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 43us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521213.548267:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 28 00000100:00080000:2.0:1788521213.548334:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788521213.555179:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201345536 00000100:00100000:3.0:1788521213.555191:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201345536 00000100:00100000:3.0:1788521213.555271:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201345664 00000100:00100000:3.0:1788521213.555275:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201345664 00000100:00100000:3.0:1788521213.555307:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 76 00000100:00100000:3.0:1788521213.555319:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+6:2395:x1875400201345536:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521213.555398:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+6:2395:x1875400201345536:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 81us (9270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521213.555405:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 76 00000100:00100000:3.0:1788521213.555424:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 77 00000100:00100000:3.0:1788521213.555431:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201345664:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521213.555459:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201345664:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 29us (9183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521213.555465:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 77 00000100:00080000:2.0:1788521213.555921:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788521213.555926:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521213.587280:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521213.587307:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222379008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788521213.587374:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521213.587444:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222379008 00000100:00100000:0.0:1788521213.587452:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222379008 00000100:00100000:0.0:1788521213.587499:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788521213.587508:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee435edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222379008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788521213.587541:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788521213.587588:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee435edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222379008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521213.587595:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788521213.587643:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222379008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788521213.592924:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222379136:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788521213.593018:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521213.596219:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222379136 00000100:00100000:0.0:1788521213.596232:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222379136 00000100:00100000:0.0:1788521213.596333:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788521213.596345:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222379136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788521213.596376:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521213.596461:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222379136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (3443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521213.596483:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1788521213.597366:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7a4ffb80 x1875400222379136/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521213.597404:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222379136:0@lo:13:osp-pre-1-1.0 00000020:00000080:3.0:1788521213.945385:0:10395:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb8b2d650 20000000:00000080:3.0:1788521213.945404:0:10395:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8fee43260c00 uarg=0000000000000000 20000000:01000000:3.0:1788521213.945451:0:10395:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788521213.945458:0:10395:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788521213.945463:0:10395:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788521213.946307:0:10396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788521213.946754:0:10395:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788521213.962956:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788521213.962989:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788521213.963019:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788521213.963039:0:10395:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788521213.963058:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fee42411c00/0x411dd0ee4d2d134b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521213.963076:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef413fcc00/0x411dd0ee4d2d0fe7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0fe0 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521213.963084:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef40030800/0x411dd0ee4d2d0ff5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d0fee expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521213.963091:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef413fce00/0x411dd0ee4d2d1049 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1042 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521213.963098:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef413fca00/0x411dd0ee4d2d116f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1168 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521213.963108:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fee42411800/0x411dd0ee4d2d1287 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed4a4 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521213.963116:0:10395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fee42411c00/0x411dd0ee4d2d134b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521213.963158:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fee42411800/0x411dd0ee4d2d1287 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed4a4 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521213.963172:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fee42411800/0x411dd0ee4d2d1287 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed4a4 expref: 9 pid: 6513 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521213.963202:0:10395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435eed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1875400222379264:192.168.203.41@tcp:104: 00010000:00010000:0.0:1788521213.963337:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef413fca00/0x411dd0ee4d2d116f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d1168 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521213.963345:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef413fca00/0x411dd0ee4d2d116f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1168 expref: 23 pid: 6512 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521213.963355:0:10395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435edf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1875400222379392:0@lo:104: 00000100:00100000:0.0:1788521213.963396:0:10395:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788521213.963435:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef413fce00/0x411dd0ee4d2d1049 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d1042 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521213.963443:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef413fce00/0x411dd0ee4d2d1049 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1042 expref: 23 pid: 6514 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521213.963451:0:10395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435eca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1875400222379520:0@lo:104: 00000100:00100000:0.0:1788521213.963475:0:10395:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788521213.963502:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef40030800/0x411dd0ee4d2d0ff5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d0fee expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521213.963511:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef40030800/0x411dd0ee4d2d0ff5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0fee expref: 23 pid: 6513 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521213.963519:0:10395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ece00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1875400222379648:0@lo:104: 00010000:00010000:0.0:1788521213.963542:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef413fcc00/0x411dd0ee4d2d0fe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d0fe0 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521213.963551:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef413fcc00/0x411dd0ee4d2d0fe7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0fe0 expref: 23 pid: 6513 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521213.963567:0:10395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ef800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1875400222379776:0@lo:104: 00000100:00100000:0.0:1788521213.963588:0:10395:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee434c6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788521213.963988:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788521213.964020:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521213.964047:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521213.964056:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222379392 00000100:00100000:3.0:1788521213.964063:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222379392 00000100:00100000:3.0:1788521213.964106:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222379520 00000100:00100000:3.0:1788521213.964110:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222379520 00000100:00100000:3.0:1788521213.964121:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222379648 00000100:00100000:3.0:1788521213.964123:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222379648 00000100:00100000:3.0:1788521213.964132:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222379776 00000100:00100000:3.0:1788521213.964134:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222379776 00000100:00100000:3.0:1788521213.964146:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788521213.964154:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee435ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+6:10395:x1875400222379392:12345-0@lo:104: 00010000:00010000:3.0:1788521213.964168:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef821dd200/0x411dd0ee4d2d1168 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d116f expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.964225:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788521213.964243:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee435ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+6:10395:x1875400222379392:12345-0@lo:104: Request processed in 79us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521213.964250:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788521213.964268:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788521213.964284:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f019050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+5:10395:x1875400222379520:12345-0@lo:104: 00010000:00010000:3.0:1788521213.964292:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef413fdc00/0x411dd0ee4d2d1042 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d1049 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.964353:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788521213.964359:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f019050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+5:10395:x1875400222379520:12345-0@lo:104: Request processed in 77us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521213.964365:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788521213.964398:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788521213.964406:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f070000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+4:10395:x1875400222379648:12345-0@lo:104: 00010000:00010000:3.0:1788521213.964416:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef749cb400/0x411dd0ee4d2d0fee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0ff5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.964450:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788521213.964455:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f070000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+4:10395:x1875400222379648:12345-0@lo:104: Request processed in 52us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521213.964460:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788521213.964472:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788521213.964479:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f070a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:10395:x1875400222379776:12345-0@lo:104: 00010000:00010000:3.0:1788521213.964486:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef40030400/0x411dd0ee4d2d0fe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0fe7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.964511:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788521213.964516:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f070a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:10395:x1875400222379776:12345-0@lo:104: Request processed in 38us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521213.964520:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1788521213.964543:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788521213.964555:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef821dd200/0x411dd0ee4d2d1168 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d116f expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.964562:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef821dd200 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:3.0:1788521213.964566:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef821dd200/0x411dd0ee4d2d1168 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d116f expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.964575:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef821dd200/0x411dd0ee4d2d1168 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d116f expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521213.964582:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef821dd200/0x411dd0ee4d2d1168 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d116f expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521213.964588:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788521213.964616:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef821dd200/0x411dd0ee4d2d1168 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d116f expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.964623:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521213.964644:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef821dd200/0x411dd0ee4d2d1168 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d116f expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.964652:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef821dd200/0x411dd0ee4d2d1168 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d116f expref: -99 pid: 9511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.964664:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788521213.964668:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef413fdc00/0x411dd0ee4d2d1042 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d1049 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.964673:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef413fdc00 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:3.0:1788521213.964676:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef413fdc00/0x411dd0ee4d2d1042 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d1049 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.964693:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef413fdc00/0x411dd0ee4d2d1042 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d1049 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521213.964699:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef413fdc00/0x411dd0ee4d2d1042 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d1049 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521213.964704:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788521213.964718:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef413fdc00/0x411dd0ee4d2d1042 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d1049 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.964723:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521213.964738:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef413fdc00/0x411dd0ee4d2d1042 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d1049 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.964745:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef413fdc00/0x411dd0ee4d2d1042 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d1049 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.964756:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788521213.964759:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef749cb400/0x411dd0ee4d2d0fee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0ff5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.964765:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cb400 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:3.0:1788521213.964767:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef749cb400/0x411dd0ee4d2d0fee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d0ff5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.964774:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef749cb400/0x411dd0ee4d2d0fee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d0ff5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521213.964787:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef749cb400/0x411dd0ee4d2d0fee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d0ff5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521213.964800:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788521213.964815:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef749cb400/0x411dd0ee4d2d0fee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0ff5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.964822:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521213.964830:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef749cb400/0x411dd0ee4d2d0fee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0ff5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.964836:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef749cb400/0x411dd0ee4d2d0fee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0ff5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.964846:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521213.964848:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef40030400/0x411dd0ee4d2d0fe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d0fe7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.964854:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40030400 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:3.0:1788521213.964856:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef40030400/0x411dd0ee4d2d0fe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d0fe7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.964863:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef40030400/0x411dd0ee4d2d0fe0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d0fe7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521213.964869:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef40030400/0x411dd0ee4d2d0fe0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d0fe7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521213.964874:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788521213.964913:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef40030400/0x411dd0ee4d2d0fe0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0fe7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.964919:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521213.964932:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef40030400/0x411dd0ee4d2d0fe0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0fe7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.964939:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef40030400/0x411dd0ee4d2d0fe0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d0fe7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.964951:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521213.964953:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521213.964955:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521213.964963:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521213.964968:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521213.964979:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222379904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521213.965014:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521213.965055:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788521213.965062:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222380288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521213.965083:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521213.965109:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222380032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521213.965130:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521213.965148:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788521213.965153:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222380160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521213.965173:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521213.965196:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222379904 00000100:00100000:3.0:1788521213.965201:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222379904 00010000:00010000:3.0:1788521213.965222:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef413fca00/0x411dd0ee4d2d116f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1168 expref: 24 pid: 6512 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521213.965254:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222380288 00000100:00100000:3.0:1788521213.965257:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222380288 00010000:00010000:3.0:1788521213.965270:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef413fcc00/0x411dd0ee4d2d0fe7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0fe0 expref: 25 pid: 6513 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521213.965289:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222380032 00000100:00100000:3.0:1788521213.965292:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222380032 00010000:00010000:3.0:1788521213.965304:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef413fce00/0x411dd0ee4d2d1049 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1042 expref: 26 pid: 6514 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521213.965313:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222380160 00000100:00100000:3.0:1788521213.965315:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222380160 00010000:00010000:3.0:1788521213.965325:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef40030800/0x411dd0ee4d2d0ff5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0fee expref: 27 pid: 6513 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521213.965336:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788521213.965342:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f070380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+27:3644:x1875400222379904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788521213.965352:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521213.965356:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef413fca00/0x411dd0ee4d2d116f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1168 expref: 27 pid: 6512 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.965365:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef413fca00/0x411dd0ee4d2d116f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1168 expref: 27 pid: 6512 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.965380:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521213.965408:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f070380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+27:3644:x1875400222379904:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521213.965414:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788521213.965426:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788521213.965433:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f072300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+26:3644:x1875400222380288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788521213.965440:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521213.965444:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef413fcc00/0x411dd0ee4d2d0fe7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0fe0 expref: 26 pid: 6513 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.965462:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef413fcc00/0x411dd0ee4d2d0fe7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0fe0 expref: 26 pid: 6513 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.965471:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521213.965491:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f072300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+26:3644:x1875400222380288:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521213.965497:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788521213.965507:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788521213.965513:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f070700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+25:3645:x1875400222380032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788521213.965520:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521213.965524:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef413fce00/0x411dd0ee4d2d1049 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1042 expref: 25 pid: 6514 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.965531:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef413fce00/0x411dd0ee4d2d1049 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1042 expref: 25 pid: 6514 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.965539:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521213.965563:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f070700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+25:3645:x1875400222380032:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521213.965569:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788521213.965581:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788521213.965588:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4e7e2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3645:x1875400222380160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788521213.965595:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521213.965599:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef40030800/0x411dd0ee4d2d0ff5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0fee expref: 24 pid: 6513 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.965607:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef40030800/0x411dd0ee4d2d0ff5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d0fee expref: 24 pid: 6513 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521213.965621:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521213.965643:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4e7e2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3645:x1875400222380160:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521213.965649:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788521213.965704:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222380160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521213.965711:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222380032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521213.965731:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f072d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222380288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521213.965739:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222379904:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521213.966502:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef413fca00/0x411dd0ee4d2d116f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d1168 expref: 23 pid: 6512 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521213.966517:0:10395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435edf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1875400222379392:0@lo:104: 00010000:00010000:0.0:1788521213.966526:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef413fce00/0x411dd0ee4d2d1049 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d1042 expref: 22 pid: 6514 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521213.966534:0:10395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435eca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1875400222379520:0@lo:104: 00010000:00010000:0.0:1788521213.966543:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef40030800/0x411dd0ee4d2d0ff5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d0fee expref: 21 pid: 6513 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521213.966553:0:10395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ece00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1875400222379648:0@lo:104: 00010000:00010000:0.0:1788521213.966562:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef413fcc00/0x411dd0ee4d2d0fe7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d0fe0 expref: 20 pid: 6513 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521213.966570:0:10395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ef800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1875400222379776:0@lo:104: 00000100:00100000:3.0:1788521213.968474:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521213.968557:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201346048 00000100:00100000:1.0:1788521213.968565:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201346048 00010000:00010000:1.0:1788521213.968602:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fee42411800/0x411dd0ee4d2d1287 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed4a4 expref: 10 pid: 6513 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521213.968651:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 39 00000100:00100000:1.0:1788521213.968662:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f071180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f234d90e-c25e-4162-a7b5-1cc50583b917+10:2396:x1875400201346048:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521213.968675:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521213.968680:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fee42411800/0x411dd0ee4d2d1287 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed4a4 expref: 10 pid: 6513 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521213.968692:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fee42411800/0x411dd0ee4d2d1287 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed4a4 expref: 10 pid: 6513 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521213.968714:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fee42411c00/0x411dd0ee4d2d134b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521213.968723:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fee42411c00/0x411dd0ee4d2d134b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521213.968738:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fee42411c00/0x411dd0ee4d2d134b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521213.968745:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fee42411c00/0x411dd0ee4d2d134b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521213.968765:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fee42411c00/0x411dd0ee4d2d134b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521213.968773:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fee42411c00/0x411dd0ee4d2d134b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521213.968780:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42411c00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:1.0:1788521213.968784:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fee42411c00/0x411dd0ee4d2d134b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521213.968793:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fee42411c00/0x411dd0ee4d2d134b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521213.968802:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fee42411c00/0x411dd0ee4d2d134b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521213.968812:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521213.968859:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f071180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f234d90e-c25e-4162-a7b5-1cc50583b917+10:2396:x1875400201346048:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 199us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521213.968867:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 39 00010000:00010000:0.0:1788521213.971416:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fee42411800/0x411dd0ee4d2d1287 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed4a4 expref: 9 pid: 6513 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521213.971441:0:10395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435eed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1875400222379264:192.168.203.41@tcp:104: 00010000:00010000:0.0:1788521213.971480:0:10395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fee42411c00/0x411dd0ee4d2d134b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521213.971490:0:10395:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fee42411c00/0x411dd0ee4d2d134b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521213.971517:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fee42411c00/0x411dd0ee4d2d134b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521213.971523:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fee42411c00/0x411dd0ee4d2d134b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521214.159921:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521215.017457:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521215.017491:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201346176 00000100:00100000:3.0:1788521215.017499:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201346176 00000100:00100000:3.0:1788521215.017553:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 256 00000100:00100000:3.0:1788521215.017564:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+9:6169:x1875400201346176:12345-192.168.203.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521215.017579:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521215.017599:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef749cb600/0x411dd0ee4d2d1352 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed4ea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521215.017624:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef749cb600/0x411dd0ee4d2d1352 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed4ea expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521215.017637:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef749cb600/0x411dd0ee4d2d1352 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed4ea expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521215.017663:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749cb600, rc 0) 00000100:00100000:3.0:1788521215.017713:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+10:6169:x1875400201346176:12345-192.168.203.41@tcp:101:ll_cfg_requeue.0 Request processed in 151us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521215.017721:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 256 00000100:00100000:3.0:1788521215.021113:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521215.021259:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201346304 00000100:00100000:1.0:1788521215.021269:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201346304 00000100:00100000:1.0:1788521215.021320:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 257 00000100:00100000:1.0:1788521215.021329:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+10:6169:x1875400201346304:12345-192.168.203.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521215.021481:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+10:6169:x1875400201346304:12345-192.168.203.41@tcp:501:ll_cfg_requeue.0 Request processed in 153us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521215.021490:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 257 00000100:00100000:3.0:1788521215.026285:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521215.026721:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201346432 00000100:00100000:2.0:1788521215.026746:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201346432 00000100:00100000:2.0:1788521215.026861:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 258 00000100:00100000:2.0:1788521215.026872:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+10:6169:x1875400201346432:12345-192.168.203.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521215.027050:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+10:6169:x1875400201346432:12345-192.168.203.41@tcp:503:ll_cfg_requeue.0 Request processed in 179us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521215.027059:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 258 00000100:00100000:1.0:1788521215.043688:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521215.044098:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201346560 00000100:00100000:3.0:1788521215.044107:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201346560 00000100:00100000:3.0:1788521215.044815:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 259 00000100:00100000:3.0:1788521215.044828:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+10:6727:x1875400201346560:12345-192.168.203.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788521215.045002:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+10:6727:x1875400201346560:12345-192.168.203.41@tcp:502:llog_process_th.0 Request processed in 167us (1310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521215.045011:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 259 00000100:00100000:3.0:1788521215.061322:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521215.061779:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201346688 00000100:00100000:2.0:1788521215.061790:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201346688 00000100:00100000:3.0:1788521215.066165:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 260 00000100:00100000:3.0:1788521215.066236:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+10:6727:x1875400201346688:12345-192.168.203.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788521215.066432:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+10:6727:x1875400201346688:12345-192.168.203.41@tcp:502:llog_process_th.0 Request processed in 254us (5119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521215.066440:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 260 10000000:01000000:0.0:1788521215.142665:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788521215.142675:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fef7675d800 from 4 10000000:01000000:0.0:1788521215.142680:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788521215.142727:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee42411800/0x411dd0ee4d2d1359 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521215.142739:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fee42411800/0x411dd0ee4d2d1359 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521215.142750:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fee42411800/0x411dd0ee4d2d1359 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521215.142835:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222380416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788521215.143251:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521215.143334:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee434c69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521215.143689:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222380416 00000100:00100000:3.0:1788521215.143698:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222380416 00000100:00100000:3.0:1788521215.143757:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788521215.144106:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:6517:x1875400222380416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521215.144121:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521215.144135:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fee42411e00/0x411dd0ee4d2d1360 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d1359 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521215.144167:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fee42411e00/0x411dd0ee4d2d1360 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1359 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521215.144191:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fee42411e00/0x411dd0ee4d2d1360 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1359 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521215.144200:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411e00, rc 0) 00000100:00100000:0.0:1788521215.144266:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222380416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 219us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521215.144272:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788521215.144447:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222380416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521215.144463:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fee42411800/0x411dd0ee4d2d1359 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1360 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521215.144474:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fee42411800/0x411dd0ee4d2d1359 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d1360 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521215.144560:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222380544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521215.144606:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521215.144637:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef81704f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788521215.144731:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222380544 00000100:00100000:3.0:1788521215.144736:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222380544 00000100:00100000:3.0:1788521215.144810:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788521215.144819:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222380544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521215.144960:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222380544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521215.144967:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788521215.145275:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222380544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521215.145311:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222380672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521215.145431:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521215.145460:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee434c69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521215.145498:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222380672 00000100:00100000:2.0:1788521215.145504:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222380672 00000100:00100000:2.0:1788521215.145602:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788521215.145609:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222380672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521215.145696:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222380672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521215.145703:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788521215.145825:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222380672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521215.146267:0:10426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10426:1875400222380800:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521215.146303:0:10426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521215.146534:0:10426:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee434c69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521215.146622:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222380800 00000100:00100000:2.0:1788521215.146628:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222380800 00000100:00100000:2.0:1788521215.146702:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788521215.146710:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:10426:x1875400222380800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521215.146819:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:10426:x1875400222380800:12345-0@lo:502:llog_process_th.0 Request processed in 110us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521215.146826:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788521215.147071:0:10426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10426:1875400222380800:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788521215.147098:0:10426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788521215.147108:0:10426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521215.147111:0:10426:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788521215.147116:0:10426:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fef7675d800 00000020:00000080:1.0:1788521215.147119:0:10426:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788521215.147201:0:10426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10426:1875400222380928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521215.147248:0:10426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521215.147263:0:10426:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4e6d0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788521215.147426:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222380928 00000100:00100000:2.0:1788521215.147431:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222380928 00000100:00100000:2.0:1788521215.147453:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788521215.147459:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:10426:x1875400222380928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521215.147611:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:10426:x1875400222380928:12345-0@lo:502:llog_process_th.0 Request processed in 151us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521215.147617:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788521215.149493:0:10426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10426:1875400222380928:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788521215.149610:0:10426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788521215.149618:0:10426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521215.149620:0:10426:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788521215.149625:0:10426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788521215.149850:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788521215.149878:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788521215.149905:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee42411800/0x411dd0ee4d2d1359 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1360 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521215.149917:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fee42411800/0x411dd0ee4d2d1359 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1360 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521215.149927:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788521215.149930:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fef76680800 from 4 10000000:01000000:2.0:1788521215.149932:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788521215.149964:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7000/0x411dd0ee4d2d1367 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521215.149972:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7000/0x411dd0ee4d2d1367 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521215.149993:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7000/0x411dd0ee4d2d1367 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521215.150015:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222381056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788521215.150071:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521215.150100:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef81704300 going to sleep for 11 seconds 00000100:00100000:1.0:1788521215.150252:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222381056 00000100:00100000:1.0:1788521215.150260:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222381056 00000100:00100000:1.0:1788521215.150308:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788521215.150317:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222381056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521215.150330:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521215.150443:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fee434aa800/0x411dd0ee4d2d136e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d1367 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521215.150468:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fee434aa800/0x411dd0ee4d2d136e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1367 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521215.150479:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fee434aa800/0x411dd0ee4d2d136e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1367 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521215.150488:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434aa800, rc 0) 00000100:00100000:1.0:1788521215.150608:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:6517:x1875400222381056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 290us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521215.150614:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788521215.150748:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222381056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521215.150771:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7000/0x411dd0ee4d2d1367 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d136e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521215.150780:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7000/0x411dd0ee4d2d1367 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d136e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521215.150847:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222381184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521215.150875:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521215.150913:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef81704300 going to sleep for 11 seconds 00000100:00100000:1.0:1788521215.151444:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222381184 00000100:00100000:1.0:1788521215.151451:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222381184 00000100:00100000:1.0:1788521215.151485:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788521215.151493:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:6517:x1875400222381184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521215.151676:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:6517:x1875400222381184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 183us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521215.151683:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788521215.151716:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222381184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521215.151750:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222381312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521215.152021:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521215.152595:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee434c69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521215.158015:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222381312 00000100:00100000:2.0:1788521215.158031:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222381312 00000100:00100000:2.0:1788521215.158643:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788521215.158669:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:6517:x1875400222381312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521215.159029:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:6517:x1875400222381312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 377us (7007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521215.159037:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788521215.159127:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222381312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521215.161497:0:10428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10428:1875400222381440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521215.162062:0:10428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521215.162106:0:10428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef81704300 going to sleep for 11 seconds 00000100:00100000:0.0:1788521215.162155:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222381440 00000100:00100000:0.0:1788521215.162162:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222381440 00000100:00100000:0.0:1788521215.162214:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788521215.162231:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:10428:x1875400222381440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521215.162363:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:10428:x1875400222381440:12345-0@lo:502:llog_process_th.0 Request processed in 141us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521215.162371:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788521215.162809:0:10428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10428:1875400222381440:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788521215.162846:0:10428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521215.162857:0:10428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521215.162859:0:10428:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788521215.162867:0:10428:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fef76680800 00000020:00000080:2.0:1788521215.162870:0:10428:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788521215.162975:0:10428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10428:1875400222381568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521215.163013:0:10428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521215.163028:0:10428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef81704300 going to sleep for 11 seconds 00000100:00100000:0.0:1788521215.163490:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222381568 00000100:00100000:0.0:1788521215.163496:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222381568 00000100:00100000:0.0:1788521215.163690:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788521215.163699:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:10428:x1875400222381568:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521215.163784:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:10428:x1875400222381568:12345-0@lo:502:llog_process_th.0 Request processed in 86us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521215.163790:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788521215.164981:0:10428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10428:1875400222381568:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788521215.165015:0:10428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521215.165022:0:10428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521215.165024:0:10428:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788521215.165028:0:10428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788521215.165270:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788521215.165290:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788521215.165300:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7000/0x411dd0ee4d2d1367 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d136e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521215.165311:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7000/0x411dd0ee4d2d1367 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d136e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521215.165321:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788521215.165323:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fef81580000 from 4 10000000:01000000:0.0:1788521215.165326:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788521215.165593:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee42410c00/0x411dd0ee4d2d1375 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521215.165602:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fee42410c00/0x411dd0ee4d2d1375 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521215.165611:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fee42410c00/0x411dd0ee4d2d1375 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521215.165631:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222381696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788521215.165686:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521215.165725:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788521215.165772:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222381696 00000100:00100000:2.0:1788521215.165778:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222381696 00000100:00100000:2.0:1788521215.165818:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788521215.165826:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:6517:x1875400222381696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521215.165922:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521215.165937:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef6d7b7200/0x411dd0ee4d2d137c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d1375 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521215.165962:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef6d7b7200/0x411dd0ee4d2d137c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1375 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521215.165972:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef6d7b7200/0x411dd0ee4d2d137c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1375 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521215.165988:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7200, rc 0) 00000100:00100000:2.0:1788521215.166024:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:6517:x1875400222381696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521215.166030:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788521215.166633:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222381696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521215.166659:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fee42410c00/0x411dd0ee4d2d1375 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d137c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521215.166669:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fee42410c00/0x411dd0ee4d2d1375 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d137c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521215.166732:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222381824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521215.166774:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521215.166802:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788521215.166958:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222381824 00000100:00100000:2.0:1788521215.166964:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222381824 00000100:00100000:2.0:1788521215.167027:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788521215.167035:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:6517:x1875400222381824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521215.167163:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:6517:x1875400222381824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521215.167170:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788521215.168099:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222381824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521215.168150:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222381952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521215.168197:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521215.168579:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222381952 00000100:00100000:0.0:1788521215.168585:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222381952 00000100:00100000:0.0:1788521215.168618:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788521215.168626:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:6517:x1875400222381952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521215.168717:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:6517:x1875400222381952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521215.168724:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788521215.168857:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef74a80240 going to sleep for 11 seconds 00000100:00100000:1.0:1788521215.168870:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222381952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521215.169209:0:10430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435eca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10430:1875400222382080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521215.169254:0:10430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521215.169271:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222382080 00000100:00100000:0.0:1788521215.169274:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222382080 00000100:00100000:0.0:1788521215.169291:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788521215.169297:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:10430:x1875400222382080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521215.169471:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:10430:x1875400222382080:12345-0@lo:502:llog_process_th.0 Request processed in 173us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521215.169478:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788521215.169522:0:10430:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521215.169540:0:10430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435eca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10430:1875400222382080:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788521215.169560:0:10430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521215.169569:0:10430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521215.169571:0:10430:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788521215.169579:0:10430:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fef81580000 00000020:00000080:0.0:1788521215.169581:0:10430:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788521215.170001:0:10430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435eca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10430:1875400222382208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521215.170036:0:10430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521215.170056:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222382208 00000100:00100000:0.0:1788521215.170060:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222382208 00000100:00100000:0.0:1788521215.170078:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788521215.170084:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:10430:x1875400222382208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521215.170456:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:10430:x1875400222382208:12345-0@lo:502:llog_process_th.0 Request processed in 371us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521215.170463:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788521215.170503:0:10430:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521215.170577:0:10430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435eca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10430:1875400222382208:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788521215.170599:0:10430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521215.170605:0:10430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521215.170607:0:10430:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788521215.170611:0:10430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788521215.170675:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788521215.170696:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788521215.170705:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee42410c00/0x411dd0ee4d2d1375 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d137c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521215.170716:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fee42410c00/0x411dd0ee4d2d1375 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d137c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521215.170739:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788521215.170742:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fef58328000 from 4 10000000:01000000:0.0:1788521215.170745:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788521215.170830:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee42410400/0x411dd0ee4d2d1383 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521215.170987:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fee42410400/0x411dd0ee4d2d1383 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521215.170997:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fee42410400/0x411dd0ee4d2d1383 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521215.171014:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435eca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222382336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788521215.171043:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521215.171096:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521215.171268:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222382336 00000100:00100000:2.0:1788521215.171273:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222382336 00000100:00100000:3.0:1788521215.171414:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788521215.171428:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:6517:x1875400222382336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521215.171438:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521215.171450:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef749cb400/0x411dd0ee4d2d138a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d1383 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521215.171470:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef749cb400/0x411dd0ee4d2d138a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1383 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521215.171480:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef749cb400/0x411dd0ee4d2d138a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1383 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521215.171487:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749cb400, rc 0) 00000100:00100000:3.0:1788521215.171533:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:6517:x1875400222382336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521215.171538:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788521215.171592:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435eca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222382336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521215.171604:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fee42410400/0x411dd0ee4d2d1383 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d138a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521215.171612:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fee42410400/0x411dd0ee4d2d1383 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d138a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521215.171658:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435eca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222382464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521215.171679:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521215.172077:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521215.172121:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222382464 00000100:00100000:1.0:1788521215.172127:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222382464 00000100:00100000:1.0:1788521215.172159:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788521215.172166:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:6517:x1875400222382464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521215.172318:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:6517:x1875400222382464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521215.172336:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788521215.172532:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435eca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222382464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521215.172565:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435eca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222382592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521215.172609:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521215.172629:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521215.172720:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222382592 00000100:00100000:1.0:1788521215.172724:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222382592 00000100:00100000:1.0:1788521215.172740:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788521215.172744:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:6517:x1875400222382592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521215.172844:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:6517:x1875400222382592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521215.172850:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788521215.175300:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435eca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222382592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521215.176333:0:10431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10431:1875400222382720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521215.176461:0:10431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521215.176500:0:10431:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee434c69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521215.176614:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222382720 00000100:00100000:1.0:1788521215.176621:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222382720 00000100:00100000:1.0:1788521215.176665:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788521215.176674:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:10431:x1875400222382720:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521215.177061:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:10431:x1875400222382720:12345-0@lo:502:llog_process_th.0 Request processed in 386us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521215.177069:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788521215.177278:0:10431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10431:1875400222382720:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788521215.177305:0:10431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521215.177314:0:10431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521215.177317:0:10431:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788521215.177324:0:10431:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fef58328000 00000020:00000080:2.0:1788521215.177327:0:10431:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788521215.177481:0:10431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10431:1875400222382848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521215.177597:0:10431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521215.177620:0:10431:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef816b7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788521215.177669:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222382848 00000100:00100000:3.0:1788521215.177674:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222382848 00000100:00100000:3.0:1788521215.177711:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788521215.177718:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:10431:x1875400222382848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521215.177817:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:10431:x1875400222382848:12345-0@lo:502:llog_process_th.0 Request processed in 100us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521215.177833:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788521215.178019:0:10431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:10431:1875400222382848:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788521215.178041:0:10431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521215.178047:0:10431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521215.178048:0:10431:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788521215.178052:0:10431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788521215.181094:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788521215.181127:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788521215.181205:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee42410400/0x411dd0ee4d2d1383 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d138a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521215.181217:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fee42410400/0x411dd0ee4d2d1383 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d138a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521215.182462:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521215.629162:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222382976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521215.630610:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521215.631005:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222382976 00000100:00100000:2.0:1788521215.631014:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222382976 00000100:00100000:2.0:1788521215.631076:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788521215.631086:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222382976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788521215.631118:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521215.631177:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222382976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521215.631184:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1788521215.631262:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7a4fea00 x1875400222382976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521231 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521215.631282:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222382976:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788521215.631428:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521215.631636:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788521215.639074:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222383104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788521215.639145:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521215.639427:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222383104 00000100:00100000:1.0:1788521215.639434:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222383104 00000100:00100000:1.0:1788521215.639492:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788521215.639502:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee435eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222383104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788521215.639525:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521215.639572:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee435eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222383104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521215.639580:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788521215.639636:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788521215.639768:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7a4fea00 x1875400222383104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521231 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521215.639787:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222383104:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788521216.206049:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521217.230036:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521218.190508:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222383232:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788521218.190610:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521218.190689:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222383232 00000100:00100000:0.0:1788521218.190697:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222383232 00000100:00100000:0.0:1788521218.190741:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788521218.190750:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee435ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222383232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788521218.190781:0:10099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788521218.190826:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee435ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222383232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521218.190850:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788521218.190924:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222383232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788521218.191704:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788521218.191717:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222383360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521218.191753:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521218.191802:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222383360 00000100:00100000:1.0:1788521218.191808:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222383360 00000100:00100000:1.0:1788521218.191846:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788521218.191854:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222383360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521218.191875:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521218.191926:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222383360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521218.191932:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1788521218.191963:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef767d0e00 x1875400222383360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521218.191992:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222383360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521218.205908:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222383872:0@lo:400:kworker.0 00000100:00100000:0.0:1788521218.205973:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521218.206001:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222384384:0@lo:400:kworker.0 00000100:00100000:0.0:1788521218.206020:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521218.206039:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788521218.206044:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222383488:0@lo:400:kworker.0 00000100:00100000:0.0:1788521218.206064:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521218.206093:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875400222384000:0@lo:400:kworker.0 00000100:00100000:0.0:1788521218.206112:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521218.206127:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222384512:0@lo:400:kworker.0 00000100:00100000:0.0:1788521218.206145:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521218.206169:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222383872 00000100:00100000:0.0:1788521218.206175:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222383872 00000100:00100000:0.0:1788521218.206227:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788521218.206236:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222383872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521218.206300:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222383872:12345-0@lo:400:kworker.0 Request processed in 65us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521218.206308:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788521218.206330:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222384384 00000100:00100000:0.0:1788521218.206334:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222384384 00000100:00100000:0.0:1788521218.206364:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788521218.206371:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222384384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521218.206416:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43504700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222384384:12345-0@lo:400:kworker.0 Request processed in 46us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521218.206422:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788521218.206439:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222384000 00000100:00100000:0.0:1788521218.206442:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222384000 00000100:00100000:0.0:1788521218.206465:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222384512 00000100:00100000:0.0:1788521218.206468:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222384512 00000100:00100000:0.0:1788521218.206485:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788521218.206498:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875400222384000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521218.206526:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875400222384000:12345-0@lo:400:kworker.0 Request processed in 30us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521218.206533:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788521218.206543:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788521218.206549:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222384512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521218.206589:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222384512:12345-0@lo:400:kworker.0 Request processed in 40us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521218.207811:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788521218.207898:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875400222384000:0@lo:400:kworker.0 00000100:00100000:0.0:1788521218.207913:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222384512:0@lo:400:kworker.0 00000100:00100000:0.0:1788521218.207924:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222383872:0@lo:400:kworker.0 00010000:00080000:0.0:1788521218.207937:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee435ef800 x1875400222384384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521218.207947:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222384384:0@lo:400:kworker.0 00000100:00100000:0.0:1788521218.207982:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222383616:0@lo:400:kworker.0 00000100:00100000:0.0:1788521218.208033:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521218.208060:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875400222384128:0@lo:400:kworker.0 00000100:00100000:0.0:1788521218.208081:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521218.208096:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222384640:0@lo:400:kworker.0 00000100:00100000:0.0:1788521218.208114:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521218.208132:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788521218.208138:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222383744:0@lo:400:kworker.0 00000100:00100000:0.0:1788521218.208158:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521218.208173:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222384256:0@lo:400:kworker.0 00000100:00100000:0.0:1788521218.208194:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521218.208225:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222384768:0@lo:400:kworker.0 00000100:00100000:0.0:1788521218.208246:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521218.208282:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222383616 00000100:00100000:0.0:1788521218.208288:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222383616 00000100:00100000:0.0:1788521218.208311:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222384128 00000100:00100000:0.0:1788521218.208313:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222384128 00000100:00100000:0.0:1788521218.208328:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222384640 00000100:00100000:0.0:1788521218.208330:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222384640 00000100:00100000:0.0:1788521218.208341:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222383744 00000100:00100000:0.0:1788521218.208343:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222383744 00000100:00100000:0.0:1788521218.208355:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788521218.208361:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222383616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521218.208400:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222383616:12345-0@lo:400:kworker.0 Request processed in 40us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521218.208406:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788521218.208417:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788521218.208422:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875400222384128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521218.208454:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875400222384128:12345-0@lo:400:kworker.0 Request processed in 32us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521218.208461:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788521218.208472:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788521218.208477:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222384640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521218.208499:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222384640:12345-0@lo:400:kworker.0 Request processed in 22us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521218.208504:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788521218.208513:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788521218.208517:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222383744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521218.208536:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222383744:12345-0@lo:400:kworker.0 Request processed in 20us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521218.208541:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788521218.208561:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222384256 00000100:00100000:0.0:1788521218.208564:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222384256 00000100:00100000:0.0:1788521218.208586:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222384768 00000100:00100000:0.0:1788521218.208589:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222384768 00000100:00100000:0.0:1788521218.213573:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788521218.213590:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43505f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222384256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521218.213678:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43505f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222384256:12345-0@lo:400:kworker.0 Request processed in 94us (5483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521218.213686:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788521218.213702:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788521218.213709:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222384768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521218.213735:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222384768:12345-0@lo:400:kworker.0 Request processed in 28us (5489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521218.213758:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788521218.213820:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222383744:0@lo:400:kworker.0 00010000:00080000:0.0:1788521218.213836:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee435ece00 x1875400222384256/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521218.213846:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222384256:0@lo:400:kworker.0 00010000:00080000:0.0:1788521218.213857:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43504380 x1875400222384768/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521218.213866:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222384768:0@lo:400:kworker.0 00000100:00100000:0.0:1788521218.213876:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222383616:0@lo:400:kworker.0 00010000:00080000:0.0:1788521218.213906:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee435ec380 x1875400222384128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521218.213915:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875400222384128:0@lo:400:kworker.0 00010000:00080000:0.0:1788521218.213927:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee435ee680 x1875400222384640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521218.213934:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222384640:0@lo:400:kworker.0 00000100:00100000:3.0:1788521218.215641:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222383488 00000100:00100000:3.0:1788521218.215653:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222383488 00000100:00100000:3.0:1788521218.215718:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788521218.215729:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3643:x1875400222383488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521218.215921:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3643:x1875400222383488:12345-0@lo:400:kworker.0 Request processed in 194us (9853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521218.215928:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:3.0:1788521218.215961:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788521218.215967:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788521218.215970:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788521218.215973:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788521218.222679:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222383488:0@lo:400:kworker.0 00010000:00010000:2.0:1788521218.258251:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521218.665436:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521218.665658:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521218.665699:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521218.665772:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521218.665805:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521218.665851:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201347072 00000100:00100000:0.0:1788521218.665861:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201347072 00000100:00100000:0.0:1788521218.665949:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201346944 00000100:00100000:0.0:1788521218.665953:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201346944 00000100:00100000:0.0:1788521218.665994:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 84 00000100:00100000:0.0:1788521218.666004:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2393:x1875400201347072:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521218.666097:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2393:x1875400201347072:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 95us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521218.666126:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 84 00000100:00100000:0.0:1788521218.666147:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 85 00000100:00100000:0.0:1788521218.666155:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+6:2393:x1875400201346944:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521218.666184:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+6:2393:x1875400201346944:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 30us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521218.666190:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 85 00000100:00080000:0.0:1788521218.666220:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788521218.666238:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788521218.668999:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201346816 00000100:00100000:1.0:1788521218.669013:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201346816 00000100:00100000:1.0:1788521218.669085:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 282 00000100:00100000:1.0:1788521218.669095:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+10:2393:x1875400201346816:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521218.669175:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+10:2393:x1875400201346816:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 82us (4718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521218.669183:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 282 00000100:00100000:2.0:1788521218.674854:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201347328 00000100:00100000:2.0:1788521218.674870:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201347328 00000100:00100000:2.0:1788521218.675190:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201347200 00000100:00100000:2.0:1788521218.675195:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201347200 00000100:00100000:2.0:1788521218.675249:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 32 00000100:00100000:2.0:1788521218.675259:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+5:2393:x1875400201347328:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521218.675343:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+5:2393:x1875400201347328:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 85us (9643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521218.675350:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 32 00000100:00100000:2.0:1788521218.675369:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 33 00000100:00100000:2.0:1788521218.675390:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+5:2393:x1875400201347200:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521218.675418:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+5:2393:x1875400201347200:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 30us (9613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521218.675424:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 33 00000100:00080000:3.0:1788521218.678359:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788521218.678369:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788521218.705655:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222384896:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788521218.705734:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521218.705812:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222384896 00000100:00100000:1.0:1788521218.705821:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222384896 00000100:00100000:1.0:1788521218.705867:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788521218.705876:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222384896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788521218.705947:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788521218.706020:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222384896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 145us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521218.706027:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788521218.706074:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222384896:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788521218.709213:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222385024:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788521218.709310:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521218.709380:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222385024 00000100:00100000:3.0:1788521218.709387:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222385024 00000100:00100000:3.0:1788521218.709699:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788521218.709710:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f072680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222385024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788521218.709732:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788521218.709780:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f072680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222385024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521218.709787:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1788521218.709828:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f070700 x1875400222385024/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521218.709847:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222385024:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788521219.277055:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521220.307975:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788521220.622675:0:10695:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg341-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1788521220.749228:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222385152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788521220.749302:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521220.749451:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222385152 00000100:00100000:2.0:1788521220.749459:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222385152 00000100:00100000:2.0:1788521220.749521:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788521220.749532:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222385152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788521220.749561:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521220.749603:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222385152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521220.749610:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1788521220.749691:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7a4fdc00 x1875400222385152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521236 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521220.749708:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222385152:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788521220.750209:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521220.750398:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788521220.750409:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222385280:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788521220.750440:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521220.752145:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222385280 00000100:00100000:2.0:1788521220.752156:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222385280 00000100:00100000:2.0:1788521220.752228:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788521220.752238:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222385280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788521220.752259:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521220.752319:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222385280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (1877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521220.752325:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788521220.753113:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788521220.753209:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7a4fd880 x1875400222385280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521236 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521220.753231:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222385280:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788521221.326039:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521222.354714:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521223.309751:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222385408:0@lo:400:kworker.0 00000100:00100000:1.0:1788521223.309824:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521223.309871:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222385920:0@lo:400:kworker.0 00000100:00100000:1.0:1788521223.309914:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521223.309930:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222386432:0@lo:400:kworker.0 00000100:00100000:1.0:1788521223.310033:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521223.310054:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4359a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222386944:0@lo:400:kworker.0 00000100:00100000:1.0:1788521223.310087:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521223.310113:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788521223.310119:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222385536:0@lo:400:kworker.0 00000100:00100000:1.0:1788521223.310141:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521223.310157:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875400222386048:0@lo:400:kworker.0 00000100:00100000:1.0:1788521223.310189:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521223.310205:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222386560:0@lo:400:kworker.0 00000100:00100000:1.0:1788521223.310226:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521223.310764:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222385408 00000100:00100000:0.0:1788521223.310772:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222385408 00000100:00100000:3.0:1788521223.312134:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222387072:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788521223.312203:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521223.312252:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875400222385792:0@lo:400:kworker.0 00000100:00100000:3.0:1788521223.312277:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521223.312295:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222386304:0@lo:400:kworker.0 00000100:00100000:3.0:1788521223.312317:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521223.312335:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222386816:0@lo:400:kworker.0 00000100:00100000:3.0:1788521223.312355:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521223.318385:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788521223.318408:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3643:x1875400222385408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521223.318503:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3643:x1875400222385408:12345-0@lo:400:kworker.0 Request processed in 107us (8679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521223.318510:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788521223.318555:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222385920 00000100:00100000:0.0:1788521223.318563:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222385920 00000100:00100000:0.0:1788521223.318615:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222387072 00000100:00100000:0.0:1788521223.318618:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222387072 00000100:00100000:0.0:1788521223.318633:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788521223.318638:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222385920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521223.318674:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222385920:12345-0@lo:400:kworker.0 Request processed in 35us (8759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521223.318680:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788521223.318702:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788521223.318709:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222387072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788521223.318736:0:10099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788521223.318775:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222387072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (6573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521223.318781:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788521223.318801:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222385536 00000100:00100000:0.0:1788521223.318805:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222385536 00000100:00100000:0.0:1788521223.318821:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222386048 00000100:00100000:0.0:1788521223.318824:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222386048 00000100:00100000:0.0:1788521223.318865:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222386560 00000100:00100000:0.0:1788521223.318868:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222386560 00000100:00100000:0.0:1788521223.318880:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222385792 00000100:00100000:0.0:1788521223.318899:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222385792 00000100:00100000:0.0:1788521223.318916:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788521223.318921:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222385536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521223.318962:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222385536:12345-0@lo:400:kworker.0 Request processed in 42us (8820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521223.318969:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788521223.318980:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788521223.318986:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875400222386048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521223.319014:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875400222386048:12345-0@lo:400:kworker.0 Request processed in 29us (8825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521223.319020:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788521223.319030:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788521223.319036:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222386560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521223.319060:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222386560:12345-0@lo:400:kworker.0 Request processed in 25us (8833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521223.319073:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788521223.319087:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788521223.319092:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875400222385792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521223.319121:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875400222385792:12345-0@lo:400:kworker.0 Request processed in 29us (6843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521223.319127:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788521223.319195:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222387072:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1788521223.322504:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521223.327974:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222386432 00000100:00100000:0.0:1788521223.327994:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222386432 00000100:00100000:0.0:1788521223.328130:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222386944 00000100:00100000:0.0:1788521223.328134:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222386944 00000100:00100000:0.0:1788521223.328150:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222386304 00000100:00100000:0.0:1788521223.328153:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222386304 00000100:00100000:0.0:1788521223.328178:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222386816 00000100:00100000:0.0:1788521223.328181:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222386816 00000100:00100000:0.0:1788521223.328200:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788521223.328210:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a705850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222386432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521223.328326:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a705850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222386432:12345-0@lo:400:kworker.0 Request processed in 116us (18291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521223.328334:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788521223.328488:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788521223.328495:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222386944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521223.328526:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222386944:12345-0@lo:400:kworker.0 Request processed in 32us (18439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521223.328533:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788521223.328543:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788521223.328556:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222386304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521223.328586:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222386304:12345-0@lo:400:kworker.0 Request processed in 31us (16268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521223.328591:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788521223.328601:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788521223.328607:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222386816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521223.328631:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222386816:12345-0@lo:400:kworker.0 Request processed in 25us (16276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521223.328638:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788521223.328662:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521223.328666:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521223.328696:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222385664:0@lo:400:kworker.0 00000100:00100000:0.0:1788521223.328730:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521223.328870:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222385664 00000100:00100000:0.0:1788521223.328876:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222385664 00000100:00100000:0.0:1788521223.328927:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788521223.328934:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222385664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521223.328964:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222385664:12345-0@lo:400:kworker.0 Request processed in 32us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521223.328970:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788521223.329002:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222385664:0@lo:400:kworker.0 00000100:00100000:0.0:1788521223.329009:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875400222386176:0@lo:400:kworker.0 00000100:00100000:0.0:1788521223.329032:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521223.329118:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222386176 00000100:00100000:0.0:1788521223.329122:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222386176 00000100:00100000:0.0:1788521223.329155:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788521223.329181:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875400222386176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521223.329214:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875400222386176:12345-0@lo:400:kworker.0 Request processed in 46us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521223.329221:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1788521223.329239:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788521223.329258:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee435ee300 x1875400222386176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521223.329268:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875400222386176:0@lo:400:kworker.0 00000100:00100000:0.0:1788521223.329275:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222386688:0@lo:400:kworker.0 00000100:00100000:0.0:1788521223.329340:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521223.329363:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222386688 00000100:00100000:0.0:1788521223.329367:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222386688 00000100:00100000:0.0:1788521223.329400:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788521223.329407:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222386688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521223.329437:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222386688:12345-0@lo:400:kworker.0 Request processed in 31us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521223.329444:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1788521223.329457:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788521223.329471:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee435eea00 x1875400222386688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521223.329481:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222386688:0@lo:400:kworker.0 00000100:00100000:0.0:1788521223.329487:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222387200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521223.329511:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521223.329536:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222387200 00000100:00100000:0.0:1788521223.329540:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222387200 00000100:00100000:0.0:1788521223.329578:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788521223.329585:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222387200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788521223.329607:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521223.329636:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222387200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521223.329641:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1788521223.329661:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43598700 x1875400222387200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521223.329674:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222387200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521223.330860:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222385536:0@lo:400:kworker.0 00000100:00100000:0.0:1788521223.330909:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875400222386048:0@lo:400:kworker.0 00000100:00100000:0.0:1788521223.330921:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222386560:0@lo:400:kworker.0 00000100:00100000:0.0:1788521223.330932:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222385408:0@lo:400:kworker.0 00000100:00100000:0.0:1788521223.330944:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222385920:0@lo:400:kworker.0 00010000:00080000:0.0:1788521223.330957:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee435ef480 x1875400222386432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521223.330966:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222386432:0@lo:400:kworker.0 00010000:00080000:0.0:1788521223.330977:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4359a300 x1875400222386944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521223.330984:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4359a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222386944:0@lo:400:kworker.0 00010000:00080000:0.0:1788521223.331034:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43598380 x1875400222386816/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521223.331698:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222386816:0@lo:400:kworker.0 00000100:00100000:0.0:1788521223.331730:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875400222385792:0@lo:400:kworker.0 00010000:00080000:0.0:1788521223.331744:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee435ef800 x1875400222386304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521223.331829:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222386304:0@lo:400:kworker.0 00010000:00010000:3.0:1788521223.378948:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521223.793015:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521223.793090:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521223.793116:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521223.793140:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201347712 00000100:00100000:1.0:1788521223.793149:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201347712 00000100:00100000:1.0:1788521223.793234:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201347584 00000100:00100000:1.0:1788521223.793238:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201347584 00000100:00100000:1.0:1788521223.793268:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 92 00000100:00100000:1.0:1788521223.793277:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2394:x1875400201347712:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521223.793345:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2394:x1875400201347712:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 69us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521223.793353:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 92 00000100:00100000:1.0:1788521223.793369:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 93 00000100:00100000:1.0:1788521223.793375:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+6:2394:x1875400201347584:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521223.793396:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+6:2394:x1875400201347584:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 22us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521223.793402:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 93 00000100:00080000:1.0:1788521223.793427:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788521223.793430:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788521223.794838:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201347456 00000100:00100000:2.0:1788521223.794852:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201347456 00000100:00100000:2.0:1788521223.794926:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 284 00000100:00100000:2.0:1788521223.794936:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+10:2394:x1875400201347456:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521223.794996:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+10:2394:x1875400201347456:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 62us (1991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521223.795013:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 284 00000100:00100000:1.0:1788521223.799037:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521223.799072:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521223.801559:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201347840 00000100:00100000:2.0:1788521223.801575:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201347840 00000100:00100000:2.0:1788521223.801685:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201347968 00000100:00100000:2.0:1788521223.801689:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201347968 00000100:00100000:3.0:1788521223.801728:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 18 00000100:00100000:3.0:1788521223.801745:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+5:2392:x1875400201347840:12345-192.168.203.41@tcp:9:kworker.0 00000020:00000080:3.0:1788521223.801783:0:8875:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d129c 00000100:00080000:3.0:1788521223.801792:0:8875:0:(import.c:65:import_set_state_nolock()) ffff8fef7f058000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788521223.801836:0:8875:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788521223.802014:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+2:2392:x1875400201347840:12345-192.168.203.41@tcp:9:kworker.0 Request processed in 276us (2986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521223.802022:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 18 00010000:00010000:3.0:1788521223.802077:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788521223.802483:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788521223.802487:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521223.802609:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 19 00000100:00100000:2.0:1788521223.802618:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2392:x1875400201347968:12345-192.168.203.41@tcp:9:kworker.0 00000020:00000080:2.0:1788521223.802640:0:8436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d12a3 00000100:00080000:2.0:1788521223.802648:0:8436:0:(import.c:65:import_set_state_nolock()) ffff8fef7efd5000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788521223.802690:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788521223.802791:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+2:2392:x1875400201347968:12345-192.168.203.41@tcp:9:kworker.0 Request processed in 174us (3718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521223.802798:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 19 00010000:00010000:0.0:1788521223.803702:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521223.822006:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788521223.822028:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222387328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788521223.822092:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521223.822149:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222387328 00000100:00100000:1.0:1788521223.822156:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222387328 00000100:00100000:1.0:1788521223.822211:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788521223.822220:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222387328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788521223.822244:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521223.822285:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222387328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521223.822292:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788521223.822331:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee41aa8e00 x1875400222387328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521223.822348:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222387328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788521223.822977:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222387456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788521223.823011:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521223.823049:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222387456 00000100:00100000:1.0:1788521223.823054:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222387456 00000100:00100000:1.0:1788521223.823085:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788521223.823092:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222387456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788521223.823118:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788521223.823177:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222387456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521223.823184:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788521223.823221:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222387456:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788521224.409132:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521225.426480:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788521225.497391:0:10939:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg341-server.virtnet: executing yml_node 00000100:00100000:1.0:1788521225.870021:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788521225.870043:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222387584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788521225.870106:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521225.870182:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222387584 00000100:00100000:1.0:1788521225.870190:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222387584 00000100:00100000:1.0:1788521225.870238:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788521225.870247:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222387584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788521225.870275:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521225.870316:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222387584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521225.870324:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788521225.870345:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788521225.870376:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee41aa8e00 x1875400222387584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521241 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521225.870395:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222387584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521225.870725:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788521225.870737:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222387712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788521225.870769:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521225.870917:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222387712 00000100:00100000:2.0:1788521225.870922:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222387712 00000100:00100000:2.0:1788521225.870962:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788521225.870970:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222387712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788521225.870982:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521225.871021:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222387712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521225.871027:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1788521225.871056:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7a4fe300 x1875400222387712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521241 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521225.871072:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222387712:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788521225.871129:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788521226.446315:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521227.469437:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521228.429563:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788521228.429584:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222387968:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788521228.429601:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4359a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222387840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521228.429656:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521228.429948:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222388224:0@lo:400:kworker.0 00000100:00100000:0.0:1788521228.430067:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875400222388480:0@lo:400:kworker.0 00000100:00100000:3.0:1788521228.438352:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521228.438440:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222388096:0@lo:400:kworker.0 00000100:00100000:3.0:1788521228.438489:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521228.438517:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222388608:0@lo:400:kworker.0 00000100:00100000:3.0:1788521228.438540:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521228.438559:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222389120:0@lo:400:kworker.0 00000100:00100000:3.0:1788521228.438580:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521228.438597:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222389632:0@lo:400:kworker.0 00000100:00100000:3.0:1788521228.438616:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521228.439831:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222388096 00000100:00100000:3.0:1788521228.439841:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222388096 00000100:00100000:3.0:1788521228.439914:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788521228.439924:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3644:x1875400222388096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521228.440056:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3644:x1875400222388096:12345-0@lo:400:kworker.0 Request processed in 133us (1565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521228.440076:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788521228.440111:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222389120 00000100:00100000:3.0:1788521228.440116:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222389120 00000100:00100000:3.0:1788521228.440160:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222389632 00000100:00100000:3.0:1788521228.440163:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222389632 00000100:00100000:3.0:1788521228.440183:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788521228.440190:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222389120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521228.440222:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222389120:12345-0@lo:400:kworker.0 Request processed in 34us (1641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521228.440229:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788521228.440240:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788521228.440247:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222389632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521228.440272:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222389632:12345-0@lo:400:kworker.0 Request processed in 26us (1654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521228.440278:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1788521228.440297:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788521228.440301:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521228.440332:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222388096:0@lo:400:kworker.0 00010000:00080000:3.0:1788521228.440346:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef766f4380 x1875400222389120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521228.440357:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222389120:0@lo:400:kworker.0 00010000:00080000:3.0:1788521228.440367:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43258e00 x1875400222389632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521228.440375:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222389632:0@lo:400:kworker.0 00000100:00100000:3.0:1788521228.440488:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222387840 00000100:00100000:3.0:1788521228.440499:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222387840 00000100:00100000:3.0:1788521228.440526:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788521228.440533:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222387840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788521228.440553:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788521228.440585:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222387840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (10929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521228.440591:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788521228.445145:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521228.445202:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875400222388736:0@lo:400:kworker.0 00000100:00100000:1.0:1788521228.445239:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521228.445256:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4325b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875400222389248:0@lo:400:kworker.0 00000100:00100000:1.0:1788521228.445299:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521228.445324:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788521228.445332:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222388352:0@lo:400:kworker.0 00000100:00100000:1.0:1788521228.445356:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521228.445373:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875400222388864:0@lo:400:kworker.0 00000100:00100000:1.0:1788521228.445391:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521228.445406:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222389376:0@lo:400:kworker.0 00000100:00100000:1.0:1788521228.445425:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521228.445459:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222387968 00000100:00100000:1.0:1788521228.445466:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222387968 00000100:00100000:1.0:1788521228.445501:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222388608 00000100:00100000:1.0:1788521228.445504:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222388608 00000100:00100000:1.0:1788521228.445513:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222388352 00000100:00100000:1.0:1788521228.445515:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222388352 00000100:00100000:1.0:1788521228.445527:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788521228.445534:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1875400222387968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788521228.445568:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788521228.445616:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1875400222387968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (7272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521228.445623:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788521228.445640:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788521228.445646:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222388608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521228.445673:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222388608:12345-0@lo:400:kworker.0 Request processed in 28us (7132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521228.445679:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788521228.445689:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788521228.445694:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222388352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521228.445731:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222388352:12345-0@lo:400:kworker.0 Request processed in 37us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521228.445737:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788521228.445755:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222388224 00000100:00100000:1.0:1788521228.445758:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222388224 00000100:00100000:1.0:1788521228.445775:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222388736 00000100:00100000:1.0:1788521228.445777:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222388736 00000100:00100000:1.0:1788521228.445797:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222389248 00000100:00100000:1.0:1788521228.445799:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222389248 00000100:00100000:1.0:1788521228.445808:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222388864 00000100:00100000:1.0:1788521228.445811:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222388864 00000100:00100000:1.0:1788521228.445820:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222389376 00000100:00100000:1.0:1788521228.445822:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222389376 00000100:00100000:1.0:1788521228.445834:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788521228.445839:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222388224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521228.445867:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222388224:12345-0@lo:400:kworker.0 Request processed in 28us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521228.445873:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788521228.445905:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788521228.445911:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875400222388736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521228.445939:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875400222388736:12345-0@lo:400:kworker.0 Request processed in 29us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521228.445945:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788521228.445955:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788521228.445961:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4325b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875400222389248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521228.446194:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788521228.446207:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875400222388864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521228.446240:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875400222388864:12345-0@lo:400:kworker.0 Request processed in 40us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521228.446247:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788521228.446258:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788521228.446264:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4325b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222389376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521228.446288:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4325b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222389376:12345-0@lo:400:kworker.0 Request processed in 25us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521228.446293:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788521228.446344:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222388352:0@lo:400:kworker.0 00010000:00080000:3.0:1788521228.446359:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef766f6d80 x1875400222388864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521228.446368:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875400222388864:0@lo:400:kworker.0 00010000:00080000:3.0:1788521228.446377:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43258380 x1875400222389376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521228.446385:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222389376:0@lo:400:kworker.0 00000100:00100000:3.0:1788521228.446407:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222388224:0@lo:400:kworker.0 00000100:00100000:3.0:1788521228.446416:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875400222388736:0@lo:400:kworker.0 00000100:00100000:3.0:1788521228.446451:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222388608:0@lo:400:kworker.0 00000100:00100000:3.0:1788521228.446465:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222387968:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1788521228.446492:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788521228.446496:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521228.446580:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4325b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875400222389248:12345-0@lo:400:kworker.0 Request processed in 612us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521228.446588:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788521228.447083:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4325b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875400222389248:0@lo:400:kworker.0 00010000:00080000:2.0:1788521228.449039:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4359a300 x1875400222387840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521228.449063:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4359a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222387840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521228.455770:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521228.455827:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222388992:0@lo:400:kworker.0 00000100:00100000:0.0:1788521228.455879:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521228.455925:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4325a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222389504:0@lo:400:kworker.0 00000100:00100000:0.0:1788521228.455946:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521228.456180:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222388480 00000100:00100000:1.0:1788521228.456180:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222388992 00000100:00100000:3.0:1788521228.456188:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222388480 00000100:00100000:1.0:1788521228.456188:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222388992 00000100:00100000:1.0:1788521228.456231:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222389504 00000100:00100000:1.0:1788521228.456234:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222389504 00000100:00100000:3.0:1788521228.456236:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788521228.456245:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875400222388480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521228.456254:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788521228.456259:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222388992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521228.456301:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875400222388480:12345-0@lo:400:kworker.0 Request processed in 56us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521228.456301:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222388992:12345-0@lo:400:kworker.0 Request processed in 41us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521228.456309:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788521228.456309:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788521228.456331:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1788521228.456352:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788521228.456355:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521228.456399:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222389504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521228.456430:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222389504:12345-0@lo:400:kworker.0 Request processed in 94us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521228.456436:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788521228.458033:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875400222388480:0@lo:400:kworker.0 00010000:00080000:0.0:1788521228.458050:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef766f6300 x1875400222388992/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521228.458060:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222388992:0@lo:400:kworker.0 00010000:00080000:0.0:1788521228.458086:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4325a300 x1875400222389504/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521228.458095:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4325a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222389504:0@lo:400:kworker.0 00010000:00010000:1.0:1788521228.493047:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521228.905416:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521228.905474:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521228.905519:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521228.905534:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201348096 00000100:00100000:2.0:1788521228.905552:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201348096 00000100:00100000:1.0:1788521228.905567:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201348352 00000100:00100000:1.0:1788521228.905577:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201348352 00000100:00100000:2.0:1788521228.905637:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 286 00000100:00100000:2.0:1788521228.905652:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+10:2396:x1875400201348096:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521228.905659:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201348224 00000100:00100000:1.0:1788521228.905665:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201348224 00000100:00100000:1.0:1788521228.905703:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 100 00000100:00100000:1.0:1788521228.905714:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4325a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2396:x1875400201348352:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521228.905753:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+10:2396:x1875400201348096:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 103us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521228.905763:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 286 00000100:00100000:1.0:1788521228.905785:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4325a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2396:x1875400201348352:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 72us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521228.905795:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 100 00000100:00100000:1.0:1788521228.905824:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 101 00000100:00100000:1.0:1788521228.905848:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4325b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+6:2396:x1875400201348224:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521228.905923:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4325b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+6:2396:x1875400201348224:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 36us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521228.905930:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 101 00000100:00080000:3.0:1788521228.906447:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788521228.906453:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788521228.941805:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222389760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788521228.941879:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521228.941980:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521228.941989:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222389888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788521228.942015:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521228.942150:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222389760 00000100:00100000:1.0:1788521228.942159:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222389760 00000100:00100000:1.0:1788521228.942221:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788521228.942230:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222389760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788521228.942267:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788521228.942332:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222389760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521228.942343:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788521228.942476:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222389760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788521228.942985:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222389888 00000100:00100000:3.0:1788521228.942999:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222389888 00000100:00100000:3.0:1788521228.943088:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788521228.943100:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222389888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788521228.943127:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788521228.943231:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43598e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222389888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 133us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521228.943262:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788521228.943283:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f071c00 x1875400222389888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521228.943308:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222389888:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788521229.518140:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788521229.635987:0:11122:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00000001:00100000:0.0:1788521229.966223:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fc75e887-507e-4861-8203-e266d82f5177 00000020:00000080:0.0:1788521229.966235:0:8430:0:(genops.c:885:class_export_put()) final put ffff8fef816f0000/fc75e887-507e-4861-8203-e266d82f5177 00000020:00000080:3.0:1788521229.966394:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef816f0000/fc75e887-507e-4861-8203-e266d82f5177 for lustre-OST0000 00000020:00000080:3.0:1788521229.966439:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fef7f058000 for lustre-OST0000 00000001:00100000:2.0:1788521229.988671:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fc75e887-507e-4861-8203-e266d82f5177 00000020:00000080:2.0:1788521229.988680:0:9512:0:(genops.c:885:class_export_put()) final put ffff8fef7efd3000/fc75e887-507e-4861-8203-e266d82f5177 00000020:00000080:3.0:1788521229.988753:0:477:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef7efd3000/fc75e887-507e-4861-8203-e266d82f5177 for lustre-OST0001 00000020:00000080:3.0:1788521229.988808:0:477:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fef7efd5000 for lustre-OST0001 00010000:00010000:0.0:1788521230.542586:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521230.989222:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222390016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521230.989318:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521230.990093:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222390016 00000100:00100000:2.0:1788521230.990104:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222390016 00000100:00100000:2.0:1788521230.990185:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788521230.990196:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222390016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788521230.990232:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521230.990299:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222390016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521230.990327:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1788521230.990386:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43258e00 x1875400222390016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521230.990409:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222390016:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788521230.990483:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521230.990597:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222390144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788521230.990642:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521230.991093:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222390144 00000100:00100000:1.0:1788521230.991099:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222390144 00000100:00100000:1.0:1788521230.991164:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788521230.991172:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222390144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788521230.991187:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521230.991228:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222390144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521230.991234:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1788521230.991414:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788521230.991441:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43258e00 x1875400222390144/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521230.991457:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222390144:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788521231.565552:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788521232.392328:0:11220:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00010000:00010000:3.0:1788521232.598317:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521233.549178:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788521233.549214:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222390272:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788521233.549321:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521233.549409:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222390400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521233.549448:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521233.549551:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222390400 00000100:00100000:2.0:1788521233.549562:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222390400 00000100:00100000:2.0:1788521233.549641:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788521233.549651:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222390400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788521233.549683:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788521233.549771:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222390272 00000100:00100000:3.0:1788521233.549781:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222390272 00000100:00100000:2.0:1788521233.549786:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222390400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521233.549796:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788521233.549852:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788521233.549865:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222390272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788521233.549933:0:10099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788521233.549987:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222390272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521233.549994:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1788521233.550018:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788521233.550251:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43598000 x1875400222390400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521233.550271:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222390400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521233.550289:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222390272:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788521233.550635:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875400222390656:0@lo:400:kworker.0 00000100:00100000:1.0:1788521233.550685:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521233.550724:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875400222391168:0@lo:400:kworker.0 00000100:00100000:1.0:1788521233.550747:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521233.550763:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875400222391680:0@lo:400:kworker.0 00000100:00100000:1.0:1788521233.550783:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521233.550801:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788521233.550807:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222390528:0@lo:400:kworker.0 00000100:00100000:1.0:1788521233.550834:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521233.550859:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875400222391040:0@lo:400:kworker.0 00000100:00100000:1.0:1788521233.550880:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521233.551089:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222390784:0@lo:400:kworker.0 00000100:00100000:1.0:1788521233.551239:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875400222391552:0@lo:400:kworker.0 00000100:00100000:1.0:1788521233.551261:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521233.555852:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521233.558277:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222390656 00000100:00100000:3.0:1788521233.558293:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222390656 00000100:00100000:3.0:1788521233.558364:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222391168 00000100:00100000:3.0:1788521233.558367:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222391168 00000100:00100000:3.0:1788521233.558398:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222391680 00000100:00100000:3.0:1788521233.558402:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222391680 00000100:00100000:3.0:1788521233.558415:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222391040 00000100:00100000:3.0:1788521233.558418:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222391040 00000100:00100000:3.0:1788521233.558428:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222391552 00000100:00100000:3.0:1788521233.558431:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222391552 00000100:00100000:3.0:1788521233.558447:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788521233.558457:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875400222390656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521233.558546:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875400222390656:12345-0@lo:400:kworker.0 Request processed in 91us (7861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521233.558554:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788521233.558571:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788521233.558578:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875400222391168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521233.558608:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875400222391168:12345-0@lo:400:kworker.0 Request processed in 32us (7860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521233.558614:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788521233.558624:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788521233.558630:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875400222391680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521233.558656:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875400222391680:12345-0@lo:400:kworker.0 Request processed in 27us (7872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521233.558662:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788521233.558671:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788521233.558677:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef8149a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875400222391040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521233.558704:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef8149a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875400222391040:12345-0@lo:400:kworker.0 Request processed in 28us (7822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521233.558718:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788521233.558733:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788521233.558739:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef81498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875400222391552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521233.558765:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef81498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875400222391552:12345-0@lo:400:kworker.0 Request processed in 28us (7504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521233.558771:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788521233.558798:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222390528 00000100:00100000:3.0:1788521233.558802:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222390528 00000100:00100000:3.0:1788521233.558828:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788521233.558834:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3644:x1875400222390528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521233.558863:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3644:x1875400222390528:12345-0@lo:400:kworker.0 Request processed in 30us (8029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521233.558961:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00080000:3.0:1788521233.559050:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788521233.559054:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788521233.560911:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222390784 00000100:00100000:0.0:1788521233.560924:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222390784 00000100:00100000:1.0:1788521233.560957:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222391296:0@lo:400:kworker.0 00000100:00100000:0.0:1788521233.560983:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788521233.560993:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222390784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521233.561060:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521233.561064:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222390784:12345-0@lo:400:kworker.0 Request processed in 72us (5217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521233.561074:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788521233.561091:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222391808:0@lo:400:kworker.0 00000100:00100000:1.0:1788521233.561128:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521233.561174:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222390784:0@lo:400:kworker.0 00000100:00100000:1.0:1788521233.561204:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788521233.561214:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222390912:0@lo:400:kworker.0 00000100:00100000:1.0:1788521233.561252:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521233.561279:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222391424:0@lo:400:kworker.0 00000100:00100000:3.0:1788521233.561301:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222390912 00000100:00100000:1.0:1788521233.561313:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521233.561343:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222391296 00000100:00100000:1.0:1788521233.561347:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222391296 00000100:00100000:1.0:1788521233.561387:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222391808 00000100:00100000:1.0:1788521233.561390:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222391808 00000100:00100000:2.0:1788521233.561400:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222391424 00000100:00100000:2.0:1788521233.561403:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222391424 00000100:00100000:1.0:1788521233.561411:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788521233.561421:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788521233.561427:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f077800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222391808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521233.561427:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f075f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222391296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521233.561466:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f075f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222391296:12345-0@lo:400:kworker.0 Request processed in 49us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521233.561472:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f077800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222391808:12345-0@lo:400:kworker.0 Request processed in 45us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521233.561474:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788521233.561478:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788521233.561488:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788521233.561494:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f075c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222391424:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788521233.561513:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788521233.561516:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521233.561519:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f075c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222391424:12345-0@lo:400:kworker.0 Request processed in 27us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521233.561534:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1788521233.561534:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7a4ffb80 x1875400222391424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521233.561544:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222391424:0@lo:400:kworker.0 00000100:00100000:3.0:1788521233.561553:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222390912 00010000:00080000:1.0:1788521233.561554:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7a4fdf80 x1875400222391296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521233.561565:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222391296:0@lo:400:kworker.0 00010000:00080000:1.0:1788521233.561578:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7a4fce00 x1875400222391808/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521233.561587:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222391808:0@lo:400:kworker.0 00000100:00100000:3.0:1788521233.561594:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788521233.561607:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222390912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521233.561642:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222390528:0@lo:400:kworker.0 00000100:00100000:1.0:1788521233.561660:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875400222391040:0@lo:400:kworker.0 00000100:00100000:3.0:1788521233.561665:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222390912:12345-0@lo:400:kworker.0 Request processed in 60us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521233.561677:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788521233.561687:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875400222391552:0@lo:400:kworker.0 00000100:00100000:1.0:1788521233.561701:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875400222390656:0@lo:400:kworker.0 00010000:00080000:1.0:1788521233.561712:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7a4ff800 x1875400222391168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521233.561720:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875400222391168:0@lo:400:kworker.0 00010000:00080000:1.0:1788521233.561731:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7a4fd180 x1875400222391680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521233.561748:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875400222391680:0@lo:400:kworker.0 00000100:00100000:0.0:1788521233.561959:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222390912:0@lo:400:kworker.0 00010000:00010000:0.0:1788521233.613125:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521234.021158:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521234.021260:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201348608 00000100:00100000:3.0:1788521234.021277:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201348608 00000100:00100000:3.0:1788521234.021391:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 108 00000100:00100000:3.0:1788521234.021414:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+6:2396:x1875400201348608:12345-192.168.203.41@tcp:400:kworker.0 00000100:00080000:1.0:1788521234.021525:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521234.021708:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+6:2396:x1875400201348608:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 306us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521234.021717:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 108 00000100:00100000:2.0:1788521234.027721:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521234.027777:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521234.028535:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201348480 00000100:00100000:3.0:1788521234.028550:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201348480 00000100:00100000:3.0:1788521234.028635:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 288 00000100:00100000:3.0:1788521234.028649:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+10:2395:x1875400201348480:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521234.028752:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+10:2395:x1875400201348480:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 106us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521234.028761:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 288 00000100:00100000:0.0:1788521234.028875:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201348736 00000100:00100000:0.0:1788521234.028921:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201348736 00000100:00100000:0.0:1788521234.029008:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 109 00000100:00100000:0.0:1788521234.029017:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+5:2396:x1875400201348736:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521234.029056:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+5:2396:x1875400201348736:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 42us (1279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521234.029063:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 109 00000100:00080000:3.0:1788521234.029302:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788521234.062878:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788521234.062928:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222391936:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788521234.063035:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521234.063558:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222392064:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788521234.063596:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521234.064295:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222391936 00000100:00100000:1.0:1788521234.064306:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222391936 00000100:00100000:1.0:1788521234.064378:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788521234.064388:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222391936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788521234.064433:0:10099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788521234.064501:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222391936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521234.064509:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788521234.064576:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222391936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788521234.066108:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222392064 00000100:00100000:0.0:1788521234.066123:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222392064 00000100:00100000:0.0:1788521234.066188:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788521234.066199:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222392064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788521234.066226:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521234.066320:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222392064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 123us (2722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521234.066328:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1788521234.069339:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f071c00 x1875400222392064/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521234.069379:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222392064:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788521234.637338:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788521234.864532:0:11317:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00010000:00010000:3.0:1788521235.661159:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521236.109188:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222392192:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788521236.109281:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521236.109436:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222392192 00000100:00100000:1.0:1788521236.109453:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222392192 00000100:00100000:1.0:1788521236.109533:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788521236.109545:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222392192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788521236.109581:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521236.109637:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222392192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521236.109644:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1788521236.109693:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f075880 x1875400222392192/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521252 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521236.109715:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222392192:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788521236.109765:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521236.110235:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788521236.110248:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222392320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788521236.110288:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521236.110317:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222392320 00000100:00100000:1.0:1788521236.110322:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222392320 00000100:00100000:1.0:1788521236.110355:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788521236.110362:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f074e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222392320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788521236.110375:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521236.110407:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f074e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222392320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521236.110414:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1788521236.110444:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f075880 x1875400222392320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521252 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521236.110458:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222392320:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788521236.110509:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1788521236.482328:0:11365:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 4 07:27:14 EDT 2026 00010000:00010000:3.0:1788521236.685177:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521237.713181:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521238.670083:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222392448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521238.670190:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521238.670279:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222392448 00000100:00100000:1.0:1788521238.670299:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222392448 00000100:00100000:1.0:1788521238.670364:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788521238.670374:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222392448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521238.670409:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521238.670460:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222392448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521238.670468:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788521238.670493:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788521238.670529:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f075880 x1875400222392448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521238.670548:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222392448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521238.670778:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788521238.670790:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222392576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788521238.670828:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521238.670859:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222392576 00000100:00100000:3.0:1788521238.670863:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222392576 00000100:00100000:3.0:1788521238.670922:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788521238.670941:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222392576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788521238.671119:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788521238.671159:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222392576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 221us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521238.671166:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788521238.671202:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222392576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788521238.672531:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222392704:0@lo:400:kworker.0 00000100:00100000:3.0:1788521238.672587:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521238.672780:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222392704 00000100:00100000:2.0:1788521238.672788:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222392704 00000100:00100000:2.0:1788521238.672838:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788521238.672847:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3644:x1875400222392704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521238.673052:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3644:x1875400222392704:12345-0@lo:400:kworker.0 Request processed in 205us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521238.673060:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788521238.673140:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222392704:0@lo:400:kworker.0 00000100:00100000:3.0:1788521238.673158:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788521238.673164:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f075180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222393088:0@lo:400:kworker.0 00000100:00100000:3.0:1788521238.673199:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521238.673266:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222393088 00000100:00100000:2.0:1788521238.673271:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222393088 00000100:00100000:2.0:1788521238.673313:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788521238.673321:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222393088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521238.673364:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222393088:12345-0@lo:400:kworker.0 Request processed in 45us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521238.673370:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788521238.673398:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f075180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222393088:0@lo:400:kworker.0 00000100:00100000:1.0:1788521238.673585:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222393600:0@lo:400:kworker.0 00000100:00100000:1.0:1788521238.673619:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521238.673681:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788521238.673687:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875400222393216:0@lo:400:kworker.0 00000100:00100000:1.0:1788521238.673716:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521238.673738:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222393728:0@lo:400:kworker.0 00000100:00100000:1.0:1788521238.673775:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521238.673809:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222393216 00000100:00100000:1.0:1788521238.673814:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222393216 00000100:00100000:1.0:1788521238.673858:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222393728 00000100:00100000:1.0:1788521238.673861:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222393728 00000100:00100000:1.0:1788521238.673923:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788521238.673932:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875400222393216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521238.673983:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875400222393216:12345-0@lo:400:kworker.0 Request processed in 53us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521238.673990:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788521238.674006:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788521238.674013:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4358f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222393728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521238.674040:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4358f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222393728:12345-0@lo:400:kworker.0 Request processed in 28us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521238.674046:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788521238.674087:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222392832:0@lo:400:kworker.0 00000100:00100000:1.0:1788521238.674115:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521238.674134:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f075500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875400222393344:0@lo:400:kworker.0 00000100:00100000:1.0:1788521238.674158:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521238.674173:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222393856:0@lo:400:kworker.0 00000100:00100000:1.0:1788521238.674194:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521238.674209:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788521238.674216:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222392960:0@lo:400:kworker.0 00000100:00100000:1.0:1788521238.674238:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521238.674248:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222393472:0@lo:400:kworker.0 00000100:00100000:1.0:1788521238.674266:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521238.674577:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222393984:0@lo:400:kworker.0 00000100:00100000:1.0:1788521238.674601:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521238.674648:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222393600 00000100:00100000:3.0:1788521238.674653:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222393600 00000100:00100000:3.0:1788521238.674692:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222393472 00000100:00100000:3.0:1788521238.674695:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222393472 00000100:00100000:3.0:1788521238.674721:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788521238.674729:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f075180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222393600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521238.674766:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f075180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222393600:12345-0@lo:400:kworker.0 Request processed in 39us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521238.674773:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788521238.674787:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788521238.674794:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4358c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222393472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521238.674822:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4358c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222393472:12345-0@lo:400:kworker.0 Request processed in 29us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521238.674837:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788521238.674857:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222392832 00000100:00100000:3.0:1788521238.674861:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222392832 00000100:00100000:3.0:1788521238.674879:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222393344 00000100:00100000:3.0:1788521238.674904:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222393344 00000100:00100000:3.0:1788521238.674919:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222393856 00000100:00100000:3.0:1788521238.674922:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222393856 00000100:00100000:3.0:1788521238.674935:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222392960 00000100:00100000:3.0:1788521238.674937:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222392960 00000100:00100000:3.0:1788521238.674951:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788521238.674958:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4358d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222392832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521238.674991:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4358d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222392832:12345-0@lo:400:kworker.0 Request processed in 34us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521238.674996:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788521238.675008:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788521238.675014:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4358ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875400222393344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521238.675040:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4358ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875400222393344:12345-0@lo:400:kworker.0 Request processed in 27us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521238.675046:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788521238.675057:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788521238.675075:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4358c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222393856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521238.675103:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4358c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222393856:12345-0@lo:400:kworker.0 Request processed in 40us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521238.675108:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788521238.675121:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788521238.675128:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4358e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222392960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521238.675166:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4358e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222392960:12345-0@lo:400:kworker.0 Request processed in 40us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521238.675172:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788521238.675504:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222392832:0@lo:400:kworker.0 00010000:00080000:1.0:1788521238.675516:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f075500 x1875400222393344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521238.675539:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f075500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875400222393344:0@lo:400:kworker.0 00010000:00080000:1.0:1788521238.675563:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f074700 x1875400222393856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521238.675571:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222393856:0@lo:400:kworker.0 00000100:00100000:1.0:1788521238.675597:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222392960:0@lo:400:kworker.0 00010000:00080000:1.0:1788521238.675607:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f076d80 x1875400222393472/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521238.675614:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222393472:0@lo:400:kworker.0 00000100:00080000:1.0:1788521238.675643:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788521238.675649:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788521238.675652:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521238.675674:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875400222393216:0@lo:400:kworker.0 00000100:00100000:1.0:1788521238.675687:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222393728:0@lo:400:kworker.0 00010000:00080000:1.0:1788521238.675697:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f074380 x1875400222393600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521238.675705:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222393600:0@lo:400:kworker.0 00000100:00100000:3.0:1788521238.676071:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222393984 00000100:00100000:3.0:1788521238.676078:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222393984 00000100:00100000:3.0:1788521238.676126:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788521238.676135:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4358e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222393984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521238.676194:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4358e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222393984:12345-0@lo:400:kworker.0 Request processed in 62us (1592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521238.676201:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1788521238.676234:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f076680 x1875400222393984/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521238.676244:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222393984:0@lo:400:kworker.0 00000100:00080000:1.0:1788521238.676377:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788521238.733207:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521239.154130:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521239.154203:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521239.154238:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521239.154306:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201349120 00000100:00100000:2.0:1788521239.154326:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201349120 00000100:00100000:2.0:1788521239.154389:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201348992 00000100:00100000:2.0:1788521239.154393:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201348992 00000100:00100000:2.0:1788521239.154431:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 116 00000100:00100000:2.0:1788521239.154441:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4358fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+5:2396:x1875400201349120:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521239.154510:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4358fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+5:2396:x1875400201349120:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 70us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521239.154517:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 116 00000100:00100000:2.0:1788521239.154535:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 117 00000100:00100000:2.0:1788521239.154541:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4358df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+6:2396:x1875400201348992:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521239.154565:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4358df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+6:2396:x1875400201348992:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 24us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521239.154572:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 117 00000100:00080000:1.0:1788521239.154732:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788521239.154736:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788521239.155127:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201348864 00000100:00100000:3.0:1788521239.155132:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201348864 00000100:00100000:3.0:1788521239.155206:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 290 00000100:00100000:3.0:1788521239.155215:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+10:2396:x1875400201348864:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521239.155261:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+10:2396:x1875400201348864:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 47us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521239.155268:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 290 00000100:00100000:3.0:1788521239.182170:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788521239.182203:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222394112:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788521239.182274:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521239.182335:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222394112 00000100:00100000:3.0:1788521239.182354:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222394112 00000100:00100000:3.0:1788521239.182404:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788521239.182699:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222394112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788521239.182722:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788521239.182767:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222394112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 355us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521239.182776:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1788521239.182820:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef766f4700 x1875400222394112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521239.182839:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222394112:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788521239.191253:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521239.191274:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222394240:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788521239.191340:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521239.191395:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222394240 00000100:00100000:2.0:1788521239.191401:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222394240 00000100:00100000:2.0:1788521239.191452:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788521239.191461:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222394240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788521239.191493:0:10099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788521239.191535:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222394240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521239.191543:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788521239.191586:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222394240:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788521239.760244:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521240.781197:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521241.229379:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788521241.229401:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4358f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222394368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788521241.229469:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521241.229548:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222394368 00000100:00100000:3.0:1788521241.229557:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222394368 00000100:00100000:2.0:1788521241.229599:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222394496:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788521241.229622:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788521241.229636:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4358ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222394368:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521241.229648:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788521241.229665:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788521241.229718:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4358ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222394368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521241.229725:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788521241.229741:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222394496 00000100:00100000:3.0:1788521241.229743:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222394496 00010000:00080000:2.0:1788521241.229755:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4358f800 x1875400222394368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521257 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521241.229760:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788521241.229765:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222394496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788521241.229773:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521241.229773:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4358f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222394368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521241.229796:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222394496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 31us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521241.229811:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1788521241.229813:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7a4fca80 x1875400222394496/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521257 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521241.229829:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222394496:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788521241.230147:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788521241.805151:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521242.829855:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521243.790365:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4358dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222394624:0@lo:400:kworker.0 00000100:00100000:1.0:1788521243.790441:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521243.790488:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4358c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222395136:0@lo:400:kworker.0 00000100:00100000:1.0:1788521243.790516:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521243.790534:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222395648:0@lo:400:kworker.0 00000100:00100000:1.0:1788521243.790555:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521243.790571:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222396160:0@lo:400:kworker.0 00000100:00100000:1.0:1788521243.790591:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521243.790615:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788521243.790621:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4358d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222394752:0@lo:400:kworker.0 00000100:00100000:1.0:1788521243.790644:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521243.790662:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4358ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875400222395264:0@lo:400:kworker.0 00000100:00100000:1.0:1788521243.790696:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521243.790717:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222395776:0@lo:400:kworker.0 00000100:00100000:1.0:1788521243.790739:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521243.790767:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4358ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222394880:0@lo:400:kworker.0 00000100:00100000:1.0:1788521243.790786:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521243.790816:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4358d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875400222395392:0@lo:400:kworker.0 00000100:00100000:1.0:1788521243.790836:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521243.790853:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222395904:0@lo:400:kworker.0 00000100:00100000:1.0:1788521243.790917:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521243.790930:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788521243.790936:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4358f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222395008:0@lo:400:kworker.0 00000100:00100000:1.0:1788521243.790953:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521243.790962:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4358f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222395520:0@lo:400:kworker.0 00000100:00100000:1.0:1788521243.790976:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521243.790992:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222396032:0@lo:400:kworker.0 00000100:00100000:1.0:1788521243.791008:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521243.791049:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222394624 00000100:00100000:1.0:1788521243.791057:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222394624 00000100:00100000:0.0:1788521243.791259:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222396288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521243.791287:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521243.791354:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788521243.791364:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3643:x1875400222394624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521243.791405:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3643:x1875400222394624:12345-0@lo:400:kworker.0 Request processed in 42us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521243.791412:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788521243.794470:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222395136 00000100:00100000:2.0:1788521243.794484:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222395136 00000100:00100000:2.0:1788521243.794536:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222394880 00000100:00100000:2.0:1788521243.794540:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222394880 00000100:00100000:2.0:1788521243.794559:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788521243.794575:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222395136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521243.794659:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222395136:12345-0@lo:400:kworker.0 Request processed in 87us (4142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521243.794668:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788521243.794684:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788521243.794690:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222394880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521243.794732:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222394880:12345-0@lo:400:kworker.0 Request processed in 42us (3944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521243.794738:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788521243.794759:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222394752 00000100:00100000:2.0:1788521243.794763:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222394752 00000100:00100000:2.0:1788521243.794781:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222395264 00000100:00100000:2.0:1788521243.794784:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222395264 00000100:00100000:0.0:1788521243.797094:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222396288 00000100:00100000:0.0:1788521243.797108:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222396288 00000100:00100000:0.0:1788521243.797184:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788521243.797197:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222396288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788521243.797228:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521243.797301:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222396288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (6012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521243.797308:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1788521243.797333:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788521243.797382:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43598a80 x1875400222396288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521259 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521243.797404:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222396288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521243.797447:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4358dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222394624:0@lo:400:kworker.0 00000100:00100000:0.0:1788521243.797461:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4358c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222395136:0@lo:400:kworker.0 00000100:00100000:0.0:1788521243.797543:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222395648 00000100:00100000:0.0:1788521243.797548:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222395648 00000100:00100000:0.0:1788521243.797573:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222396160 00000100:00100000:0.0:1788521243.797577:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222396160 00000100:00100000:0.0:1788521243.797588:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222395520 00000100:00100000:0.0:1788521243.797591:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222395520 00000100:00100000:0.0:1788521243.797608:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222396032 00000100:00100000:0.0:1788521243.797611:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222396032 00000100:00100000:0.0:1788521243.797626:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788521243.797632:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f074700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222395648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521243.797671:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f074700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222395648:12345-0@lo:400:kworker.0 Request processed in 40us (7114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521243.797678:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788521243.797690:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788521243.797696:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f075500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222396160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521243.797724:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f075500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222396160:12345-0@lo:400:kworker.0 Request processed in 29us (7132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521243.797730:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788521243.797740:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788521243.797746:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222395520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521243.797775:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222395520:12345-0@lo:400:kworker.0 Request processed in 29us (6797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521243.798107:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222395776 00000100:00100000:2.0:1788521243.798120:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222395776 00000100:00100000:2.0:1788521243.798137:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222395392 00000100:00100000:2.0:1788521243.798140:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222395392 00000100:00100000:2.0:1788521243.798151:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222395904 00000100:00100000:2.0:1788521243.798153:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222395904 00000100:00100000:2.0:1788521243.798166:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222395008 00000100:00100000:2.0:1788521243.798169:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222395008 00000100:00100000:2.0:1788521243.798181:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788521243.798188:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222394752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521243.798226:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222394752:12345-0@lo:400:kworker.0 Request processed in 39us (7581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521243.798232:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788521243.798246:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788521243.798251:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875400222395264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521243.798278:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875400222395264:12345-0@lo:400:kworker.0 Request processed in 27us (7581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521243.798284:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788521243.798295:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788521243.798300:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222395776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521243.798324:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222395776:12345-0@lo:400:kworker.0 Request processed in 25us (7584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521243.798329:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788521243.798338:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788521243.798343:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875400222395392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521243.798368:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875400222395392:12345-0@lo:400:kworker.0 Request processed in 24us (7530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521243.798373:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788521243.798392:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788521243.798398:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222395904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521243.798426:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222395904:12345-0@lo:400:kworker.0 Request processed in 29us (7509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521243.798432:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788521243.798443:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788521243.798449:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222395008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521243.798478:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222395008:12345-0@lo:400:kworker.0 Request processed in 30us (7524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521243.798484:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788521243.798898:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4358f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222395008:0@lo:400:kworker.0 00010000:00080000:1.0:1788521243.798916:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4358f800 x1875400222395520/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521243.798925:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4358f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222395520:0@lo:400:kworker.0 00000100:00100000:1.0:1788521243.798936:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4358ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222394880:0@lo:400:kworker.0 00010000:00080000:1.0:1788521243.798945:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4358d180 x1875400222395392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521243.798953:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4358d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875400222395392:0@lo:400:kworker.0 00010000:00080000:1.0:1788521243.798962:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f076300 x1875400222395904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521243.798978:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222395904:0@lo:400:kworker.0 00000100:00100000:0.0:1788521243.799328:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788521243.799386:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788521243.799396:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222396032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521243.799444:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222396032:12345-0@lo:400:kworker.0 Request processed in 50us (8434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521243.799451:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788521243.800135:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788521243.800151:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222396416:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788521243.800194:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521243.800315:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222396416 00000100:00100000:2.0:1788521243.800322:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222396416 00000100:00100000:2.0:1788521243.800363:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788521243.800370:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222396416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788521243.800398:0:10099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788521243.800436:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222396416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521243.800442:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788521243.800505:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222396416:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1788521243.801436:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788521243.801444:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788521243.801448:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521243.801464:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521243.801501:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4358d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222394752:0@lo:400:kworker.0 00000100:00100000:2.0:1788521243.801515:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4358ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875400222395264:0@lo:400:kworker.0 00000100:00100000:2.0:1788521243.801527:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222395776:0@lo:400:kworker.0 00010000:00080000:2.0:1788521243.801542:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f076680 x1875400222395648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521243.801552:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222395648:0@lo:400:kworker.0 00010000:00080000:2.0:1788521243.801563:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f076d80 x1875400222396160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521243.801570:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222396160:0@lo:400:kworker.0 00010000:00080000:1.0:1788521243.812441:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f077100 x1875400222396032/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521243.812460:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222396032:0@lo:400:kworker.0 00010000:00010000:3.0:1788521243.853069:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521244.264565:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521244.264621:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521244.264667:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521244.264674:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201349248 00000100:00100000:3.0:1788521244.264687:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201349248 00000100:00100000:3.0:1788521244.264776:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 292 00000100:00100000:3.0:1788521244.264802:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+10:2393:x1875400201349248:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521244.264876:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+10:2393:x1875400201349248:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 91us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521244.264920:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 292 00000100:00100000:2.0:1788521244.264949:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201349376 00000100:00100000:2.0:1788521244.264960:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201349376 00000100:00100000:2.0:1788521244.265052:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201349504 00000100:00100000:2.0:1788521244.265056:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201349504 00000100:00100000:2.0:1788521244.265084:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 124 00000100:00100000:2.0:1788521244.265095:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+6:2394:x1875400201349376:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521244.265174:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+6:2394:x1875400201349376:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 80us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521244.265182:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 124 00000100:00100000:2.0:1788521244.265200:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 125 00000100:00100000:2.0:1788521244.265207:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+5:2393:x1875400201349504:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521244.265239:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+5:2393:x1875400201349504:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 32us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521244.265269:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 125 00000100:00080000:3.0:1788521244.265394:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788521244.265401:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521244.301456:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222396544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788521244.301523:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521244.301709:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222396544 00000100:00100000:0.0:1788521244.301717:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222396544 00000100:00100000:0.0:1788521244.301779:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788521244.301800:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222396544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788521244.301823:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521244.301880:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222396544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521244.301897:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222396672:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788521244.301912:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788521244.301937:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788521244.301958:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43598a80 x1875400222396544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521244.301975:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222396672 00000100:00100000:0.0:1788521244.301978:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222396544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788521244.301981:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222396672 00000100:00100000:2.0:1788521244.302014:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788521244.302032:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222396672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788521244.302058:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788521244.302101:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222396672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521244.302108:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788521244.303436:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222396672:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788521244.880263:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521245.901085:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521246.350947:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4321f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222396800:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788521246.351043:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521246.351110:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788521246.351119:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222396928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521246.351145:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521246.351174:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222396800 00000100:00100000:0.0:1788521246.351181:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222396800 00000100:00100000:0.0:1788521246.351223:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222396928 00000100:00100000:0.0:1788521246.351226:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222396928 00000100:00100000:0.0:1788521246.351240:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788521246.351248:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222396800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788521246.351276:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521246.351337:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222396800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521246.351345:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788521246.351359:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788521246.351366:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43599500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222396928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788521246.351375:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521246.351400:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43599500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222396928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521246.351406:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1788521246.351424:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788521246.351448:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43598a80 x1875400222396928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521262 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521246.351465:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222396928:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788521246.351490:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4321f480 x1875400222396800/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521262 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521246.351501:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4321f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222396800:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788521246.929194:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521247.949151:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521248.909278:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521248.909298:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222397056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521248.909358:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521248.909416:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222397056 00000100:00100000:0.0:1788521248.909423:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222397056 00000100:00100000:0.0:1788521248.909472:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788521248.909481:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222397056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788521248.909525:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521248.909568:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222397056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521248.909580:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1788521248.909601:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788521248.909630:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43598a80 x1875400222397056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521248.909647:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222397056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521248.909838:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875400222397568:0@lo:400:kworker.0 00000100:00100000:2.0:1788521248.909869:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521248.909915:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee437c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222398080:0@lo:400:kworker.0 00000100:00100000:1.0:1788521248.910015:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875400222397312:0@lo:400:kworker.0 00000100:00100000:1.0:1788521248.910044:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521248.910062:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee437c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875400222397824:0@lo:400:kworker.0 00000100:00100000:1.0:1788521248.910079:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521248.910095:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee437c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875400222398336:0@lo:400:kworker.0 00000100:00100000:1.0:1788521248.910112:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521248.910128:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788521248.910132:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222397184:0@lo:400:kworker.0 00000100:00100000:1.0:1788521248.910153:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521248.910173:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee437c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222397696:0@lo:400:kworker.0 00000100:00100000:1.0:1788521248.910192:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521248.910208:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee437c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222398208:0@lo:400:kworker.0 00000100:00100000:1.0:1788521248.910227:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521248.910258:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222397568 00000100:00100000:1.0:1788521248.910262:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222397568 00000100:00100000:1.0:1788521248.910291:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222397312 00000100:00100000:1.0:1788521248.910295:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222397312 00000100:00100000:1.0:1788521248.910304:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222397824 00000100:00100000:1.0:1788521248.910306:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222397824 00000100:00100000:1.0:1788521248.910320:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222398336 00000100:00100000:1.0:1788521248.910322:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222398336 00000100:00100000:1.0:1788521248.910334:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788521248.910339:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee437c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875400222397568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521248.910370:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee437c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875400222397568:12345-0@lo:400:kworker.0 Request processed in 31us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521248.910376:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788521248.910389:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788521248.910394:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875400222397312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521248.910423:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875400222397312:12345-0@lo:400:kworker.0 Request processed in 29us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521248.910429:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788521248.910440:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788521248.910445:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875400222397824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521248.910469:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875400222397824:12345-0@lo:400:kworker.0 Request processed in 24us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521248.910475:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788521248.910485:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788521248.910490:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875400222398336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521248.910515:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875400222398336:12345-0@lo:400:kworker.0 Request processed in 25us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521248.910520:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788521248.910541:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222397184 00000100:00100000:1.0:1788521248.910550:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222397184 00000100:00100000:1.0:1788521248.910576:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1788521248.910582:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3644:x1875400222397184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521248.910611:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3644:x1875400222397184:12345-0@lo:400:kworker.0 Request processed in 29us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521248.910617:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1788521248.910642:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222397696 00000100:00100000:1.0:1788521248.910645:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222397696 00000100:00100000:1.0:1788521248.910668:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788521248.910675:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222397696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521248.910705:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222397696:12345-0@lo:400:kworker.0 Request processed in 30us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521248.910711:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788521248.910738:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222397184:0@lo:400:kworker.0 00000100:00100000:1.0:1788521248.910748:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee437c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222397696:0@lo:400:kworker.0 00000100:00100000:1.0:1788521248.910757:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875400222397312:0@lo:400:kworker.0 00000100:00100000:1.0:1788521248.910765:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee437c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875400222397824:0@lo:400:kworker.0 00000100:00100000:1.0:1788521248.910772:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee437c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875400222398336:0@lo:400:kworker.0 00000100:00080000:0.0:1788521248.910857:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521248.910919:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521248.911002:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee437c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222398592:0@lo:400:kworker.0 00000100:00100000:2.0:1788521248.911026:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521248.911056:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875400222397568:0@lo:400:kworker.0 00000100:00100000:2.0:1788521248.911066:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788521248.911072:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222397440:0@lo:400:kworker.0 00000100:00100000:2.0:1788521248.911098:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521248.911115:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee437c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875400222397952:0@lo:400:kworker.0 00000100:00100000:2.0:1788521248.911133:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521248.911147:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee437c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875400222398464:0@lo:400:kworker.0 00000100:00100000:2.0:1788521248.911173:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521248.911197:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222397952 00000100:00100000:2.0:1788521248.911200:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222397952 00000100:00100000:2.0:1788521248.911224:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222398464 00000100:00100000:2.0:1788521248.911227:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222398464 00000100:00100000:2.0:1788521248.911239:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788521248.911245:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee437c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875400222397952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521248.911275:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee437c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875400222397952:12345-0@lo:400:kworker.0 Request processed in 31us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521248.911281:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788521248.911292:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788521248.911297:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee437c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875400222398464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521248.911318:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee437c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875400222398464:12345-0@lo:400:kworker.0 Request processed in 21us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521248.911323:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788521248.911336:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222398208 00000100:00100000:2.0:1788521248.911339:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222398208 00000100:00100000:2.0:1788521248.911356:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222398080 00000100:00100000:2.0:1788521248.911358:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222398080 00000100:00100000:2.0:1788521248.911367:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222398592 00000100:00100000:2.0:1788521248.911369:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222398592 00000100:00100000:2.0:1788521248.911380:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788521248.911385:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222398208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521248.911411:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222398208:12345-0@lo:400:kworker.0 Request processed in 27us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521248.911416:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788521248.911426:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788521248.911431:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee437c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222398080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521248.911460:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee437c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222398080:12345-0@lo:400:kworker.0 Request processed in 29us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521248.911466:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788521248.911477:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788521248.911482:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee437c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222398592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521248.911507:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee437c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222398592:12345-0@lo:400:kworker.0 Request processed in 25us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521248.911512:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788521248.911554:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222397440 00000100:00100000:2.0:1788521248.911558:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222397440 00000100:00100000:2.0:1788521248.911577:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788521248.911583:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6e535850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222397440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521248.911611:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6e535850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222397440:12345-0@lo:400:kworker.0 Request processed in 29us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521248.911616:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:1.0:1788521248.912255:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee437c0700 x1875400222398208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521248.912264:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee437c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222398208:0@lo:400:kworker.0 00000100:00100000:1.0:1788521248.912274:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788521248.912278:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee437c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222398720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788521248.912307:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521248.912342:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222398720 00000100:00100000:3.0:1788521248.912347:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222398720 00000100:00100000:3.0:1788521248.912382:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788521248.912389:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222398720:12345-0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1788521248.912413:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521248.912417:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788521248.912419:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:3.0:1788521248.912420:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788521248.912519:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222397440:0@lo:400:kworker.0 00010000:00080000:2.0:1788521248.912535:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee437c0380 x1875400222397952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521248.912543:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee437c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875400222397952:0@lo:400:kworker.0 00010000:00080000:2.0:1788521248.912555:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee437c3b80 x1875400222398464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521248.912562:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee437c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875400222398464:0@lo:400:kworker.0 00010000:00080000:2.0:1788521248.912571:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee437c2300 x1875400222398080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521248.912592:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee437c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222398080:0@lo:400:kworker.0 00010000:00080000:2.0:1788521248.912604:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee437c1f80 x1875400222398592/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521248.912612:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee437c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222398592:0@lo:400:kworker.0 00000100:00100000:3.0:1788521248.912617:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222398720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 230us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521248.912624:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788521248.912702:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee437c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222398720:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788521248.973532:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521249.405553:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521249.405641:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521249.405675:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521249.408134:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201349632 00000100:00100000:1.0:1788521249.408146:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201349632 00000100:00100000:1.0:1788521249.408199:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 294 00000100:00100000:1.0:1788521249.408210:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+10:2396:x1875400201349632:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521249.408282:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+10:2396:x1875400201349632:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 74us (2641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521249.408290:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 294 00000100:00100000:2.0:1788521249.417156:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201349760 00000100:00100000:2.0:1788521249.417171:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201349760 00000100:00100000:2.0:1788521249.418924:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201349888 00000100:00100000:2.0:1788521249.418935:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201349888 00000100:00100000:1.0:1788521249.419013:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 132 00000100:00100000:1.0:1788521249.419025:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+6:2396:x1875400201349760:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521249.419114:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+6:2396:x1875400201349760:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 91us (13571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521249.419122:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 132 00000100:00080000:3.0:1788521249.421571:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788521249.422012:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 133 00000100:00100000:2.0:1788521249.422036:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+5:2396:x1875400201349888:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521249.422119:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+5:2396:x1875400201349888:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 97us (16443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521249.422126:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 133 00000100:00080000:0.0:1788521249.422849:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521249.423928:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222398848:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788521249.423998:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521249.424081:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222398848 00000100:00100000:0.0:1788521249.424090:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222398848 00000100:00100000:0.0:1788521249.424131:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788521249.424139:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222398848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788521249.424187:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788521249.424305:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222398848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521249.424313:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788521249.424366:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222398848:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788521249.428136:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4321c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222398976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788521249.428207:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521249.429429:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222398976 00000100:00100000:1.0:1788521249.429440:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222398976 00000100:00100000:1.0:1788521249.429504:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788521249.429514:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222398976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788521249.429538:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521249.435198:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222398976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5678us (6982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521249.435212:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1788521249.442154:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4321c380 x1875400222398976/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521249.442203:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4321c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222398976:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788521249.997512:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521251.021241:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521251.469339:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222399104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521251.469410:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521251.469492:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222399104 00000100:00100000:2.0:1788521251.469501:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222399104 00000100:00080000:0.0:1788521251.469530:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521251.469557:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788521251.469562:0:8438:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788521251.469566:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222399104:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521251.469570:0:8438:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:2.0:1788521251.469592:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521251.470045:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788521251.470057:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4321c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222399232:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788521251.470088:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521251.470129:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222399232 00000100:00100000:1.0:1788521251.470134:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222399232 00000100:00100000:1.0:1788521251.470165:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788521251.470172:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222399232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788521251.470182:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521251.470213:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222399232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521251.470219:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1788521251.470237:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788521251.470263:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4321c380 x1875400222399232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521267 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521251.470281:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4321c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222399232:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788521251.481778:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222399104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 12203us (12357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521251.481793:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1788521251.483186:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43599880 x1875400222399104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521267 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521251.483213:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222399104:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788521252.045671:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788521252.973624:0:11996:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 07:27:30 (1788521250) === 00010000:00010000:1.0:1788521253.073674:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521253.589846:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521253.590019:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201350016 00000100:00100000:1.0:1788521253.590030:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201350016 00000100:00100000:1.0:1788521253.590092:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 295 00000100:00100000:1.0:1788521253.590102:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+10:8742:x1875400201350016:12345-192.168.203.41@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788521253.590118:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521253.590136:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fee434abc00/0x411dd0ee4d2d1391 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed4f1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521253.590166:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fee434abc00/0x411dd0ee4d2d1391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed4f1 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521253.590177:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fee434abc00/0x411dd0ee4d2d1391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed4f1 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521253.590203:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434abc00, rc 0) 00000100:00100000:1.0:1788521253.590265:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+11:8742:x1875400201350016:12345-192.168.203.41@tcp:101:mount.lustre.0 Request processed in 164us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521253.590272:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 295 00000100:00100000:2.0:1788521253.606151:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521253.606439:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201350144 00000100:00100000:1.0:1788521253.606450:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201350144 00000100:00100000:1.0:1788521253.606513:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 296 00000100:00100000:1.0:1788521253.606523:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+11:8742:x1875400201350144:12345-192.168.203.41@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788521253.606689:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+11:8742:x1875400201350144:12345-192.168.203.41@tcp:501:mount.lustre.0 Request processed in 167us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521253.606698:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 296 00000100:00100000:3.0:1788521253.609086:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521253.609282:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201350272 00000100:00100000:2.0:1788521253.609292:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201350272 00000100:00100000:2.0:1788521253.609387:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 297 00000100:00100000:2.0:1788521253.609412:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+11:8742:x1875400201350272:12345-192.168.203.41@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788521253.609573:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+11:8742:x1875400201350272:12345-192.168.203.41@tcp:503:mount.lustre.0 Request processed in 162us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521253.609581:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 297 00000100:00100000:0.0:1788521253.622992:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521253.623083:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201350400 00000100:00100000:3.0:1788521253.623093:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201350400 00000100:00100000:3.0:1788521253.623149:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 298 00000100:00100000:3.0:1788521253.623159:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+11:8746:x1875400201350400:12345-192.168.203.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788521253.623325:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+11:8746:x1875400201350400:12345-192.168.203.41@tcp:502:llog_process_th.0 Request processed in 166us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521253.623334:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 298 00000100:00100000:3.0:1788521253.658189:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521253.658638:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201350528 00000100:00100000:2.0:1788521253.658649:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201350528 00000100:00100000:2.0:1788521253.658714:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 299 00000100:00100000:2.0:1788521253.658725:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+11:8746:x1875400201350528:12345-192.168.203.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788521253.658878:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+11:8746:x1875400201350528:12345-192.168.203.41@tcp:502:llog_process_th.0 Request processed in 155us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521253.658932:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 299 00000100:00100000:0.0:1788521253.668986:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521253.669080:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201350656 00000100:00100000:1.0:1788521253.669091:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201350656 00000100:00100000:1.0:1788521253.669154:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 300 00000100:00100000:1.0:1788521253.669164:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+11:8746:x1875400201350656:12345-192.168.203.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788521253.669313:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+11:8746:x1875400201350656:12345-192.168.203.41@tcp:502:llog_process_th.0 Request processed in 150us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521253.669321:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 300 00000100:00100000:0.0:1788521253.680911:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521253.681001:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201350784 00000100:00100000:3.0:1788521253.681024:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201350784 00000100:00100000:3.0:1788521253.681080:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 301 00000100:00100000:3.0:1788521253.681090:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+11:8742:x1875400201350784:12345-192.168.203.41@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788521253.681108:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521253.681126:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef749cac00/0x411dd0ee4d2d1398 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed522 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521253.681155:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef749cac00/0x411dd0ee4d2d1398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed522 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521253.681165:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef749cac00/0x411dd0ee4d2d1398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed522 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521253.681174:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749cac00, rc 0) 00000100:00100000:3.0:1788521253.681229:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+12:8742:x1875400201350784:12345-192.168.203.41@tcp:101:mount.lustre.0 Request processed in 141us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521253.681237:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 301 00000100:00100000:2.0:1788521253.698166:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521253.698343:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201350912 00000100:00100000:1.0:1788521253.698353:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201350912 00000100:00100000:1.0:1788521253.698408:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 302 00000100:00100000:1.0:1788521253.698417:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+12:8742:x1875400201350912:12345-192.168.203.41@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788521253.698439:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788521253.698461:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788521253.698469:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788521253.698472:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788521253.698476:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788521253.698478:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1788521253.700953:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+12:8742:x1875400201350912:12345-192.168.203.41@tcp:256:mount.lustre.0 Request processed in 2527us (2785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521253.700975:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 302 00000100:00100000:0.0:1788521253.706344:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521253.706480:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201351040 00000100:00100000:1.0:1788521253.706489:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201351040 00000100:00100000:1.0:1788521253.706540:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 303 00000100:00100000:1.0:1788521253.706551:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+12:8742:x1875400201351040:12345-192.168.203.41@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788521253.706568:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521253.706585:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fee434aae00/0x411dd0ee4d2d139f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed529 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521253.706615:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fee434aae00/0x411dd0ee4d2d139f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed529 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521253.706626:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fee434aae00/0x411dd0ee4d2d139f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed529 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521253.706635:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434aae00, rc 0) 00000100:00100000:1.0:1788521253.706690:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+13:8742:x1875400201351040:12345-192.168.203.41@tcp:101:mount.lustre.0 Request processed in 142us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521253.706697:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 303 00000100:00100000:2.0:1788521253.711577:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521253.711765:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201351168 00000100:00100000:1.0:1788521253.711774:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201351168 00000100:00100000:1.0:1788521253.711865:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 304 00000100:00100000:1.0:1788521253.711876:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+13:8742:x1875400201351168:12345-192.168.203.41@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788521253.712081:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+13:8742:x1875400201351168:12345-192.168.203.41@tcp:501:mount.lustre.0 Request processed in 207us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521253.712089:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 304 00000100:00100000:0.0:1788521253.716771:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521253.716851:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201351296 00000100:00100000:3.0:1788521253.716860:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201351296 00000100:00100000:3.0:1788521253.716934:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 305 00000100:00100000:3.0:1788521253.716945:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+13:8742:x1875400201351296:12345-192.168.203.41@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788521253.717121:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+13:8742:x1875400201351296:12345-192.168.203.41@tcp:503:mount.lustre.0 Request processed in 178us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521253.717129:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 305 00000100:00100000:0.0:1788521253.723674:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521253.726091:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201351424 00000100:00100000:3.0:1788521253.726108:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201351424 00000100:00100000:3.0:1788521253.726184:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 306 00000100:00100000:3.0:1788521253.726195:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+13:8752:x1875400201351424:12345-192.168.203.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788521253.727386:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+13:8752:x1875400201351424:12345-192.168.203.41@tcp:502:llog_process_th.0 Request processed in 1185us (3713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521253.727398:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 306 00000100:00100000:0.0:1788521253.736729:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521253.736832:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201351552 00000100:00100000:1.0:1788521253.736843:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201351552 00000100:00100000:1.0:1788521253.736998:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 307 00000100:00100000:1.0:1788521253.737010:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+13:8752:x1875400201351552:12345-192.168.203.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788521253.737181:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+13:8752:x1875400201351552:12345-192.168.203.41@tcp:502:llog_process_th.0 Request processed in 172us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521253.737189:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 307 00000100:00100000:0.0:1788521253.754376:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521253.754470:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521253.765262:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521253.768629:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201352448 00000100:00100000:1.0:1788521253.768644:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201352448 00000100:00100000:1.0:1788521253.768733:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201352320 00000100:00100000:1.0:1788521253.768745:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201352320 00000100:00100000:1.0:1788521253.768778:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 134 00000100:00100000:1.0:1788521253.768823:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201352448:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521253.768930:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201352448:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 109us (14564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521253.768938:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 134 00000100:00100000:1.0:1788521253.768968:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 135 00000100:00100000:1.0:1788521253.768976:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+6:2395:x1875400201352320:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521253.769002:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+6:2395:x1875400201352320:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 28us (14532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521253.769008:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 135 00000100:00100000:0.0:1788521253.769489:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521253.769507:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201351680 00000100:00100000:0.0:1788521253.769512:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201351680 00000100:00080000:3.0:1788521253.769699:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788521253.769704:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788521253.769725:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201351936 00000100:00100000:3.0:1788521253.769730:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201351936 00000100:00100000:3.0:1788521253.769748:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 16 00000100:00100000:3.0:1788521253.769753:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4358ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1875400201351936:12345-192.168.203.41@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788521253.769777:0:6519:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 3ebc0a53-9d31-4673-9ea1-597a62a00e6b@192.168.203.41@tcp t0 exp 0000000000000000 cur 303 last 0 00000020:00000080:3.0:1788521253.769816:0:6519:0:(genops.c:1385:class_connect()) connect: client 3ebc0a53-9d31-4673-9ea1-597a62a00e6b, cookie 0x411dd0ee4d2d13a6 00000004:00100000:3.0:1788521253.769839:0:6519:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788521253.769989:0:6519:0:(import.c:65:import_set_state_nolock()) ffff8fef7f064800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788521253.770039:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4358ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:2392:x1875400201351936:12345-192.168.203.41@tcp:38:mount.lustre.0 Request processed in 283us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521253.770046:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 16 00000100:00100000:0.0:1788521253.770871:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 17 00000100:00100000:0.0:1788521253.770879:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1875400201351680:12345-192.168.203.41@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788521253.770925:0:9815:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 3ebc0a53-9d31-4673-9ea1-597a62a00e6b@192.168.203.41@tcp t0 exp 0000000000000000 cur 303 last 0 00000020:00000080:0.0:1788521253.770954:0:9815:0:(genops.c:1385:class_connect()) connect: client 3ebc0a53-9d31-4673-9ea1-597a62a00e6b, cookie 0x411dd0ee4d2d13ad 00000004:00100000:0.0:1788521253.770981:0:9815:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788521253.772966:0:9815:0:(import.c:65:import_set_state_nolock()) ffff8fee41abe800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788521253.773053:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:2392:x1875400201351680:12345-192.168.203.41@tcp:38:mount.lustre.0 Request processed in 2169us (7796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521253.773243:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521253.773600:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 17 00000100:00100000:0.0:1788521253.773633:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201352064 00000100:00100000:0.0:1788521253.773640:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201352064 00000100:00100000:0.0:1788521253.773703:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 18 00000100:00100000:0.0:1788521253.773713:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:0:x1875400201352064:12345-192.168.203.41@tcp:41:mount.lustre.0 00000100:00080000:1.0:1788521253.773981:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:0.0:1788521253.774145:0:9815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788521253.774255:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:0:x1875400201352064:12345-192.168.203.41@tcp:41:mount.lustre.0 Request processed in 542us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521253.774262:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 18 00000100:00100000:1.0:1788521253.788202:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521253.788287:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521253.792617:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201351808 00000100:00100000:2.0:1788521253.792631:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201351808 00000100:00100000:2.0:1788521253.792711:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201352192 00000100:00100000:2.0:1788521253.792715:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201352192 00000100:00100000:2.0:1788521253.792874:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 19 00000100:00100000:2.0:1788521253.792902:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+7:0:x1875400201351808:12345-192.168.203.41@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788521253.792943:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788521253.793042:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+7:0:x1875400201351808:12345-192.168.203.41@tcp:41:mount.lustre.0 Request processed in 158us (4848us total) trans 0 rc 0/0 00000100:00080000:1.0:1788521253.793087:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521253.793177:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 20 00000100:00100000:0.0:1788521253.793188:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+7:8742:x1875400201352192:12345-192.168.203.41@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788521253.793202:0:9815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788521253.793231:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+7:8742:x1875400201352192:12345-192.168.203.41@tcp:41:mount.lustre.0 Request processed in 46us (4944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521253.793238:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 20 00000100:00100000:2.0:1788521253.796702:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 19 00000100:00100000:1.0:1788521253.808003:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521253.808641:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201352576 00000100:00100000:0.0:1788521253.808651:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201352576 00000100:00100000:0.0:1788521253.808718:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 21 00000100:00100000:0.0:1788521253.808845:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:8742:x1875400201352576:12345-192.168.203.41@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788521253.808965:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:8742:x1875400201352576:12345-192.168.203.41@tcp:40:mount.lustre.0 Request processed in 113us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521253.814674:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 21 00000100:00100000:2.0:1788521253.819155:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521253.819235:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521253.819286:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521253.820402:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201352704 00000100:00100000:1.0:1788521253.820414:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201352704 00000100:00100000:1.0:1788521253.820462:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201352832 00000100:00100000:1.0:1788521253.820465:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201352832 00000100:00100000:1.0:1788521253.820485:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 20 00000100:00100000:1.0:1788521253.820504:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee437c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2392:x1875400201352704:12345-192.168.203.41@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788521253.820657:0:8875:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3ebc0a53-9d31-4673-9ea1-597a62a00e6b@192.168.203.41@tcp t0 exp 0000000000000000 cur 303 last 0 00000020:00000080:1.0:1788521253.820690:0:8875:0:(genops.c:1385:class_connect()) connect: client 3ebc0a53-9d31-4673-9ea1-597a62a00e6b, cookie 0x411dd0ee4d2d13b4 00002000:00100000:1.0:1788521253.820702:0:8875:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3ebc0a53-9d31-4673-9ea1-597a62a00e6b/ffff8fef7efe3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788521253.820730:0:8875:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788521253.820805:0:8875:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788521253.820837:0:8875:0:(import.c:65:import_set_state_nolock()) ffff8fef7efe3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788521253.820924:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee437c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:2392:x1875400201352704:12345-192.168.203.41@tcp:8:mount.lustre.0 Request processed in 430us (1688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521253.820932:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 20 00000100:00100000:1.0:1788521253.820951:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 21 00000100:00100000:1.0:1788521253.820955:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee437c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2392:x1875400201352832:12345-192.168.203.41@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788521253.820983:0:8875:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3ebc0a53-9d31-4673-9ea1-597a62a00e6b@192.168.203.41@tcp t0 exp 0000000000000000 cur 303 last 0 00000020:00000080:1.0:1788521253.820998:0:8875:0:(genops.c:1385:class_connect()) connect: client 3ebc0a53-9d31-4673-9ea1-597a62a00e6b, cookie 0x411dd0ee4d2d13bb 00002000:00100000:1.0:1788521253.821003:0:8875:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3ebc0a53-9d31-4673-9ea1-597a62a00e6b/ffff8fef7efe1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788521253.821028:0:8875:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788521253.821061:0:8875:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788521253.821081:0:8875:0:(import.c:65:import_set_state_nolock()) ffff8fef7efe7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788521253.821105:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee437c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:2392:x1875400201352832:12345-192.168.203.41@tcp:8:mount.lustre.0 Request processed in 148us (1829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521253.821112:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 21 00000100:00100000:3.0:1788521253.823713:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201352960 00000100:00100000:3.0:1788521253.823806:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201352960 00000100:00100000:2.0:1788521253.828831:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 5 00000100:00100000:2.0:1788521253.828845:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee437c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:8742:x1875400201352960:12345-192.168.203.41@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788521253.828971:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee437c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:8742:x1875400201352960:12345-192.168.203.41@tcp:900:mount.lustre.0 Request processed in 128us (9825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521253.828979:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 5 00000100:00100000:2.0:1788521253.842628:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521253.848425:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201353088 00000100:00100000:1.0:1788521253.848440:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201353088 00000100:00100000:1.0:1788521253.848590:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 1 00000100:00100000:1.0:1788521253.848603:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee437c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:8742:x1875400201353088:12345-192.168.203.41@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788521253.848701:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788521253.848826:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee437c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:8742:x1875400201353088:12345-192.168.203.41@tcp:33:mount.lustre.0 Request processed in 226us (6206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521253.848834:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 1 00000100:00100000:1.0:1788521254.029190:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4358d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222399360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521254.029261:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521254.029392:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222399360 00000100:00100000:0.0:1788521254.029400:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222399360 00000100:00100000:0.0:1788521254.029454:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788521254.029464:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222399360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788521254.029502:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521254.029545:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222399360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521254.029552:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1788521254.029620:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788521254.029650:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4358d880 x1875400222399360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521254.029668:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4358d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222399360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521254.031528:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788521254.031548:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee437c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222399488:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788521254.031604:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521254.031693:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222399488 00000100:00100000:2.0:1788521254.031701:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222399488 00000100:00100000:2.0:1788521254.031760:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788521254.031769:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4358d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222399488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788521254.031803:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788521254.031861:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4358d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222399488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521254.031868:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788521254.031936:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee437c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222399488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788521254.032259:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222399744:0@lo:400:kworker.0 00000100:00100000:3.0:1788521254.032309:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521254.032328:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222400256:0@lo:400:kworker.0 00000100:00100000:3.0:1788521254.032349:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521254.032365:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875400222400768:0@lo:400:kworker.0 00000100:00100000:3.0:1788521254.032385:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521254.032401:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788521254.032414:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875400222399872:0@lo:400:kworker.0 00000100:00100000:3.0:1788521254.032437:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521254.032452:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222400384:0@lo:400:kworker.0 00000100:00100000:3.0:1788521254.032474:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521254.032496:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222400896:0@lo:400:kworker.0 00000100:00100000:3.0:1788521254.032514:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521254.032557:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222399744 00000100:00100000:3.0:1788521254.032562:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222399744 00000100:00100000:3.0:1788521254.032590:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222400256 00000100:00100000:3.0:1788521254.032593:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222400256 00000100:00100000:3.0:1788521254.032613:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222400768 00000100:00100000:3.0:1788521254.032616:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222400768 00000100:00100000:3.0:1788521254.032627:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222399872 00000100:00100000:3.0:1788521254.032630:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222399872 00000100:00100000:3.0:1788521254.032642:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788521254.032649:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222399744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521254.032685:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222399744:12345-0@lo:400:kworker.0 Request processed in 37us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521254.032691:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788521254.032706:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788521254.032714:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222400256:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788521254.032817:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788521254.032830:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222399616:0@lo:400:kworker.0 00000100:00100000:1.0:1788521254.032862:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521254.032931:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875400222400128:0@lo:400:kworker.0 00000100:00100000:1.0:1788521254.032954:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521254.032975:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875400222400640:0@lo:400:kworker.0 00000100:00100000:1.0:1788521254.032994:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521254.033006:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788521254.033012:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222400000:0@lo:400:kworker.0 00000100:00100000:1.0:1788521254.033032:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521254.033051:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f071880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222400512:0@lo:400:kworker.0 00000100:00100000:1.0:1788521254.033071:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521254.033096:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222400000 00000100:00100000:1.0:1788521254.033100:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222400000 00000100:00100000:1.0:1788521254.033126:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788521254.033133:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222400000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521254.033170:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222400000:12345-0@lo:400:kworker.0 Request processed in 38us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521254.033175:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788521254.033194:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222400384 00000100:00100000:1.0:1788521254.033197:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222400384 00000100:00100000:1.0:1788521254.033222:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222400896 00000100:00100000:1.0:1788521254.033225:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222400896 00000100:00100000:1.0:1788521254.033238:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222400512 00000100:00100000:1.0:1788521254.033241:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222400512 00000100:00100000:1.0:1788521254.033253:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788521254.033258:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222400384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521254.033289:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222400384:12345-0@lo:400:kworker.0 Request processed in 31us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521254.033295:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788521254.033313:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788521254.033319:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222400896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521254.033350:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222400896:12345-0@lo:400:kworker.0 Request processed in 32us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521254.033356:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788521254.033367:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788521254.033373:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222400512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521254.033397:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222400512:12345-0@lo:400:kworker.0 Request processed in 25us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521254.033403:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1788521254.033418:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788521254.033421:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521254.033440:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222400000:0@lo:400:kworker.0 00010000:00080000:1.0:1788521254.033452:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f071880 x1875400222400512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521254.033462:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f071880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222400512:0@lo:400:kworker.0 00010000:00080000:1.0:1788521254.033622:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f073b80 x1875400222400384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521254.033631:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222400384:0@lo:400:kworker.0 00010000:00080000:1.0:1788521254.033641:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee41aabb80 x1875400222400896/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521254.033650:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222400896:0@lo:400:kworker.0 00000100:00100000:1.0:1788521254.033660:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222399744:0@lo:400:kworker.0 00000100:00100000:1.0:1788521254.033691:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222399616 00000100:00100000:1.0:1788521254.033700:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222399616 00000100:00100000:1.0:1788521254.033868:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788521254.033876:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3646:x1875400222399616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521254.033942:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3646:x1875400222399616:12345-0@lo:400:kworker.0 Request processed in 67us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521254.033949:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788521254.033990:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222399616:0@lo:400:kworker.0 00000100:00100000:2.0:1788521254.034636:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222400128 00000100:00100000:2.0:1788521254.034643:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222400128 00000100:00100000:2.0:1788521254.034681:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222400640 00000100:00100000:2.0:1788521254.034684:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222400640 00000100:00100000:2.0:1788521254.034696:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788521254.034702:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875400222400768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521254.034759:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875400222400768:12345-0@lo:400:kworker.0 Request processed in 56us (2372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521254.034765:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788521254.034779:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788521254.034785:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875400222399872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521254.034814:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875400222399872:12345-0@lo:400:kworker.0 Request processed in 30us (2376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521254.034831:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788521254.034845:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788521254.034850:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875400222400128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521254.034906:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875400222400128:12345-0@lo:400:kworker.0 Request processed in 32us (1928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521254.034912:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788521254.034924:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788521254.034930:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875400222400640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521254.034966:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875400222400640:12345-0@lo:400:kworker.0 Request processed in 28us (1962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521254.034971:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788521254.034999:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875400222399872:0@lo:400:kworker.0 00010000:00080000:2.0:1788521254.035014:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f071c00 x1875400222400768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521254.035024:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875400222400768:0@lo:400:kworker.0 00000100:00100000:2.0:1788521254.035051:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875400222400128:0@lo:400:kworker.0 00000100:00100000:2.0:1788521254.035061:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f070e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875400222400640:0@lo:400:kworker.0 00000100:00100000:3.0:1788521254.038164:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222400256:12345-0@lo:400:kworker.0 Request processed in 5442us (5804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521254.038176:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:1.0:1788521254.039042:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788521254.039707:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef766f7100 x1875400222400256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521254.039730:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222400256:0@lo:400:kworker.0 00010000:00010000:3.0:1788521254.093456:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521254.541425:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222401024:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788521254.541502:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521254.541639:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222401024 00000100:00100000:3.0:1788521254.541647:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222401024 00000100:00100000:3.0:1788521254.541701:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788521254.541728:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee437c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222401024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788521254.541763:0:10099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788521254.541806:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee437c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222401024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521254.541812:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788521254.541966:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222401024:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788521254.542450:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788521254.542461:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222401152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788521254.542494:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521254.542612:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222401152 00000100:00100000:3.0:1788521254.542617:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222401152 00000100:00100000:3.0:1788521254.542657:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788521254.542667:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee437c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222401152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788521254.542682:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788521254.542932:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee437c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222401152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 266us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521254.542939:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1788521254.543108:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7a4fd880 x1875400222401152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521254.543124:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222401152:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788521255.118027:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521256.141325:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521256.589262:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4358ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222401280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521256.589360:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521256.589533:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222401280 00000100:00100000:0.0:1788521256.589544:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222401280 00000100:00100000:0.0:1788521256.589684:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788521256.589696:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee437c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222401280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788521256.589746:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521256.589804:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee437c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222401280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521256.589812:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1788521256.590138:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521256.590202:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222401408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788521256.590238:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521256.590426:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222401408 00000100:00100000:2.0:1788521256.590432:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222401408 00000100:00100000:2.0:1788521256.590462:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788521256.590470:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222401408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788521256.590483:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521256.590523:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222401408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521256.590529:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1788521256.590571:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7a4ffb80 x1875400222401408/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521256.590590:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222401408:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788521256.590698:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4358ce00 x1875400222401280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521256.590722:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4358ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222401280:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788521256.590852:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788521257.166074:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521258.189044:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521259.117453:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521259.117504:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521259.117534:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521259.117562:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521259.117640:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201353216 00000100:00100000:1.0:1788521259.117650:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201353216 00000100:00100000:1.0:1788521259.117699:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 309 00000100:00100000:1.0:1788521259.117709:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2394:x1875400201353216:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521259.117789:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2394:x1875400201353216:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 81us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521259.117797:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 309 00000100:00100000:1.0:1788521259.118057:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201353344 00000100:00100000:1.0:1788521259.118062:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201353344 00000100:00100000:1.0:1788521259.118100:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201353472 00000100:00100000:1.0:1788521259.118104:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201353472 00000100:00100000:1.0:1788521259.118116:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201353728 00000100:00100000:1.0:1788521259.118118:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201353728 00000100:00100000:1.0:1788521259.118148:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 142 00000100:00100000:1.0:1788521259.118154:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+6:2393:x1875400201353344:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521259.118187:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+6:2393:x1875400201353344:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 34us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521259.118193:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 142 00000100:00100000:1.0:1788521259.118205:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 143 00000100:00100000:1.0:1788521259.118212:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+5:2394:x1875400201353472:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521259.118234:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+5:2394:x1875400201353472:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 24us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521259.118240:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 143 00000100:00100000:1.0:1788521259.118251:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 144 00000100:00100000:1.0:1788521259.118258:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:2394:x1875400201353728:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521259.118279:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:2394:x1875400201353728:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 22us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521259.118286:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 144 00000100:00080000:1.0:1788521259.118300:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788521259.118304:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521259.118433:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521259.118478:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521259.118505:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521259.118557:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201353600 00000100:00100000:3.0:1788521259.118561:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201353600 00000100:00100000:1.0:1788521259.118709:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201353984 00000100:00100000:1.0:1788521259.118713:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201353984 00000100:00100000:1.0:1788521259.118754:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201353856 00000100:00100000:1.0:1788521259.118758:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201353856 00000100:00100000:1.0:1788521259.118778:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 58 00000100:00100000:1.0:1788521259.118785:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:2394:x1875400201353984:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521259.118817:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:2394:x1875400201353984:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 32us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521259.118834:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 58 00000100:00100000:1.0:1788521259.118847:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 59 00000100:00100000:1.0:1788521259.118853:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:2393:x1875400201353856:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521259.118878:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:2393:x1875400201353856:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 26us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521259.118905:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 59 00000100:00080000:2.0:1788521259.119014:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788521259.119017:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788521259.119233:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 145 00000100:00100000:3.0:1788521259.119241:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:2393:x1875400201353600:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521259.119275:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:2393:x1875400201353600:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 36us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521259.119291:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 145 00000100:00080000:2.0:1788521259.119473:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521259.149052:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788521259.149075:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222401536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521259.149142:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521259.149419:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222402048:0@lo:400:kworker.0 00000100:00100000:3.0:1788521259.149450:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521259.149487:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222402560:0@lo:400:kworker.0 00000100:00100000:3.0:1788521259.149511:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521259.149540:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222403072:0@lo:400:kworker.0 00000100:00100000:3.0:1788521259.149559:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521259.149755:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788521259.149762:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222401664:0@lo:400:kworker.0 00000100:00100000:3.0:1788521259.149791:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521259.149810:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222402176:0@lo:400:kworker.0 00000100:00100000:3.0:1788521259.149833:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521259.149853:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222402688:0@lo:400:kworker.0 00000100:00100000:3.0:1788521259.149874:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521259.149938:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222402176 00000100:00100000:3.0:1788521259.149945:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222402176 00000100:00100000:3.0:1788521259.149993:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788521259.150002:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222402176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521259.150053:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222402176:12345-0@lo:400:kworker.0 Request processed in 53us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521259.150060:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788521259.150086:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222402560 00000100:00100000:3.0:1788521259.150089:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222402560 00000100:00100000:3.0:1788521259.150119:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222403072 00000100:00100000:3.0:1788521259.150121:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222403072 00000100:00100000:3.0:1788521259.150151:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222402688 00000100:00100000:3.0:1788521259.150154:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222402688 00000100:00100000:3.0:1788521259.150168:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788521259.150174:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222402560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521259.150204:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222402560:12345-0@lo:400:kworker.0 Request processed in 30us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521259.150210:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788521259.150220:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788521259.150226:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222403072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521259.150246:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222403072:12345-0@lo:400:kworker.0 Request processed in 22us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521259.150252:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788521259.150261:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788521259.150267:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222402688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521259.150285:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222402688:12345-0@lo:400:kworker.0 Request processed in 19us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521259.150290:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788521259.150333:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222402176:0@lo:400:kworker.0 00010000:00080000:3.0:1788521259.150346:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef766f7800 x1875400222402688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521259.150356:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222402688:0@lo:400:kworker.0 00010000:00080000:3.0:1788521259.150364:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef766f5c00 x1875400222402560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521259.150372:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222402560:0@lo:400:kworker.0 00010000:00080000:3.0:1788521259.150380:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f077100 x1875400222403072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521259.150394:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222403072:0@lo:400:kworker.0 00000100:00100000:1.0:1788521259.150700:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222402048 00000100:00100000:1.0:1788521259.150706:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222402048 00000100:00100000:1.0:1788521259.150742:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788521259.150757:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222402048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521259.150795:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222402048:12345-0@lo:400:kworker.0 Request processed in 40us (1344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521259.150801:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788521259.150976:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222401536 00000100:00100000:2.0:1788521259.150980:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222401536 00000100:00100000:2.0:1788521259.151012:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788521259.151019:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222401536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788521259.151042:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521259.151073:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222401536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (1931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521259.151079:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788521259.151098:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222401792:0@lo:400:kworker.0 00000100:00100000:2.0:1788521259.151126:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521259.151146:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875400222402304:0@lo:400:kworker.0 00000100:00100000:2.0:1788521259.151164:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521259.151178:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f076a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222402816:0@lo:400:kworker.0 00000100:00100000:2.0:1788521259.151194:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521259.151224:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788521259.151230:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f071880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222401920:0@lo:400:kworker.0 00000100:00100000:2.0:1788521259.151251:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521259.151267:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222402432:0@lo:400:kworker.0 00000100:00100000:2.0:1788521259.151283:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521259.151292:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875400222402944:0@lo:400:kworker.0 00000100:00100000:2.0:1788521259.151309:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521259.151333:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222401664 00000100:00100000:2.0:1788521259.151336:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222401664 00000100:00100000:2.0:1788521259.151371:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788521259.151378:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3645:x1875400222401664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521259.151408:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3645:x1875400222401664:12345-0@lo:400:kworker.0 Request processed in 32us (1617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521259.151414:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788521259.151441:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222401920 00000100:00100000:2.0:1788521259.151444:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222401920 00000100:00100000:2.0:1788521259.151464:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788521259.151470:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee437c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222401920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521259.151513:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee437c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222401920:12345-0@lo:400:kworker.0 Request processed in 43us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521259.151675:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788521259.151694:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222401792 00000100:00100000:2.0:1788521259.151698:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222401792 00000100:00100000:2.0:1788521259.151713:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222402304 00000100:00100000:2.0:1788521259.151715:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222402304 00000100:00100000:2.0:1788521259.151727:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222402816 00000100:00100000:2.0:1788521259.151730:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222402816 00000100:00100000:2.0:1788521259.151740:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222402432 00000100:00100000:2.0:1788521259.151743:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222402432 00000100:00100000:2.0:1788521259.151912:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222402944 00000100:00100000:2.0:1788521259.151916:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222402944 00000100:00100000:2.0:1788521259.151944:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788521259.151951:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee437c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222401792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521259.151984:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee437c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222401792:12345-0@lo:400:kworker.0 Request processed in 34us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521259.151991:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788521259.152001:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788521259.152007:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee437c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875400222402304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521259.152042:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee437c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875400222402304:12345-0@lo:400:kworker.0 Request processed in 35us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521259.152048:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788521259.152059:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788521259.152064:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee437c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222402816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521259.152089:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee437c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222402816:12345-0@lo:400:kworker.0 Request processed in 26us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521259.152095:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788521259.152106:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788521259.152111:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee437c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222402432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521259.152136:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee437c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222402432:12345-0@lo:400:kworker.0 Request processed in 25us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521259.152141:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788521259.152151:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788521259.152157:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875400222402944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521259.152180:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875400222402944:12345-0@lo:400:kworker.0 Request processed in 24us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521259.152185:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:2.0:1788521259.152201:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788521259.152205:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788521259.152207:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521259.152209:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521259.152239:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f071880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222401920:0@lo:400:kworker.0 00010000:00080000:2.0:1788521259.152252:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef766f5f80 x1875400222402432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521259.152273:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222402432:0@lo:400:kworker.0 00010000:00080000:2.0:1788521259.152285:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f074a80 x1875400222402944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521259.152294:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875400222402944:0@lo:400:kworker.0 00000100:00100000:2.0:1788521259.152303:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222401792:0@lo:400:kworker.0 00000100:00100000:2.0:1788521259.152312:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875400222402304:0@lo:400:kworker.0 00000100:00100000:2.0:1788521259.152321:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f076a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222402816:0@lo:400:kworker.0 00000100:00100000:3.0:1788521259.152440:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222401664:0@lo:400:kworker.0 00000100:00100000:3.0:1788521259.152453:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222402048:0@lo:400:kworker.0 00000100:00100000:3.0:1788521259.152466:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788521259.152474:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee437c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222403200:0@lo:41:osp-pre-0-1.0 00010000:00080000:1.0:1788521259.152605:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7a4ffb80 x1875400222401536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521259.152622:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222401536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521259.152969:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521259.153512:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222403200 00000100:00100000:2.0:1788521259.153528:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222403200 00000100:00100000:2.0:1788521259.153575:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788521259.153584:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222403200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788521259.153615:0:10099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788521259.153659:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222403200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521259.153666:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788521259.154508:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee437c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222403200:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788521259.213988:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521259.663759:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222403328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788521259.663853:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521259.663938:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222403328 00000100:00100000:1.0:1788521259.663953:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222403328 00000100:00100000:2.0:1788521259.663971:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521259.663979:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222403456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788521259.664021:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521259.664073:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222403456 00000100:00100000:2.0:1788521259.664081:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222403456 00000100:00100000:1.0:1788521259.664106:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788521259.664122:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222403328:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788521259.664149:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788521259.664171:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222403456:12345-0@lo:41:osp-pre-1-0.0 00002000:00000024:1.0:1788521259.664172:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000004:00000024:2.0:1788521259.664318:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788521259.668431:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222403328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4304us (4567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521259.668455:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788521259.668459:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222403456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4278us (4424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521259.668479:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788521259.669996:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222403456:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1788521259.670039:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f076d80 x1875400222403328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521259.670056:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222403328:0@lo:13:osp-pre-1-1.0 00000001:00100000:0.0:1788521259.673229:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3ebc0a53-9d31-4673-9ea1-597a62a00e6b 00000001:00100000:2.0:1788521259.673669:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3ebc0a53-9d31-4673-9ea1-597a62a00e6b 00000001:00100000:2.0:1788521259.673988:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3ebc0a53-9d31-4673-9ea1-597a62a00e6b 00000001:00100000:0.0:1788521259.675362:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3ebc0a53-9d31-4673-9ea1-597a62a00e6b 00000001:02000400:2.0:1788521259.861455:0:12189:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg341-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1788521260.237619:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521261.261676:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521261.711768:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788521261.711798:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222403584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788521261.713277:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788521261.713307:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4358f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222403712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521261.713398:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521261.713513:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521261.713735:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222403712 00000100:00100000:1.0:1788521261.713745:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222403712 00000100:00100000:0.0:1788521261.713828:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222403584 00000100:00100000:1.0:1788521261.713834:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788521261.713836:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222403584 00000100:00100000:1.0:1788521261.713852:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222403712:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521261.713870:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788521261.713880:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222403584:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788521261.713933:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788521261.713948:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1788521261.713949:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521261.714018:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222403712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 172us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521261.714027:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:0.0:1788521261.714069:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4358f800 x1875400222403712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521261.714092:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4358f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222403712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521261.714229:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222403584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 351us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521261.714286:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:1.0:1788521261.714716:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f076680 x1875400222403584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521261.714735:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222403584:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788521262.286016:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521263.312399:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521264.233286:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521264.233328:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521264.233360:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521264.233391:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521264.233423:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521264.233443:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521264.233461:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521264.233484:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201354368 00000100:00100000:2.0:1788521264.233493:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201354368 00000100:00100000:2.0:1788521264.233541:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201354624 00000100:00100000:2.0:1788521264.233544:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201354624 00000100:00100000:2.0:1788521264.233555:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201354240 00000100:00100000:2.0:1788521264.233557:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201354240 00000100:00100000:2.0:1788521264.233569:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201354496 00000100:00100000:2.0:1788521264.233570:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201354496 00000100:00100000:2.0:1788521264.233585:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 152 00000100:00100000:2.0:1788521264.233593:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+5:2393:x1875400201354368:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521264.233747:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 153 00000100:00100000:0.0:1788521264.233757:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2393:x1875400201354624:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521264.233801:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2393:x1875400201354624:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 46us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521264.233808:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 153 00000100:00100000:0.0:1788521264.233825:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 154 00000100:00100000:0.0:1788521264.233831:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+6:2393:x1875400201354240:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521264.233857:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+6:2393:x1875400201354240:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 27us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521264.233864:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 154 00000100:00100000:0.0:1788521264.233874:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 155 00000100:00100000:0.0:1788521264.233910:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2393:x1875400201354496:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521264.233935:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2393:x1875400201354496:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 55us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521264.233942:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 155 00000100:00100000:1.0:1788521264.234245:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201354112 00000100:00100000:1.0:1788521264.234251:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201354112 00000100:00100000:1.0:1788521264.234281:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 311 00000100:00100000:1.0:1788521264.234287:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2393:x1875400201354112:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521264.234317:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2393:x1875400201354112:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 30us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521264.234336:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 311 00000100:00080000:1.0:1788521264.234381:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788521264.234385:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788521264.235944:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+5:2393:x1875400201354368:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 2342us (2605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521264.235958:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 152 00000100:00100000:3.0:1788521264.236340:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201354880 00000100:00100000:3.0:1788521264.236349:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201354880 00000100:00100000:3.0:1788521264.236413:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201354752 00000100:00100000:3.0:1788521264.236416:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201354752 00000100:00100000:3.0:1788521264.236445:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 63 00000100:00100000:3.0:1788521264.236457:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2393:x1875400201354880:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521264.236512:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2393:x1875400201354880:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 60us (3120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521264.236520:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 63 00000100:00100000:3.0:1788521264.236534:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 64 00000100:00100000:3.0:1788521264.236541:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2393:x1875400201354752:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521264.236564:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2393:x1875400201354752:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 25us (3102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521264.236571:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 64 00000100:00080000:1.0:1788521264.236732:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788521264.236736:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788521264.269355:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788521264.269379:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4358f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875400222404096:0@lo:400:kworker.0 00000100:00100000:0.0:1788521264.269453:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521264.269530:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222404096 00000100:00100000:0.0:1788521264.269537:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222404096 00000100:00100000:0.0:1788521264.269586:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788521264.269595:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4358c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875400222404096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521264.269645:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4358c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875400222404096:12345-0@lo:400:kworker.0 Request processed in 51us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521264.269685:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788521264.269730:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4358f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875400222404096:0@lo:400:kworker.0 00000100:00100000:0.0:1788521264.269778:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4358f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222404224:0@lo:400:kworker.0 00000100:00100000:0.0:1788521264.269830:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521264.269864:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222404224 00000100:00100000:0.0:1788521264.269867:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222404224 00000100:00100000:0.0:1788521264.269925:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788521264.269932:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4358dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222404224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521264.269968:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4358dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222404224:12345-0@lo:400:kworker.0 Request processed in 36us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521264.269974:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788521264.270001:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4358f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222404224:0@lo:400:kworker.0 00000100:00100000:0.0:1788521264.270038:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788521264.270044:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4358d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875400222404608:0@lo:400:kworker.0 00000100:00100000:0.0:1788521264.270067:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521264.270106:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875400222404736:0@lo:400:kworker.0 00000100:00100000:0.0:1788521264.270127:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521264.270171:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788521264.270176:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875400222405120:0@lo:400:kworker.0 00000100:00100000:0.0:1788521264.270197:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521264.270222:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222404608 00000100:00100000:0.0:1788521264.270226:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222404608 00000100:00100000:0.0:1788521264.270261:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222404736 00000100:00100000:0.0:1788521264.270264:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222404736 00000100:00100000:0.0:1788521264.270280:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222405120 00000100:00100000:0.0:1788521264.270289:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222405120 00000100:00100000:3.0:1788521264.270295:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4358f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222403968:0@lo:400:kworker.0 00000100:00100000:0.0:1788521264.270309:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788521264.270318:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875400222404608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521264.270374:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788521264.270456:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788521264.270461:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521264.270486:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788521264.270495:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222405248:0@lo:400:kworker.0 00000100:00100000:2.0:1788521264.270531:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222403840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521264.270602:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875400222404608:12345-0@lo:400:kworker.0 Request processed in 285us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521264.270604:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4358ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222404480:0@lo:400:kworker.0 00000100:00100000:0.0:1788521264.270612:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788521264.270629:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788521264.270639:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875400222404736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521264.270640:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521264.270674:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222404992:0@lo:400:kworker.0 00000100:00100000:0.0:1788521264.270681:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875400222404736:12345-0@lo:400:kworker.0 Request processed in 45us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521264.270689:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788521264.270703:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788521264.270707:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521264.270714:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875400222405120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521264.270752:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875400222405120:12345-0@lo:400:kworker.0 Request processed in 40us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521264.270758:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788521264.270785:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222403968 00000100:00100000:3.0:1788521264.270789:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222403968 00000100:00100000:0.0:1788521264.270795:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875400222405120:0@lo:400:kworker.0 00010000:00080000:0.0:1788521264.270808:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee424e8a80 x1875400222404736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521264.270818:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875400222404736:0@lo:400:kworker.0 00000100:00100000:3.0:1788521264.270829:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788521264.270834:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4358d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875400222404608:0@lo:400:kworker.0 00000100:00100000:3.0:1788521264.270840:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3644:x1875400222403968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521264.270875:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3644:x1875400222403968:12345-0@lo:400:kworker.0 Request processed in 39us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521264.270976:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788521264.271009:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222404480 00000100:00100000:3.0:1788521264.271013:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222404480 00000100:00100000:3.0:1788521264.271035:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788521264.271042:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222404480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521264.271081:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222404480:12345-0@lo:400:kworker.0 Request processed in 40us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521264.271088:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788521264.271119:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222404992 00000100:00100000:3.0:1788521264.271124:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222404992 00000100:00100000:3.0:1788521264.271166:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788521264.271173:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222404992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521264.271203:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222404992:12345-0@lo:400:kworker.0 Request processed in 31us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521264.271209:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788521264.271255:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4358f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222403968:0@lo:400:kworker.0 00000100:00100000:3.0:1788521264.271268:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4358ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222404480:0@lo:400:kworker.0 00010000:00080000:3.0:1788521264.271277:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee424eb800 x1875400222404992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521264.271286:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222404992:0@lo:400:kworker.0 00000100:00100000:3.0:1788521264.271302:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788521264.271309:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222405376:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788521264.271333:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521264.275424:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222405376 00000100:00100000:0.0:1788521264.275440:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222405376 00000100:00100000:0.0:1788521264.275518:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788521264.275529:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222405376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788521264.275584:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788521264.275688:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222405376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 162us (4353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521264.275695:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1788521264.275720:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521264.275760:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222405376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788521264.276003:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222405504:0@lo:400:kworker.0 00000100:00100000:0.0:1788521264.276042:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521264.276077:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222405504 00000100:00100000:0.0:1788521264.276082:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222405504 00000100:00100000:0.0:1788521264.276119:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788521264.276126:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222405504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521264.276162:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222405504:12345-0@lo:400:kworker.0 Request processed in 37us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521264.276169:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1788521264.276185:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788521264.276215:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee424e8a80 x1875400222405504/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521264.276226:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222405504:0@lo:400:kworker.0 00000100:00100000:0.0:1788521264.276260:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788521264.276268:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222405632:0@lo:400:kworker.0 00000100:00100000:0.0:1788521264.276432:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521264.276533:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222405632 00000100:00100000:3.0:1788521264.276538:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222405632 00000100:00100000:3.0:1788521264.276587:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788521264.276595:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222405632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521264.276636:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222405632:12345-0@lo:400:kworker.0 Request processed in 43us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521264.276643:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1788521264.276761:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee424e8a80 x1875400222405632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521264.276772:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222405632:0@lo:400:kworker.0 00000100:00080000:0.0:1788521264.276949:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788521264.277045:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521264.277185:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521264.277356:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4358f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875400222404352:0@lo:400:kworker.0 00000100:00100000:2.0:1788521264.277383:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521264.277410:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222404864:0@lo:400:kworker.0 00000100:00100000:2.0:1788521264.277431:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521264.277501:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222405248 00000100:00100000:3.0:1788521264.277506:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222405248 00000100:00100000:3.0:1788521264.277550:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222404352 00000100:00100000:3.0:1788521264.277553:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222404352 00000100:00100000:3.0:1788521264.277570:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788521264.277577:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222405248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521264.277619:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222405248:12345-0@lo:400:kworker.0 Request processed in 43us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521264.277637:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788521264.277750:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222403840 00000100:00100000:0.0:1788521264.277754:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222403840 00000100:00100000:0.0:1788521264.277782:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788521264.277796:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222403840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788521264.277821:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521264.277859:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222403840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521264.277865:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788521264.278065:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222404864 00000100:00100000:0.0:1788521264.278070:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222404864 00000100:00100000:0.0:1788521264.278096:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788521264.278101:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222404864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521264.278133:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222404864:12345-0@lo:400:kworker.0 Request processed in 32us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521264.278139:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:0.0:1788521264.278170:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f076680 x1875400222403840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521264.278188:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222403840:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788521264.278200:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee424e9f80 x1875400222404864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788521264.278498:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788521264.278502:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788521264.278526:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788521264.278536:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875400222404352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521264.278569:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875400222404352:12345-0@lo:400:kworker.0 Request processed in 36us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521264.278584:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00010000:00080000:2.0:1788521264.278623:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f074380 x1875400222405248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521264.278633:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222405248:0@lo:400:kworker.0 00000100:00100000:0.0:1788521264.279418:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222404864:0@lo:400:kworker.0 00000100:00100000:0.0:1788521264.279455:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4358f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875400222404352:0@lo:400:kworker.0 00010000:00010000:1.0:1788521264.333089:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521264.781214:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788521264.781251:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f071880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222405760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788521264.781328:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521264.781396:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222405760 00000100:00100000:2.0:1788521264.781404:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222405760 00000100:00100000:2.0:1788521264.781447:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788521264.781456:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222405760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788521264.781477:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521264.781521:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222405760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521264.781528:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1788521264.781566:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f071880 x1875400222405760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521264.781582:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f071880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222405760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788521264.781982:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222405888:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788521264.782016:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521264.782091:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222405888 00000100:00100000:3.0:1788521264.782096:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222405888 00000100:00100000:3.0:1788521264.782138:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788521264.782146:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222405888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788521264.782170:0:10099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788521264.782226:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222405888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521264.782233:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788521264.782264:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222405888:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788521265.357100:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521266.381065:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521266.829112:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521266.831568:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222406144:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788521266.831646:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521266.832012:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222406144 00000100:00100000:1.0:1788521266.832021:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222406144 00000100:00100000:1.0:1788521266.832097:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788521266.832107:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222406144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788521266.832142:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521266.832191:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222406144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521266.832198:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1788521266.832611:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788521266.832652:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f076680 x1875400222406144/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521266.832670:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222406144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788521266.833642:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222406016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521266.833704:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521266.833924:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222406016 00000100:00100000:1.0:1788521266.833931:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222406016 00000100:00100000:1.0:1788521266.833982:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788521266.833991:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222406016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788521266.834011:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521266.834053:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222406016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521266.834072:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1788521266.834186:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee424ea680 x1875400222406016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521266.834205:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222406016:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788521266.834282:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788521267.405155:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788521267.884636:0:12505:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788521267.884908:0:12505:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788521268.429011:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521269.352739:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521269.352807:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521269.352842:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521269.352917:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521269.352937:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521269.352958:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521269.352980:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521269.353005:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201355264 00000100:00100000:2.0:1788521269.353014:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201355264 00000100:00100000:2.0:1788521269.353068:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201355520 00000100:00100000:2.0:1788521269.353071:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201355520 00000100:00100000:2.0:1788521269.353084:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201355136 00000100:00100000:2.0:1788521269.353087:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201355136 00000100:00100000:2.0:1788521269.353097:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201355392 00000100:00100000:2.0:1788521269.353099:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201355392 00000100:00100000:2.0:1788521269.353112:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 162 00000100:00100000:2.0:1788521269.353121:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+5:2396:x1875400201355264:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521269.353190:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+5:2396:x1875400201355264:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 70us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521269.353197:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 162 00000100:00100000:2.0:1788521269.353215:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 163 00000100:00100000:2.0:1788521269.353222:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2396:x1875400201355520:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521269.353246:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2396:x1875400201355520:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 25us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521269.353252:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 163 00000100:00100000:2.0:1788521269.353263:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 164 00000100:00100000:2.0:1788521269.353284:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+6:2396:x1875400201355136:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521269.353309:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f070e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+6:2396:x1875400201355136:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 26us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521269.353314:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 164 00000100:00100000:2.0:1788521269.353326:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 165 00000100:00100000:2.0:1788521269.353331:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6e4bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2396:x1875400201355392:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521269.353350:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6e4bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2396:x1875400201355392:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 19us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521269.353355:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 165 00000100:00080000:2.0:1788521269.353386:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788521269.353389:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788521269.353510:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201355008 00000100:00100000:0.0:1788521269.353515:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201355008 00000100:00100000:0.0:1788521269.353555:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 313 00000100:00100000:0.0:1788521269.353569:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4813ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2396:x1875400201355008:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521269.353605:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4813ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2396:x1875400201355008:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 43us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521269.353611:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 313 00000100:00100000:3.0:1788521269.354037:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201355776 00000100:00100000:3.0:1788521269.354043:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201355776 00000100:00100000:3.0:1788521269.354088:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201355648 00000100:00100000:3.0:1788521269.354091:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201355648 00000100:00080000:2.0:1788521269.354172:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788521269.354175:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788521269.354248:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 69 00000100:00100000:3.0:1788521269.354258:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2396:x1875400201355776:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521269.354300:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2396:x1875400201355776:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 45us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521269.354317:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 69 00000100:00100000:3.0:1788521269.354331:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 70 00000100:00100000:3.0:1788521269.354337:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6e4bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2396:x1875400201355648:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521269.354373:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6e4bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2396:x1875400201355648:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 37us (1391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521269.354379:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 70 00000100:00100000:0.0:1788521269.390178:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222406272:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788521269.390291:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521269.390387:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222406272 00000100:00100000:0.0:1788521269.390395:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222406272 00000100:00100000:0.0:1788521269.390453:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788521269.390471:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222406272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788521269.390504:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788521269.390549:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222406272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521269.390555:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788521269.391208:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222406272:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788521269.391327:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222406400:0@lo:400:kworker.0 00000100:00100000:0.0:1788521269.391427:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521269.391456:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875400222406912:0@lo:400:kworker.0 00000100:00100000:0.0:1788521269.391725:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521269.391747:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222407424:0@lo:400:kworker.0 00000100:00100000:0.0:1788521269.391770:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521269.391790:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788521269.391797:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222406528:0@lo:400:kworker.0 00000100:00100000:0.0:1788521269.391817:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521269.391835:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222407040:0@lo:400:kworker.0 00000100:00100000:0.0:1788521269.391901:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521269.391919:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4359b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875400222407552:0@lo:400:kworker.0 00000100:00100000:0.0:1788521269.391939:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521269.391964:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222406400 00000100:00100000:0.0:1788521269.391970:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222406400 00000100:00100000:0.0:1788521269.392001:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788521269.392007:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4813d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3643:x1875400222406400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521269.392045:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4813d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3643:x1875400222406400:12345-0@lo:400:kworker.0 Request processed in 38us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521269.392050:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788521269.392077:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222406656:0@lo:400:kworker.0 00000100:00100000:0.0:1788521269.392098:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521269.392108:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222407168:0@lo:400:kworker.0 00000100:00100000:0.0:1788521269.392127:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521269.392143:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222407680:0@lo:400:kworker.0 00000100:00100000:0.0:1788521269.392163:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521269.392197:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788521269.392202:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222406784:0@lo:400:kworker.0 00000100:00100000:0.0:1788521269.392224:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521269.392241:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222407296:0@lo:400:kworker.0 00000100:00100000:0.0:1788521269.392260:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521269.392275:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222407808:0@lo:400:kworker.0 00000100:00100000:0.0:1788521269.392295:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521269.397545:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222406912 00000100:00100000:3.0:1788521269.397558:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222406912 00000100:00100000:3.0:1788521269.397901:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222407424 00000100:00100000:3.0:1788521269.397905:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222407424 00000100:00100000:3.0:1788521269.397922:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222406528 00000100:00100000:3.0:1788521269.397924:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222406528 00000100:00100000:3.0:1788521269.397935:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222407040 00000100:00100000:3.0:1788521269.397938:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222407040 00000100:00100000:3.0:1788521269.397952:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222407552 00000100:00100000:3.0:1788521269.397955:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222407552 00000100:00100000:3.0:1788521269.397967:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222406656 00000100:00100000:3.0:1788521269.397970:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222406656 00000100:00100000:3.0:1788521269.397985:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788521269.397996:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875400222406912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521269.398078:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875400222406912:12345-0@lo:400:kworker.0 Request processed in 84us (6352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521269.398085:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788521269.398102:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788521269.398109:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222407424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521269.398140:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222407424:12345-0@lo:400:kworker.0 Request processed in 33us (6369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521269.398159:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788521269.398185:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788521269.398192:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222406528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521269.398224:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222406528:12345-0@lo:400:kworker.0 Request processed in 34us (6406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521269.398229:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788521269.398240:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788521269.398247:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222407040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521269.398277:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222407040:12345-0@lo:400:kworker.0 Request processed in 31us (6394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521269.398283:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788521269.398293:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788521269.398299:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875400222407552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521269.398324:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875400222407552:12345-0@lo:400:kworker.0 Request processed in 26us (6384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521269.398329:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788521269.398339:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788521269.398345:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222406656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521269.400958:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222406656:12345-0@lo:400:kworker.0 Request processed in 2605us (8850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521269.400972:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:3.0:1788521269.401056:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788521269.401062:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521269.401092:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222406784 00000100:00100000:3.0:1788521269.401100:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222406784 00000100:00100000:3.0:1788521269.404577:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788521269.404619:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222406784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521269.404710:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222406784:12345-0@lo:400:kworker.0 Request processed in 112us (12485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521269.404719:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788521269.404829:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788521269.404848:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222407936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521269.404927:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521269.404984:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222406656:0@lo:400:kworker.0 00000100:00100000:0.0:1788521269.405006:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222406784:0@lo:400:kworker.0 00000100:00100000:0.0:1788521269.405289:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222406528:0@lo:400:kworker.0 00010000:00080000:0.0:1788521269.405546:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43497480 x1875400222407040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521269.406998:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222407040:0@lo:400:kworker.0 00010000:00080000:0.0:1788521269.407034:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4359b800 x1875400222407552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521269.407045:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4359b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875400222407552:0@lo:400:kworker.0 00000100:00100000:0.0:1788521269.407057:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222406400:0@lo:400:kworker.0 00000100:00100000:0.0:1788521269.407070:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875400222406912:0@lo:400:kworker.0 00000100:00100000:0.0:1788521269.407082:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222407424:0@lo:400:kworker.0 00000100:00100000:2.0:1788521269.418753:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222407168 00000100:00100000:2.0:1788521269.418769:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222407168 00000100:00100000:2.0:1788521269.418789:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222407936 00000100:00100000:2.0:1788521269.418792:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222407936 00000100:00100000:2.0:1788521269.418874:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788521269.418902:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4358ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222407936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788521269.418935:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521269.419008:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4358ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222407936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (14081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521269.419014:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:2.0:1788521269.419071:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f074380 x1875400222407936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521269.419091:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222407936:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788521269.419125:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521269.419221:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521269.419240:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222407680 00000100:00100000:2.0:1788521269.419244:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222407680 00000100:00100000:3.0:1788521269.419248:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222407296 00000100:00100000:3.0:1788521269.419251:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222407296 00000100:00080000:2.0:1788521269.419259:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788521269.419261:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788521269.419269:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222407808 00000100:00100000:3.0:1788521269.419272:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222407808 00000100:00100000:2.0:1788521269.419272:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788521269.419277:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222407168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521269.419283:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788521269.419289:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222407296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521269.419318:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222407296:12345-0@lo:400:kworker.0 Request processed in 29us (27057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521269.419318:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222407168:12345-0@lo:400:kworker.0 Request processed in 40us (27189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521269.419325:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788521269.424108:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788521269.424143:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788521269.424164:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222407680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521269.426268:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222407680:12345-0@lo:400:kworker.0 Request processed in 2114us (34100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521269.426279:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788521269.426304:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788521269.426318:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4358f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222407808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521269.426342:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4358f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222407808:12345-0@lo:400:kworker.0 Request processed in 32us (34047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521269.426348:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:3.0:1788521269.426405:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee41aab480 x1875400222407296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521269.426440:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222407296:0@lo:400:kworker.0 00010000:00080000:3.0:1788521269.426455:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43598e00 x1875400222407808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521269.426474:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222407808:0@lo:400:kworker.0 00010000:00080000:3.0:1788521269.426487:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee41aab100 x1875400222407168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521269.426494:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222407168:0@lo:400:kworker.0 00010000:00080000:3.0:1788521269.426504:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43598380 x1875400222407680/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521269.426510:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222407680:0@lo:400:kworker.0 00010000:00010000:3.0:1788521269.453334:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521269.901552:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788521269.901586:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef6e4bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222408064:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788521269.901743:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521269.901820:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222408064 00000100:00100000:2.0:1788521269.901834:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222408064 00000100:00100000:2.0:1788521269.901939:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788521269.901951:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222408064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788521269.901981:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521269.902063:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222408064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521269.902071:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:2.0:1788521269.902184:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef6e4bc000 x1875400222408064/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521269.902207:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef6e4bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222408064:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788521269.907988:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4358ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222408192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788521269.908068:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521269.916521:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222408192 00000100:00100000:3.0:1788521269.916536:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222408192 00000100:00100000:3.0:1788521269.916597:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788521269.916608:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222408192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788521269.916656:0:10099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788521269.916737:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222408192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (8668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521269.916743:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788521269.916798:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4358ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222408192:0@lo:41:osp-pre-1-0.0 00000020:00000004:0.0:1788521270.048832:0:12602:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788521270.049100:0:12602:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788521270.477133:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521271.501502:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521271.950422:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521271.950449:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222408320:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788521271.950519:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521271.950733:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222408320 00000100:00100000:1.0:1788521271.950751:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222408320 00000100:00100000:1.0:1788521271.950822:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788521271.950843:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4358f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222408320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788521271.950878:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521271.950952:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4358f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222408320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521271.950959:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:1.0:1788521271.951004:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f077480 x1875400222408320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521271.951023:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222408320:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788521271.951326:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521271.954704:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4358d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222408448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521271.954785:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521271.954971:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222408448 00000100:00100000:1.0:1788521271.954978:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222408448 00000100:00100000:1.0:1788521271.955038:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788521271.955118:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6e4bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222408448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788521271.955139:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521271.955260:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6e4bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222408448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521271.955279:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788521271.955342:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788521271.955489:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4358d880 x1875400222408448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521271.955509:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4358d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222408448:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788521272.526352:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788521272.672818:0:12699:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788521272.674019:0:12699:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788521273.550409:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521274.476073:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521274.476128:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521274.476147:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521274.476164:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521274.476184:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521274.476239:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201355904 00000100:00100000:0.0:1788521274.476248:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201355904 00000100:00100000:0.0:1788521274.476305:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 315 00000100:00100000:0.0:1788521274.476314:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4813f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2394:x1875400201355904:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521274.476388:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4813f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2394:x1875400201355904:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 75us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521274.476396:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 315 00000100:00100000:3.0:1788521274.476568:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201356160 00000100:00100000:3.0:1788521274.476573:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201356160 00000100:00100000:3.0:1788521274.476621:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201356416 00000100:00100000:3.0:1788521274.476624:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201356416 00000100:00100000:3.0:1788521274.476641:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201356032 00000100:00100000:3.0:1788521274.476643:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201356032 00000100:00100000:3.0:1788521274.476655:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201356288 00000100:00100000:3.0:1788521274.476657:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201356288 00000100:00100000:3.0:1788521274.476671:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 172 00000100:00100000:3.0:1788521274.476678:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6e4bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+5:2394:x1875400201356160:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521274.476722:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6e4bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+5:2394:x1875400201356160:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 45us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521274.476729:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 172 00000100:00100000:3.0:1788521274.476752:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 173 00000100:00100000:3.0:1788521274.476760:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6e4bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2394:x1875400201356416:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521274.476784:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6e4bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2394:x1875400201356416:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 25us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521274.476790:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 173 00000100:00100000:3.0:1788521274.476802:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 174 00000100:00100000:3.0:1788521274.476809:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6e4bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+6:2393:x1875400201356032:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521274.476844:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6e4bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+6:2393:x1875400201356032:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 36us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521274.476849:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 174 00000100:00100000:3.0:1788521274.476860:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 175 00000100:00100000:3.0:1788521274.476866:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6e4bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2393:x1875400201356288:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521274.476932:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6e4bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2393:x1875400201356288:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 66us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521274.476938:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 175 00000100:00080000:2.0:1788521274.477318:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788521274.477323:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788521274.479546:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521274.479597:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521274.479909:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201356544 00000100:00100000:2.0:1788521274.479918:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201356544 00000100:00100000:2.0:1788521274.479970:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201356672 00000100:00100000:2.0:1788521274.479974:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201356672 00000100:00100000:2.0:1788521274.479994:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 22 00000100:00100000:2.0:1788521274.480003:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4358d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2392:x1875400201356544:12345-192.168.203.41@tcp:9:kworker.0 00000020:00000080:2.0:1788521274.480026:0:8875:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d13b4 00000100:00080000:2.0:1788521274.480033:0:8875:0:(import.c:65:import_set_state_nolock()) ffff8fef7efe3800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788521274.480074:0:8875:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788521274.480212:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4358d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+2:2392:x1875400201356544:12345-192.168.203.41@tcp:9:kworker.0 Request processed in 209us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521274.480219:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 22 00000100:00100000:2.0:1788521274.480233:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 23 00000100:00100000:2.0:1788521274.480240:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4358ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2392:x1875400201356672:12345-192.168.203.41@tcp:9:kworker.0 00000020:00000080:2.0:1788521274.480251:0:8875:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d13bb 00000100:00080000:2.0:1788521274.480256:0:8875:0:(import.c:65:import_set_state_nolock()) ffff8fef7efe7800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788521274.480275:0:8875:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788521274.480514:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4358ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+2:2392:x1875400201356672:12345-192.168.203.41@tcp:9:kworker.0 Request processed in 97us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521274.480520:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 23 00010000:00010000:2.0:1788521274.480543:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521274.480727:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788521274.480734:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521274.480738:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521274.518929:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222408576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788521274.519040:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521274.522060:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222408576 00000100:00100000:1.0:1788521274.522074:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222408576 00000100:00100000:1.0:1788521274.522140:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788521274.523839:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222408576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788521274.523878:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788521274.523973:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222408576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1823us (4932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521274.523982:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788521274.524017:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222408576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788521274.524057:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788521274.524069:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f076a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222408704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521274.524106:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521274.526345:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222408704 00000100:00100000:1.0:1788521274.526358:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222408704 00000100:00100000:1.0:1788521274.526431:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788521274.526442:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6e4bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222408704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521274.526470:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521274.526536:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6e4bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222408704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (2430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521274.526542:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:1.0:1788521274.526596:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f076a00 x1875400222408704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521274.526613:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f076a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222408704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521274.527121:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222409088:0@lo:400:kworker.0 00000100:00100000:3.0:1788521274.527862:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521274.527912:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee437c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222409600:0@lo:400:kworker.0 00000100:00100000:3.0:1788521274.527937:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521274.527956:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222410112:0@lo:400:kworker.0 00000100:00100000:3.0:1788521274.527974:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521274.527994:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788521274.527999:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875400222408960:0@lo:400:kworker.0 00000100:00100000:3.0:1788521274.528020:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521274.528035:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee437c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875400222409472:0@lo:400:kworker.0 00000100:00100000:3.0:1788521274.528053:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521274.528066:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875400222409984:0@lo:400:kworker.0 00000100:00100000:3.0:1788521274.528083:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521274.528108:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222409088 00000100:00100000:3.0:1788521274.528114:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222409088 00000100:00080000:2.0:1788521274.528616:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521274.529071:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222409600 00000100:00100000:2.0:1788521274.529078:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222409600 00000100:00100000:3.0:1788521274.529261:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222408960 00000100:00100000:3.0:1788521274.529265:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222408960 00000100:00100000:3.0:1788521274.529283:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222409472 00000100:00100000:3.0:1788521274.529285:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222409472 00000100:00100000:3.0:1788521274.529298:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222409984 00000100:00100000:3.0:1788521274.529300:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222409984 00000100:00100000:3.0:1788521274.529315:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788521274.529518:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222410112 00000100:00100000:2.0:1788521274.529523:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222410112 00000100:00100000:2.0:1788521274.529548:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788521274.529555:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222409600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521274.529623:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222409216:0@lo:400:kworker.0 00000100:00100000:2.0:1788521274.529626:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222409600:12345-0@lo:400:kworker.0 Request processed in 69us (1685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521274.529633:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788521274.529649:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788521274.529658:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222410112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521274.529678:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521274.529694:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222410112:12345-0@lo:400:kworker.0 Request processed in 37us (1717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521274.529700:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1788521274.529714:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521274.529717:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788521274.529720:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521274.529732:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788521274.529739:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875400222408960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521274.529771:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875400222408960:12345-0@lo:400:kworker.0 Request processed in 33us (1750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521274.529776:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788521274.529797:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788521274.529802:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875400222409472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521274.529834:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee437c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222409728:0@lo:400:kworker.0 00000100:00100000:2.0:1788521274.529849:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875400222409472:12345-0@lo:400:kworker.0 Request processed in 46us (1793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521274.529856:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788521274.529866:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521274.529873:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788521274.529908:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875400222409984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521274.529915:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788521274.529925:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222408832:0@lo:400:kworker.0 00000100:00100000:2.0:1788521274.529941:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875400222409984:12345-0@lo:400:kworker.0 Request processed in 62us (1856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521274.529948:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788521274.529960:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521274.529990:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222409728 00000100:00100000:2.0:1788521274.529995:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222409728 00000100:00100000:1.0:1788521274.529998:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875400222409344:0@lo:400:kworker.0 00000100:00100000:1.0:1788521274.530029:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521274.530033:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788521274.530042:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f074a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222409728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521274.530051:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875400222409856:0@lo:400:kworker.0 00000100:00100000:2.0:1788521274.530087:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f074a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222409728:12345-0@lo:400:kworker.0 Request processed in 43us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521274.530087:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521274.530098:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1788521274.530114:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788521274.530122:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee437c0000 x1875400222409728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521274.530947:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222409344 00000100:00100000:2.0:1788521274.530954:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222409344 00000100:00100000:2.0:1788521274.530982:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222409856 00000100:00100000:2.0:1788521274.530985:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222409856 00000100:00100000:1.0:1788521274.531043:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee437c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222409728:0@lo:400:kworker.0 00000100:00100000:2.0:1788521274.531145:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788521274.531156:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875400222409344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521274.531207:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875400222409344:12345-0@lo:400:kworker.0 Request processed in 54us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521274.531413:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875400222409344:0@lo:400:kworker.0 00000100:00100000:0.0:1788521274.531448:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222408832 00000100:00100000:0.0:1788521274.531452:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222408832 00000100:00100000:0.0:1788521274.531480:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788521274.531486:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71ec6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3645:x1875400222408832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521274.531522:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71ec6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3645:x1875400222408832:12345-0@lo:400:kworker.0 Request processed in 36us (1562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521274.531528:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788521274.531555:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222409216 00000100:00100000:0.0:1788521274.531559:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222409216 00000100:00100000:0.0:1788521274.531580:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788521274.531585:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222409216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521274.531614:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222409216:12345-0@lo:400:kworker.0 Request processed in 29us (1937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521274.531619:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788521274.531660:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875400222408960:0@lo:400:kworker.0 00010000:00080000:0.0:1788521274.531673:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee437c1180 x1875400222409472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521274.532244:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee437c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875400222409472:0@lo:400:kworker.0 00010000:00080000:0.0:1788521274.532263:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef766f6300 x1875400222409984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521274.532272:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875400222409984:0@lo:400:kworker.0 00010000:00080000:0.0:1788521274.532285:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee437c3100 x1875400222409600/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521274.532293:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee437c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222409600:0@lo:400:kworker.0 00010000:00080000:0.0:1788521274.532305:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef766f5180 x1875400222410112/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521274.532313:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222410112:0@lo:400:kworker.0 00000100:00100000:0.0:1788521274.532446:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222408832:0@lo:400:kworker.0 00000100:00100000:0.0:1788521274.532458:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222409216:0@lo:400:kworker.0 00000100:00100000:1.0:1788521274.534770:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788521274.534803:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:2.0:1788521274.534862:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521274.535123:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875400222409856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521274.535210:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875400222409856:12345-0@lo:400:kworker.0 Request processed in 95us (5126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521274.535217:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788521274.535310:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875400222409856:0@lo:400:kworker.0 00000100:00100000:3.0:1788521274.536245:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222409088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521274.536349:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222409088:12345-0@lo:400:kworker.0 Request processed in 7026us (8487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521274.536357:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788521274.536409:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222409088:0@lo:400:kworker.0 00010000:00010000:3.0:1788521274.575916:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521275.021833:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788521275.021856:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222410240:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788521275.021953:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521275.021982:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788521275.021991:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef6e4be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222410368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788521275.022010:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222410240 00000100:00100000:2.0:1788521275.022020:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521275.022597:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222410240 00000100:00100000:0.0:1788521275.022701:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788521275.022711:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222410240:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788521275.022740:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222410368 00000100:00100000:1.0:1788521275.022745:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222410368 00000004:00000024:0.0:1788521275.022754:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788521275.022774:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788521275.022779:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6e4bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222410368:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788521275.022801:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222410240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (848us total) trans 0 rc 0/0 00002000:00000024:1.0:1788521275.022804:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521275.022808:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788521275.022860:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6e4bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222410368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521275.022867:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:1.0:1788521275.022923:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef6e4be680 x1875400222410368/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521275.022941:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef6e4be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222410368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788521275.025068:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222410240:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1788521275.058089:0:12797:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788521275.059499:0:12797:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788521275.598055:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521276.622063:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521277.071168:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788521277.071211:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222410496:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788521277.071314:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521277.071880:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222410496 00000100:00100000:0.0:1788521277.071911:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222410496 00000100:00100000:0.0:1788521277.071983:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788521277.071996:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222410496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788521277.072033:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521277.072172:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521277.072188:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222410624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521277.072236:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788521277.077232:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521277.082837:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222410496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 10828us (11506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521277.082852:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788521277.082925:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222410624 00000100:00100000:0.0:1788521277.082934:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222410624 00010000:00080000:3.0:1788521277.083103:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f074380 x1875400222410496/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521293 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521277.083147:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222410496:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788521277.094929:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788521277.094947:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6e4be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222410624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788521277.094985:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788521277.096331:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521277.096460:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6e4be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222410624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1512us (24217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521277.096474:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:1.0:1788521277.101464:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f076680 x1875400222410624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521293 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521277.101508:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222410624:0@lo:13:osp-pre-0-0.0 00000020:00000004:1.0:1788521277.597154:0:12894:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788521277.597474:0:12894:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788521277.647242:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521278.672542:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521279.589789:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521279.589831:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521279.589879:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521279.589934:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521279.589937:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201357056 00000100:00100000:1.0:1788521279.589950:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201357056 00000100:00100000:3.0:1788521279.589966:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521279.589993:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201357312 00000100:00100000:3.0:1788521279.589998:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201357312 00000100:00100000:1.0:1788521279.590030:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201356928 00000100:00100000:3.0:1788521279.590034:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201357184 00000100:00100000:1.0:1788521279.590037:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201356928 00000100:00100000:3.0:1788521279.590041:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201357184 00000100:00100000:3.0:1788521279.590077:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 182 00000100:00100000:2.0:1788521279.590135:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201356800 00000100:00100000:2.0:1788521279.590139:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201356800 00000100:00100000:2.0:1788521279.590170:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 317 00000100:00100000:2.0:1788521279.590178:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71ec7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2393:x1875400201356800:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521279.590208:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 183 00000100:00100000:1.0:1788521279.590226:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2393:x1875400201357312:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521279.590274:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71ec7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2393:x1875400201356800:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 96us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521279.590283:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2393:x1875400201357312:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 61us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521279.590289:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 317 00000100:00100000:1.0:1788521279.590302:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 183 00000100:00100000:1.0:1788521279.590328:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 184 00000100:00100000:2.0:1788521279.590337:0:6520:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788521279.590339:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+6:2393:x1875400201356928:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521279.590358:0:6520:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1788521279.590398:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+6:2393:x1875400201356928:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 62us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521279.590406:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 184 00000100:00100000:1.0:1788521279.590431:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 185 00000100:00100000:1.0:1788521279.590442:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2393:x1875400201357184:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521279.590472:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2393:x1875400201357184:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 33us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521279.590478:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 185 00000100:00080000:1.0:1788521279.590509:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788521279.590515:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788521279.591838:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+5:2393:x1875400201357056:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521279.593106:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+5:2393:x1875400201357056:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 3012us (3267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521279.593120:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 182 00000100:00100000:2.0:1788521279.629169:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222410752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521279.629243:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521279.629368:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222410752 00000100:00100000:1.0:1788521279.629376:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222410752 00000100:00100000:1.0:1788521279.629442:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788521279.629451:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222410752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521279.629480:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521279.629535:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222410752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521279.629542:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1788521279.629739:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788521279.629769:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f076680 x1875400222410752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521279.629799:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222410752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521279.629910:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222410880:0@lo:400:kworker.0 00000100:00100000:3.0:1788521279.629957:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521279.629994:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222411264:0@lo:400:kworker.0 00000100:00100000:3.0:1788521279.630001:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222411392:0@lo:400:kworker.0 00000100:00100000:2.0:1788521279.630032:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521279.630041:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521279.630163:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef81499500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222411904:0@lo:400:kworker.0 00000100:00100000:3.0:1788521279.630191:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521279.630288:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222410880 00000100:00100000:3.0:1788521279.630293:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222410880 00000100:00100000:3.0:1788521279.630331:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788521279.630340:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4875b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3646:x1875400222410880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521279.630391:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4875b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3646:x1875400222410880:12345-0@lo:400:kworker.0 Request processed in 54us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521279.630398:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788521279.630441:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222411392 00000100:00100000:3.0:1788521279.630446:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222411392 00000100:00100000:3.0:1788521279.630472:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788521279.630480:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4351bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222411392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521279.630516:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4351bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222411392:12345-0@lo:400:kworker.0 Request processed in 37us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521279.630522:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788521279.630552:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222411392:0@lo:400:kworker.0 00000100:00100000:3.0:1788521279.630561:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222410880:0@lo:400:kworker.0 00000100:00100000:3.0:1788521279.631379:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222411136:0@lo:400:kworker.0 00000100:00100000:3.0:1788521279.631418:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521279.631442:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef8149a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875400222411648:0@lo:400:kworker.0 00000100:00100000:3.0:1788521279.631474:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521279.631495:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef81499180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875400222412160:0@lo:400:kworker.0 00000100:00100000:3.0:1788521279.631515:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521279.631535:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788521279.631542:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875400222411008:0@lo:400:kworker.0 00000100:00100000:3.0:1788521279.631564:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521279.631581:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875400222411520:0@lo:400:kworker.0 00000100:00100000:3.0:1788521279.631600:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521279.631617:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef8149aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875400222412032:0@lo:400:kworker.0 00000100:00100000:3.0:1788521279.631637:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521279.631663:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222411136 00000100:00100000:3.0:1788521279.631668:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222411136 00000100:00100000:3.0:1788521279.631698:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788521279.631706:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4351b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222411136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521279.631748:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4351b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222411136:12345-0@lo:400:kworker.0 Request processed in 43us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521279.631754:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788521279.631774:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222411264 00000100:00100000:3.0:1788521279.631793:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222411264 00000100:00100000:3.0:1788521279.631813:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222411648 00000100:00100000:3.0:1788521279.631816:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222411648 00000100:00100000:3.0:1788521279.631840:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222412160 00000100:00100000:3.0:1788521279.631843:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222412160 00000100:00100000:3.0:1788521279.631856:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222411008 00000100:00100000:3.0:1788521279.631858:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222411008 00000100:00100000:3.0:1788521279.631868:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222411520 00000100:00100000:3.0:1788521279.631870:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222411520 00000100:00100000:3.0:1788521279.631880:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222412032 00000100:00100000:3.0:1788521279.631909:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222412032 00000100:00100000:3.0:1788521279.631930:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788521279.631936:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef8149b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222411264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521279.631969:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef8149b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222411264:12345-0@lo:400:kworker.0 Request processed in 34us (1937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521279.631975:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788521279.631987:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788521279.631994:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4351aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875400222411648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521279.632020:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4351aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875400222411648:12345-0@lo:400:kworker.0 Request processed in 28us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521279.632026:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788521279.632037:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788521279.632043:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4351b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875400222412160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521279.632202:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4351b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875400222412160:12345-0@lo:400:kworker.0 Request processed in 159us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521279.632208:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788521279.632221:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788521279.632228:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875400222411008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521279.632257:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875400222411008:12345-0@lo:400:kworker.0 Request processed in 31us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521279.632263:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788521279.632273:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788521279.632280:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4351ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875400222411520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521279.632306:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4351ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875400222411520:12345-0@lo:400:kworker.0 Request processed in 27us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521279.632320:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788521279.632334:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788521279.632341:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4351a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875400222412032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521279.632615:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4351a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875400222412032:12345-0@lo:400:kworker.0 Request processed in 273us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521279.632622:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788521279.632677:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875400222411008:0@lo:400:kworker.0 00000100:00100000:3.0:1788521279.632687:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875400222411520:0@lo:400:kworker.0 00000100:00100000:3.0:1788521279.632696:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef8149aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875400222412032:0@lo:400:kworker.0 00000100:00100000:3.0:1788521279.632705:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222411136:0@lo:400:kworker.0 00010000:00080000:3.0:1788521279.632717:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef8149a680 x1875400222411648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521279.632738:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef8149a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875400222411648:0@lo:400:kworker.0 00010000:00080000:3.0:1788521279.632749:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef81499180 x1875400222412160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521279.632757:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef81499180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875400222412160:0@lo:400:kworker.0 00000100:00100000:3.0:1788521279.632801:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4351b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222412416:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788521279.632833:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521279.632868:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222412416 00000100:00100000:3.0:1788521279.632874:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222412416 00000100:00100000:3.0:1788521279.632922:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788521279.632931:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222412416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788521279.632965:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788521279.633000:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222412416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521279.633007:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788521279.633038:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4351b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222412416:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788521279.635004:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222411264:0@lo:400:kworker.0 00000100:00100000:2.0:1788521279.635017:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef81498380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222411776:0@lo:400:kworker.0 00000100:00100000:2.0:1788521279.635062:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788521279.636339:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788521279.636360:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788521279.638943:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef8149ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222412288:0@lo:400:kworker.0 00000100:00100000:2.0:1788521279.638998:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521279.639049:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222411904 00000100:00100000:2.0:1788521279.639056:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222411904 00000100:00100000:2.0:1788521279.639103:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222411776 00000100:00100000:2.0:1788521279.639106:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222411776 00000100:00100000:2.0:1788521279.639121:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222412288 00000100:00100000:2.0:1788521279.639124:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222412288 00000100:00100000:2.0:1788521279.639139:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788521279.639147:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43519c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222411904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521279.639199:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43519c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222411904:12345-0@lo:400:kworker.0 Request processed in 52us (9006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521279.639206:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788521279.639222:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788521279.639228:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef81498a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222411776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521279.639257:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef81498a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222411776:12345-0@lo:400:kworker.0 Request processed in 30us (4196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521279.639264:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788521279.639275:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788521279.639281:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef81499180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222412288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521279.639306:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef81499180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222412288:12345-0@lo:400:kworker.0 Request processed in 26us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521279.639312:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1788521279.639477:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521279.639482:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788521279.639523:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef81499500 x1875400222411904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521279.639538:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef81499500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222411904:0@lo:400:kworker.0 00010000:00080000:2.0:1788521279.639583:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef81498380 x1875400222411776/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521279.639592:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef81498380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222411776:0@lo:400:kworker.0 00010000:00080000:2.0:1788521279.639602:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef8149ad80 x1875400222412288/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521279.639810:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef8149ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222412288:0@lo:400:kworker.0 00010000:00010000:0.0:1788521279.693094:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521280.142609:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222412544:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788521280.142681:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521280.142746:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788521280.142761:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef8149ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222412672:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788521280.142803:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521280.142841:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222412672 00000100:00100000:0.0:1788521280.142849:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222412672 00000100:00100000:0.0:1788521280.142926:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788521280.142937:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222412672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788521280.142961:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521280.142996:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222412544 00000100:00100000:2.0:1788521280.143001:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222412544 00000100:00100000:0.0:1788521280.143002:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222412672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521280.143009:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788521280.143030:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788521280.143037:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222412544:12345-0@lo:41:osp-pre-1-0.0 00010000:00080000:0.0:1788521280.143047:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef8149ad80 x1875400222412672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000024:2.0:1788521280.143062:0:10099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788521280.143065:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef8149ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222412672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788521280.143097:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222412544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521280.143104:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788521280.143126:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222412544:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1788521280.146157:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3ebc0a53-9d31-4673-9ea1-597a62a00e6b 00000020:00000080:2.0:1788521280.146165:0:8430:0:(genops.c:885:class_export_put()) final put ffff8fef7efe3000/3ebc0a53-9d31-4673-9ea1-597a62a00e6b 00000020:00000080:0.0:1788521280.149571:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef7efe3000/3ebc0a53-9d31-4673-9ea1-597a62a00e6b for lustre-OST0000 00000020:00000080:0.0:1788521280.149626:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fef7efe3800 for lustre-OST0000 00000001:00100000:1.0:1788521280.155123:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3ebc0a53-9d31-4673-9ea1-597a62a00e6b 00000020:00000080:1.0:1788521280.155133:0:9512:0:(genops.c:885:class_export_put()) final put ffff8fef7efe1800/3ebc0a53-9d31-4673-9ea1-597a62a00e6b 00000020:00000080:2.0:1788521280.156898:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef7efe1800/3ebc0a53-9d31-4673-9ea1-597a62a00e6b for lustre-OST0001 00000020:00000080:2.0:1788521280.156954:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fef7efe7800 for lustre-OST0001 00010000:00010000:3.0:1788521280.726151:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521281.754054:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521282.189202:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222412800:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788521282.189266:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521282.189367:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222412800 00000100:00100000:1.0:1788521282.189375:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222412800 00000100:00100000:1.0:1788521282.189428:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788521282.189437:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4351b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222412800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788521282.189462:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521282.189499:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4351b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222412800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (234us total) trans 0 rc 0/0 00000100:00080000:3.0:1788521282.189585:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788521282.189624:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f076680 x1875400222412800/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521298 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521282.189643:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222412800:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788521282.189751:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788521282.189880:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef81498380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222412928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521282.189936:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521282.189966:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222412928 00000100:00100000:2.0:1788521282.190259:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222412928 00000100:00100000:2.0:1788521282.190299:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788521282.190305:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef81499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222412928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788521282.190318:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521282.190346:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef81499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222412928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521282.190352:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:2.0:1788521282.190378:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef81498380 x1875400222412928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521298 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521282.190391:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef81498380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222412928:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788521282.190443:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1788521282.364014:0:13040:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788521282.765805:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521283.790781:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521284.740642:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521284.740679:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521284.740698:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521284.740715:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521284.740756:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521284.740783:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201357440 00000100:00100000:3.0:1788521284.740792:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201357440 00000100:00100000:3.0:1788521284.740842:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 319 00000100:00100000:3.0:1788521284.740853:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef48759050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2395:x1875400201357440:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521284.740942:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef48759050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2395:x1875400201357440:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 92us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521284.740961:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 319 00000100:00100000:3.0:1788521284.740990:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201357696 00000100:00100000:3.0:1788521284.740993:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201357696 00000100:00100000:3.0:1788521284.741021:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201357952 00000100:00100000:3.0:1788521284.741024:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201357952 00000100:00100000:3.0:1788521284.741035:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201357568 00000100:00100000:3.0:1788521284.741037:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201357568 00000100:00100000:3.0:1788521284.741047:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201357824 00000100:00100000:3.0:1788521284.741049:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201357824 00000100:00100000:3.0:1788521284.741061:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 192 00000100:00100000:3.0:1788521284.741080:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201357696:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521284.741110:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201357696:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 32us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521284.741115:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 192 00000100:00100000:3.0:1788521284.741127:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 193 00000100:00100000:3.0:1788521284.741134:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201357952:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521284.741154:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201357952:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 22us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521284.741160:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 193 00000100:00100000:3.0:1788521284.741171:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 194 00000100:00100000:3.0:1788521284.741176:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4351a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+6:2395:x1875400201357568:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521284.741197:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4351a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+6:2395:x1875400201357568:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 21us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521284.741203:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 194 00000100:00100000:3.0:1788521284.741213:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 195 00000100:00100000:3.0:1788521284.741225:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201357824:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521284.741247:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201357824:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 24us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521284.741252:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 195 00000100:00080000:3.0:1788521284.741275:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788521284.741279:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788521284.752174:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef81498380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222413056:0@lo:400:kworker.0 00000100:00100000:2.0:1788521284.752244:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521284.752300:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222413568:0@lo:400:kworker.0 00000100:00100000:2.0:1788521284.752326:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521284.752345:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222414080:0@lo:400:kworker.0 00000100:00100000:2.0:1788521284.752368:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521284.752384:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4325a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222414592:0@lo:400:kworker.0 00000100:00100000:2.0:1788521284.752403:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521284.752424:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788521284.752430:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef8149a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222413184:0@lo:400:kworker.0 00000100:00100000:2.0:1788521284.752452:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521284.752468:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875400222413696:0@lo:400:kworker.0 00000100:00100000:2.0:1788521284.752537:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521284.752557:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222414208:0@lo:400:kworker.0 00000100:00100000:2.0:1788521284.752578:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521284.752616:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef8149aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222413312:0@lo:400:kworker.0 00000100:00100000:2.0:1788521284.752639:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521284.752656:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875400222413824:0@lo:400:kworker.0 00000100:00100000:2.0:1788521284.752673:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521284.752689:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222414336:0@lo:400:kworker.0 00000100:00100000:2.0:1788521284.752707:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521284.753286:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222413184 00000100:00100000:1.0:1788521284.753293:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222413184 00000100:00100000:1.0:1788521284.753325:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222413696 00000100:00100000:1.0:1788521284.753327:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222413696 00000100:00100000:1.0:1788521284.753346:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222414208 00000100:00100000:1.0:1788521284.753348:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222414208 00000100:00100000:1.0:1788521284.753357:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222413824 00000100:00100000:1.0:1788521284.753359:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222413824 00000100:00100000:1.0:1788521284.753368:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222414336 00000100:00100000:1.0:1788521284.753370:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222414336 00000100:00100000:1.0:1788521284.753384:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788521284.753393:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222413184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521284.753446:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222413184:12345-0@lo:400:kworker.0 Request processed in 54us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521284.753452:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788521284.753469:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788521284.753474:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875400222413696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521284.753511:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875400222413696:12345-0@lo:400:kworker.0 Request processed in 37us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521284.753517:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788521284.753527:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788521284.753532:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222414208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521284.753554:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222414208:12345-0@lo:400:kworker.0 Request processed in 22us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521284.753560:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788521284.753569:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788521284.753581:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875400222413824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521284.753671:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875400222413824:12345-0@lo:400:kworker.0 Request processed in 89us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521284.753677:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788521284.753688:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788521284.753694:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222414336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521284.753719:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222414336:12345-0@lo:400:kworker.0 Request processed in 26us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521284.753989:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788521284.754013:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222414720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521284.754045:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521284.754105:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef8149a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222413184:0@lo:400:kworker.0 00000100:00100000:1.0:1788521284.754115:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875400222413696:0@lo:400:kworker.0 00000100:00100000:1.0:1788521284.754124:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222414208:0@lo:400:kworker.0 00000100:00080000:1.0:1788521284.754148:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788521284.754152:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521284.754161:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222414720 00000100:00100000:1.0:1788521284.754165:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222414720 00000100:00100000:1.0:1788521284.754195:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788521284.754202:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f076680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222414720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521284.754223:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521284.754254:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f076680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222414720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521284.754259:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1788521284.754274:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788521284.754305:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f074380 x1875400222414720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521300 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521284.754319:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222414720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521284.756123:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788521284.756149:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef8149ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222413440:0@lo:400:kworker.0 00000100:00100000:2.0:1788521284.756201:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521284.756233:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222413952:0@lo:400:kworker.0 00000100:00100000:2.0:1788521284.756255:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521284.756276:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222414464:0@lo:400:kworker.0 00000100:00100000:2.0:1788521284.756296:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788521284.756324:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef71520a80 x1875400222413824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521284.756336:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875400222413824:0@lo:400:kworker.0 00010000:00080000:2.0:1788521284.756346:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef71520380 x1875400222414336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521284.756354:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222414336:0@lo:400:kworker.0 00000100:00100000:2.0:1788521284.756389:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222413056 00000100:00100000:2.0:1788521284.756401:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222413056 00000100:00100000:2.0:1788521284.756441:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788521284.756449:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3643:x1875400222413056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521284.756503:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3643:x1875400222413056:12345-0@lo:400:kworker.0 Request processed in 56us (4259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521284.756518:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788521284.756549:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222413568 00000100:00100000:2.0:1788521284.756553:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222413568 00000100:00100000:2.0:1788521284.756573:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222413312 00000100:00100000:2.0:1788521284.756576:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222413312 00000100:00100000:2.0:1788521284.756587:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788521284.756602:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222413568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521284.756635:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222413568:12345-0@lo:400:kworker.0 Request processed in 43us (4308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521284.756641:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788521284.756652:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788521284.756657:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222413312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521284.756686:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222413312:12345-0@lo:400:kworker.0 Request processed in 29us (4046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521284.756692:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788521284.756707:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222414080 00000100:00100000:2.0:1788521284.756711:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222414080 00000100:00100000:1.0:1788521284.757034:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222414592 00000100:00100000:1.0:1788521284.757039:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222414592 00000100:00100000:1.0:1788521284.757061:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222413952 00000100:00100000:1.0:1788521284.757064:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222413952 00000100:00100000:1.0:1788521284.757074:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222414464 00000100:00100000:1.0:1788521284.757076:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222414464 00000100:00100000:1.0:1788521284.757088:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788521284.757094:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222414592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521284.757127:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222414592:12345-0@lo:400:kworker.0 Request processed in 33us (4723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521284.757133:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788521284.757144:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788521284.757150:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43602d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222413952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521284.757174:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43602d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222413952:12345-0@lo:400:kworker.0 Request processed in 25us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521284.757180:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788521284.757190:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788521284.757195:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43600380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222414464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521284.757219:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43600380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222414464:12345-0@lo:400:kworker.0 Request processed in 24us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521284.757225:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1788521284.757241:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788521284.757244:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521284.757276:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef81498380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222413056:0@lo:400:kworker.0 00000100:00100000:1.0:1788521284.757296:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222413568:0@lo:400:kworker.0 00010000:00080000:1.0:1788521284.757307:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4325a680 x1875400222414592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521284.757316:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4325a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222414592:0@lo:400:kworker.0 00000100:00100000:1.0:1788521284.757339:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222413440 00000100:00100000:1.0:1788521284.757343:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222413440 00000100:00100000:1.0:1788521284.757363:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788521284.757369:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222413440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521284.757399:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222413440:12345-0@lo:400:kworker.0 Request processed in 30us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521284.757405:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788521284.758479:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788521284.758499:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222414080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521284.758801:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222414080:12345-0@lo:400:kworker.0 Request processed in 314us (6430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521284.758807:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788521284.758897:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef8149ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222413440:0@lo:400:kworker.0 00010000:00080000:2.0:1788521284.758912:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef71522680 x1875400222413952/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521284.758922:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222413952:0@lo:400:kworker.0 00010000:00080000:2.0:1788521284.758932:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef71521880 x1875400222414464/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521284.758939:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222414464:0@lo:400:kworker.0 00000100:00100000:2.0:1788521284.758948:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef8149aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222413312:0@lo:400:kworker.0 00010000:00080000:2.0:1788521284.758981:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef71521f80 x1875400222414080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521284.758989:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222414080:0@lo:400:kworker.0 00000100:00100000:3.0:1788521284.759277:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222414848:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788521284.759316:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521284.759350:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222414848 00000100:00100000:3.0:1788521284.759356:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222414848 00000100:00100000:3.0:1788521284.759387:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788521284.759394:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222414848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788521284.763923:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788521284.764024:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222414848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4626us (4702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521284.764035:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788521284.764120:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222414848:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788521284.816804:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521285.261647:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222414976:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788521285.261727:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521285.262064:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788521285.262075:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222415104:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788521285.262102:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521285.262180:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222415104 00000100:00100000:2.0:1788521285.262189:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222415104 00000100:00100000:2.0:1788521285.262244:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788521285.262254:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222415104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788521285.262276:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521285.262321:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222415104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521285.262327:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:3.0:1788521285.262420:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43602300 x1875400222415104/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521285.262456:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43602300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222415104:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788521285.262871:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222414976 00000100:00100000:0.0:1788521285.262876:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222414976 00000100:00100000:0.0:1788521285.262938:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788521285.262946:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222414976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788521285.262972:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788521285.263023:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222414976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521285.263029:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788521285.263098:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222414976:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788521285.839590:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521286.861034:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521287.312345:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788521287.312369:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222415232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788521287.312439:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521287.314055:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222415232 00000100:00100000:0.0:1788521287.314066:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222415232 00000100:00100000:0.0:1788521287.314151:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788521287.314163:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222415232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788521287.314194:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521287.314259:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222415232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (1820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521287.314268:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:0.0:1788521287.314312:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f074380 x1875400222415232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521287.314342:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222415232:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788521287.314415:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521287.318844:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788521287.318866:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222415360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521287.318959:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521287.319016:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222415360 00000100:00100000:3.0:1788521287.319023:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222415360 00000100:00100000:3.0:1788521287.319083:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788521287.319092:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222415360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788521287.319112:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788521287.319155:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222415360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521287.319162:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1788521287.319183:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788521287.319210:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef76714000 x1875400222415360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521287.319231:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222415360:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1788521287.650599:0:13187:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd341b42a0 20000000:00000080:0.0:1788521287.650617:0:13187:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8fef7a40a000 uarg=0000000000000000 20000000:01000000:0.0:1788521287.650665:0:13187:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788521287.650673:0:13187:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788521287.650678:0:13187:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788521287.652298:0:13188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788521287.652648:0:13187:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788521287.661333:0:13187:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788521287.661363:0:13187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fef6d7b7600/0x411dd0ee4d2d13c2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521287.661384:0:13187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef749cb600/0x411dd0ee4d2d1352 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed4ea expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521287.661409:0:13187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fee42411e00/0x411dd0ee4d2d1360 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1359 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521287.661417:0:13187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fee434aa800/0x411dd0ee4d2d136e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1367 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521287.661424:0:13187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef6d7b7200/0x411dd0ee4d2d137c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1375 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521287.661431:0:13187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef749cb400/0x411dd0ee4d2d138a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1383 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521287.661438:0:13187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fee434aae00/0x411dd0ee4d2d139f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed529 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521287.661446:0:13187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fef6d7b7600/0x411dd0ee4d2d13c2 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521287.661503:0:13187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fee434aae00/0x411dd0ee4d2d139f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed529 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521287.661520:0:13187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fee434aae00/0x411dd0ee4d2d139f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed529 expref: 12 pid: 6514 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521287.661544:0:13187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43600700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1875400222415488:192.168.203.41@tcp:104: 00010000:00010000:2.0:1788521287.662097:0:13187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef749cb400/0x411dd0ee4d2d138a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d1383 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521287.662107:0:13187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef749cb400/0x411dd0ee4d2d138a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1383 expref: 23 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521287.662124:0:13187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43602680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1875400222415616:0@lo:104: 00000100:00100000:2.0:1788521287.662162:0:13187:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788521287.662201:0:13187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef6d7b7200/0x411dd0ee4d2d137c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d1375 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521287.662209:0:13187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef6d7b7200/0x411dd0ee4d2d137c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1375 expref: 23 pid: 6514 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521287.662216:0:13187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43601f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1875400222415744:0@lo:104: 00000100:00100000:2.0:1788521287.662234:0:13187:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521287.662262:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222415616 00000100:00100000:2.0:1788521287.662269:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222415616 00000100:00100000:2.0:1788521287.662308:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222415744 00000100:00100000:2.0:1788521287.662311:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222415744 00000100:00100000:2.0:1788521287.662324:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788521287.662330:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43603b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+4:13187:x1875400222415616:12345-0@lo:104: 00010000:00010000:2.0:1788521287.662353:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fee42410400/0x411dd0ee4d2d1383 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d138a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521287.662395:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788521287.662400:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43603b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+4:13187:x1875400222415616:12345-0@lo:104: Request processed in 70us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521287.662406:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788521287.662421:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788521287.662427:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43603800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:13187:x1875400222415744:12345-0@lo:104: 00010000:00010000:2.0:1788521287.662434:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fee42410c00/0x411dd0ee4d2d1375 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d137c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521287.662473:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788521287.662479:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43603800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:13187:x1875400222415744:12345-0@lo:104: Request processed in 53us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521287.662484:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:0.0:1788521287.662718:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788521287.662739:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fee42410400/0x411dd0ee4d2d1383 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d138a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521287.662747:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410400 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:0.0:1788521287.662752:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fee42410400/0x411dd0ee4d2d1383 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d138a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521287.662771:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fee42410400/0x411dd0ee4d2d1383 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d138a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521287.662779:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fee42410400/0x411dd0ee4d2d1383 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d138a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521287.662785:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788521287.662814:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fee42410400/0x411dd0ee4d2d1383 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d138a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521287.662821:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521287.662841:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fee42410400/0x411dd0ee4d2d1383 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d138a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521287.662848:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fee42410400/0x411dd0ee4d2d1383 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d138a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521287.662872:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521287.662876:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fee42410c00/0x411dd0ee4d2d1375 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d137c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521287.662901:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410c00 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:0.0:1788521287.662905:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fee42410c00/0x411dd0ee4d2d1375 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d137c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521287.662912:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fee42410c00/0x411dd0ee4d2d1375 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d137c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521287.662918:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fee42410c00/0x411dd0ee4d2d1375 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d137c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521287.662930:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788521287.662946:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fee42410c00/0x411dd0ee4d2d1375 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d137c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521287.662952:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521287.662967:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fee42410c00/0x411dd0ee4d2d1375 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d137c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521287.662974:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fee42410c00/0x411dd0ee4d2d1375 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d137c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521287.662983:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521287.662984:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521287.662986:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521287.663006:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222415872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521287.663038:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521287.663074:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222416000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521287.663095:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521287.663126:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222415872 00000100:00100000:0.0:1788521287.663130:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222415872 00010000:00010000:0.0:1788521287.663151:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef749cb400/0x411dd0ee4d2d138a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1383 expref: 24 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521287.663170:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222416000 00000100:00100000:0.0:1788521287.663172:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222416000 00010000:00010000:0.0:1788521287.663182:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef6d7b7200/0x411dd0ee4d2d137c lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1375 expref: 25 pid: 6514 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521287.663192:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788521287.663204:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+25:3646:x1875400222415872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521287.663215:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521287.663220:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef749cb400/0x411dd0ee4d2d138a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1383 expref: 25 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521287.663229:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef749cb400/0x411dd0ee4d2d138a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1383 expref: 25 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521287.663243:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521287.663271:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+25:3646:x1875400222415872:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521287.663277:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788521287.663292:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788521287.663298:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3643:x1875400222416000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521287.663306:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521287.663310:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef6d7b7200/0x411dd0ee4d2d137c lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1375 expref: 24 pid: 6514 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521287.663317:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef6d7b7200/0x411dd0ee4d2d137c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1375 expref: 24 pid: 6514 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521287.663325:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521287.663348:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3643:x1875400222416000:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521287.663353:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788521287.663387:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222416000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521287.663410:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222415872:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788521287.664054:0:13187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fee434aa800/0x411dd0ee4d2d136e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d1367 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521287.664065:0:13187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fee434aa800/0x411dd0ee4d2d136e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1367 expref: 23 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521287.664076:0:13187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43602a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1875400222416128:0@lo:104: 00000100:00100000:2.0:1788521287.664108:0:13187:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788521287.664144:0:13187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fee42411e00/0x411dd0ee4d2d1360 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d1359 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521287.664151:0:13187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fee42411e00/0x411dd0ee4d2d1360 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1359 expref: 23 pid: 6513 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521287.664159:0:13187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43601880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1875400222416256:0@lo:104: 00000100:00100000:2.0:1788521287.664178:0:13187:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788521287.664207:0:13187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef749cb600/0x411dd0ee4d2d1352 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed4ea expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521287.664215:0:13187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fef749cb600/0x411dd0ee4d2d1352 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed4ea expref: 12 pid: 6514 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521287.664223:0:13187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43602300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1875400222416384:192.168.203.41@tcp:104: 00000100:00100000:2.0:1788521287.664257:0:13187:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef7a431300 going to sleep for 11 seconds 00010000:00010000:2.0:1788521287.664280:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef749cb400/0x411dd0ee4d2d138a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d1383 expref: 23 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521287.664291:0:13187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43602680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1875400222415616:0@lo:104: 00010000:00010000:2.0:1788521287.664301:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef6d7b7200/0x411dd0ee4d2d137c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d1375 expref: 22 pid: 6514 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521287.664308:0:13187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43601f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1875400222415744:0@lo:104: 00000100:00100000:1.0:1788521287.664362:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222416128 00000100:00100000:1.0:1788521287.664367:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222416128 00000100:00100000:1.0:1788521287.664404:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222416256 00000100:00100000:1.0:1788521287.664407:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222416256 00000100:00100000:1.0:1788521287.664419:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788521287.664426:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43601c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+4:13187:x1875400222416128:12345-0@lo:104: 00010000:00010000:1.0:1788521287.664436:0:9522:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7000/0x411dd0ee4d2d1367 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d136e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521287.664480:0:9522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788521287.664495:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43601c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+4:13187:x1875400222416128:12345-0@lo:104: Request processed in 60us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521287.664502:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788521287.664517:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788521287.664523:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43600e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:13187:x1875400222416256:12345-0@lo:104: 00010000:00010000:1.0:1788521287.664547:0:9522:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fee42411800/0x411dd0ee4d2d1359 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d1360 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521287.664589:0:9522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788521287.664595:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43600e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:13187:x1875400222416256:12345-0@lo:104: Request processed in 72us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521287.664601:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1788521287.664617:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788521287.664622:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7000/0x411dd0ee4d2d1367 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d136e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521287.664628:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7000 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:1.0:1788521287.664633:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7000/0x411dd0ee4d2d1367 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d136e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521287.664640:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7000/0x411dd0ee4d2d1367 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d136e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521287.664647:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7000/0x411dd0ee4d2d1367 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d136e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521287.664653:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788521287.664673:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7000/0x411dd0ee4d2d1367 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d136e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521287.664680:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788521287.664692:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7000/0x411dd0ee4d2d1367 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d136e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521287.664699:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7000/0x411dd0ee4d2d1367 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d136e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521287.664717:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521287.664721:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fee42411800/0x411dd0ee4d2d1359 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d1360 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521287.664735:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42411800 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:1.0:1788521287.664738:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fee42411800/0x411dd0ee4d2d1359 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d1360 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521287.664745:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fee42411800/0x411dd0ee4d2d1359 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d1360 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521287.664751:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fee42411800/0x411dd0ee4d2d1359 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d1360 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521287.664756:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788521287.664771:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fee42411800/0x411dd0ee4d2d1359 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d1360 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521287.664776:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788521287.664786:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fee42411800/0x411dd0ee4d2d1359 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d1360 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521287.664792:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fee42411800/0x411dd0ee4d2d1359 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d1360 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521287.664806:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521287.664807:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521287.664809:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521287.664969:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222416512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521287.665001:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521287.665032:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4325a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222416640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521287.665052:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521287.665075:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222416512 00000100:00100000:0.0:1788521287.665078:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222416512 00010000:00010000:0.0:1788521287.665095:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fee434aa800/0x411dd0ee4d2d136e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1367 expref: 22 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521287.665114:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222416640 00000100:00100000:0.0:1788521287.665116:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222416640 00010000:00010000:0.0:1788521287.665128:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fee42411e00/0x411dd0ee4d2d1360 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1359 expref: 23 pid: 6513 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521287.665139:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788521287.665145:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:3644:x1875400222416512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521287.665154:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521287.665159:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fee434aa800/0x411dd0ee4d2d136e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1367 expref: 23 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521287.665168:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fee434aa800/0x411dd0ee4d2d136e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1367 expref: 23 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521287.665182:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521287.665209:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:3644:x1875400222416512:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521287.665215:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788521287.665228:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788521287.665234:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:3645:x1875400222416640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521287.665243:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521287.665254:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fee42411e00/0x411dd0ee4d2d1360 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1359 expref: 22 pid: 6513 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521287.665263:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fee42411e00/0x411dd0ee4d2d1360 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d1359 expref: 22 pid: 6513 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521287.665273:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521287.665300:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:3645:x1875400222416640:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521287.665307:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788521287.665340:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4325a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222416640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521287.665363:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222416512:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521287.665380:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521287.665461:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fee434aa800/0x411dd0ee4d2d136e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d1367 expref: 21 pid: 6512 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521287.665471:0:13187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43602a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1875400222416128:0@lo:104: 00010000:00010000:2.0:1788521287.665481:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fee42411e00/0x411dd0ee4d2d1360 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d1359 expref: 20 pid: 6513 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521287.665489:0:13187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43601880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1875400222416256:0@lo:104: 00010000:00010000:2.0:1788521287.665988:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521287.673677:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521287.673792:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521287.673873:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201358080 00000100:00100000:1.0:1788521287.673941:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201358080 00010000:00010000:1.0:1788521287.673986:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fee434aae00/0x411dd0ee4d2d139f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed529 expref: 13 pid: 6514 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521287.674020:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201358208 00000100:00100000:1.0:1788521287.674023:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201358208 00010000:00010000:1.0:1788521287.674037:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef749cb600/0x411dd0ee4d2d1352 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed4ea expref: 14 pid: 6514 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521287.674053:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 44 00000100:00100000:1.0:1788521287.674062:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76714000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f234d90e-c25e-4162-a7b5-1cc50583b917+14:2396:x1875400201358080:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521287.674078:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521287.674084:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fee434aae00/0x411dd0ee4d2d139f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed529 expref: 14 pid: 6514 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521287.674095:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fee434aae00/0x411dd0ee4d2d139f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed529 expref: 14 pid: 6514 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521287.674115:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521287.674173:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76714000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f234d90e-c25e-4162-a7b5-1cc50583b917+14:2396:x1875400201358080:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 111us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521287.674180:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 44 00000100:00100000:1.0:1788521287.674200:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 45 00000100:00100000:1.0:1788521287.674207:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4e7e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2396:x1875400201358208:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521287.674216:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521287.674221:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef749cb600/0x411dd0ee4d2d1352 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed4ea expref: 13 pid: 6514 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521287.674230:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef749cb600/0x411dd0ee4d2d1352 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed4ea expref: 13 pid: 6514 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521287.674254:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fef6d7b7600/0x411dd0ee4d2d13c2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521287.674262:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef6d7b7600/0x411dd0ee4d2d13c2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521287.674279:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fef6d7b7600/0x411dd0ee4d2d13c2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521287.674288:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fef6d7b7600/0x411dd0ee4d2d13c2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521287.674297:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fef6d7b7600/0x411dd0ee4d2d13c2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521287.674304:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fef6d7b7600/0x411dd0ee4d2d13c2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521287.674311:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7600 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:1.0:1788521287.674316:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fef6d7b7600/0x411dd0ee4d2d13c2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521287.674325:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fef6d7b7600/0x411dd0ee4d2d13c2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521287.674332:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fee434aae00/0x411dd0ee4d2d139f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed529 expref: 13 pid: 6514 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521287.674344:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fef6d7b7600/0x411dd0ee4d2d13c2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521287.674357:0:13187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43600700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1875400222415488:192.168.203.41@tcp:104: 00010000:00010000:1.0:1788521287.674359:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521287.674378:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef749cb600/0x411dd0ee4d2d1352 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed4ea expref: 12 pid: 6514 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521287.674392:0:13187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43602300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1875400222416384:192.168.203.41@tcp:104: 00000100:00100000:1.0:1788521287.674395:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4e7e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f234d90e-c25e-4162-a7b5-1cc50583b917+11:2396:x1875400201358208:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 183us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521287.674416:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 45 00010000:00010000:2.0:1788521287.674447:0:13187:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fef6d7b7600/0x411dd0ee4d2d13c2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521287.674461:0:13187:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fef6d7b7600/0x411dd0ee4d2d13c2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521287.674481:0:13187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fef6d7b7600/0x411dd0ee4d2d13c2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521287.674488:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef6d7b7600/0x411dd0ee4d2d13c2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521287.912617:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521288.911929:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788521288.914861:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788521288.914874:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fef7675d800 from 7 10000000:01000000:2.0:1788521288.914909:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788521288.914990:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7200/0x411dd0ee4d2d13c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521288.915010:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7200/0x411dd0ee4d2d13c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521288.915023:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7200/0x411dd0ee4d2d13c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521288.915059:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43602300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222416768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788521288.915228:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521288.915290:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef7a431300 going to sleep for 11 seconds 00000100:00100000:3.0:1788521288.915960:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222416768 00000100:00100000:3.0:1788521288.915973:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222416768 00000100:00100000:3.0:1788521288.916066:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788521288.916098:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:6517:x1875400222416768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521288.916130:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521288.916152:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef749cb800/0x411dd0ee4d2d13d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d13c9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521288.916184:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef749cb800/0x411dd0ee4d2d13d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d13c9 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521288.916196:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef749cb800/0x411dd0ee4d2d13d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d13c9 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521288.916206:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749cb800, rc 0) 00000100:00100000:3.0:1788521288.916269:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222416768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521288.916276:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1788521288.916476:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43602300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222416768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521288.916497:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7200/0x411dd0ee4d2d13c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d13d0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521288.916509:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7200/0x411dd0ee4d2d13c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d13d0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521288.916608:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222416896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521288.916642:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521288.916666:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef7a2989c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521288.918018:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222416896 00000100:00100000:2.0:1788521288.918035:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222416896 00000100:00100000:2.0:1788521288.918185:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788521288.918198:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222416896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521288.918399:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222416896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 204us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521288.918407:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788521288.919831:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222416896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521288.919946:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222417024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521288.920055:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521288.920105:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef7a2989c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521288.920228:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222417024 00000100:00100000:3.0:1788521288.920237:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222417024 00000100:00100000:3.0:1788521288.920294:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788521288.920306:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222417024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521288.920444:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222417024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521288.920452:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788521288.920755:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222417024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788521288.927846:0:13210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788521288.930512:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788521288.930739:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788521288.930756:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7200/0x411dd0ee4d2d13c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d13d0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521288.930771:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7200/0x411dd0ee4d2d13c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d13d0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521288.930801:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788521288.930804:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fef76680800 from 7 10000000:01000000:3.0:1788521288.930807:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788521288.930859:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749ca400/0x411dd0ee4d2d13d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521288.930867:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef749ca400/0x411dd0ee4d2d13d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521288.930879:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef749ca400/0x411dd0ee4d2d13d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521288.931196:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222417152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788521288.931284:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521288.931379:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee435a1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788521288.931428:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222417152 00000100:00100000:0.0:1788521288.931439:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222417152 00000100:00100000:0.0:1788521288.931530:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788521288.931542:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222417152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521288.931752:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521288.931772:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fee42410a00/0x411dd0ee4d2d13de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d13d7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521288.931806:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fee42410a00/0x411dd0ee4d2d13de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d13d7 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521288.931821:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fee42410a00/0x411dd0ee4d2d13de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d13d7 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521288.931831:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42410a00, rc 0) 00000100:00100000:0.0:1788521288.932101:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:6517:x1875400222417152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 560us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521288.932109:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788521288.933094:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222417152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521288.933195:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef749ca400/0x411dd0ee4d2d13d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d13de expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521288.933211:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef749ca400/0x411dd0ee4d2d13d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d13de expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521288.933317:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4325a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222417280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521288.933376:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521288.933498:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef516b4900 going to sleep for 11 seconds 00000100:00100000:2.0:1788521288.933538:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222417280 00000100:00100000:2.0:1788521288.933546:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222417280 00000100:00100000:2.0:1788521288.933794:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1788521288.933805:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:6517:x1875400222417280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521288.934446:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:6517:x1875400222417280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 641us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521288.934456:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788521288.934528:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4325a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222417280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521288.935415:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4325a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222417408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521288.935515:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521288.935815:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef516b4900 going to sleep for 11 seconds 00000100:00100000:0.0:1788521288.936111:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222417408 00000100:00100000:0.0:1788521288.936129:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222417408 00000100:00100000:2.0:1788521288.936325:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788521288.936336:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:6517:x1875400222417408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521288.936503:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:6517:x1875400222417408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521288.936511:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788521288.938854:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4325a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222417408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788521288.940511:0:13211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788521288.942214:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788521288.942263:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788521288.942278:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749ca400/0x411dd0ee4d2d13d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d13de expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521288.942293:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef749ca400/0x411dd0ee4d2d13d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d13de expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521288.942306:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788521288.942310:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fef81580000 from 7 10000000:01000000:3.0:1788521288.942312:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788521288.942365:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749cae00/0x411dd0ee4d2d13e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521288.942393:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef749cae00/0x411dd0ee4d2d13e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521288.942406:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef749cae00/0x411dd0ee4d2d13e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521288.942439:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222417536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788521288.942528:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521288.942583:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee435a13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521288.942734:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222417536 00000100:00100000:2.0:1788521288.942748:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222417536 00000100:00100000:2.0:1788521288.942817:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788521288.942829:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:6517:x1875400222417536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521288.942847:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521288.942863:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef6d7b7600/0x411dd0ee4d2d13ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d13e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521288.943500:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef6d7b7600/0x411dd0ee4d2d13ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d13e5 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521288.943516:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef6d7b7600/0x411dd0ee4d2d13ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d13e5 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521288.943527:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7600, rc 0) 00000100:00100000:2.0:1788521288.943626:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:6517:x1875400222417536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 798us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521288.943634:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788521288.943828:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222417536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521288.943849:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef749cae00/0x411dd0ee4d2d13e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d13ec expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521288.943861:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef749cae00/0x411dd0ee4d2d13e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d13ec expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521288.945141:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222417664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521288.945223:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521288.945266:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee435a13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521288.948544:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222417664 00000100:00100000:2.0:1788521288.948565:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222417664 00000100:00100000:2.0:1788521288.949451:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788521288.949471:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:6517:x1875400222417664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521288.949711:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:6517:x1875400222417664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (4487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521288.949731:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788521288.949996:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222417664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521288.950074:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4325a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222417792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521288.950259:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521288.950305:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef516b4240 going to sleep for 11 seconds 00000100:00100000:2.0:1788521288.950796:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222417792 00000100:00100000:2.0:1788521288.950805:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222417792 00000100:00100000:2.0:1788521288.950856:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788521288.950864:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:6517:x1875400222417792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521288.951309:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:6517:x1875400222417792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 443us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521288.951318:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1788521288.952003:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4325a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222417792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788521288.955542:0:13212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788521288.956650:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788521288.956695:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788521288.956793:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749cae00/0x411dd0ee4d2d13e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d13ec expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521288.956808:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef749cae00/0x411dd0ee4d2d13e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d13ec expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521288.956848:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788521288.956851:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fef58328000 from 7 10000000:01000000:3.0:1788521288.956854:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788521288.956945:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749ca000/0x411dd0ee4d2d13f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521288.956954:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef749ca000/0x411dd0ee4d2d13f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521288.956977:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef749ca000/0x411dd0ee4d2d13f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521288.957029:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222417920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788521288.957515:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521288.957642:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee435a1240 going to sleep for 11 seconds 00000100:00100000:2.0:1788521288.959773:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222417920 00000100:00100000:2.0:1788521288.959793:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222417920 00000100:00100000:2.0:1788521288.959943:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788521288.959958:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:6517:x1875400222417920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521288.959984:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521288.960010:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef6d7b7000/0x411dd0ee4d2d13fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d13f3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521288.960048:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef6d7b7000/0x411dd0ee4d2d13fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d13f3 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521288.960089:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef6d7b7000/0x411dd0ee4d2d13fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d13f3 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521288.960100:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7000, rc 0) 00000100:00100000:2.0:1788521288.960381:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:6517:x1875400222417920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 426us (2865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521288.960389:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788521288.961579:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222417920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521288.961613:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef749ca000/0x411dd0ee4d2d13f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d13fa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521288.961644:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef749ca000/0x411dd0ee4d2d13f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d13fa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521288.961776:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4325a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222418048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521288.961834:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521288.961870:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef516b4540 going to sleep for 11 seconds 00000100:00100000:2.0:1788521288.962493:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222418048 00000100:00100000:2.0:1788521288.962504:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222418048 00000100:00100000:2.0:1788521288.962564:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788521288.962574:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:6517:x1875400222418048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521288.962762:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:6517:x1875400222418048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 189us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521288.962771:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788521288.963318:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4325a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222418048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521288.963374:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222418176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521288.963436:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521288.963485:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef7a298840 going to sleep for 11 seconds 00000100:00100000:3.0:1788521288.963677:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222418176 00000100:00100000:3.0:1788521288.963683:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222418176 00000100:00100000:3.0:1788521288.963733:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788521288.963742:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:6517:x1875400222418176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521288.963850:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:6517:x1875400222418176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521288.963856:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788521288.964018:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222418176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788521288.966543:0:13213:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788521288.966710:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788521288.966939:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788521288.966955:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749ca000/0x411dd0ee4d2d13f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d13fa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521288.966969:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef749ca000/0x411dd0ee4d2d13f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d13fa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521289.450855:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521289.452217:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201358336 00000100:00100000:0.0:1788521289.452228:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201358336 00000100:00100000:0.0:1788521289.452288:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333 00000100:00100000:0.0:1788521289.452297:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+11:6169:x1875400201358336:12345-192.168.203.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521289.452312:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521289.452338:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fee42410200/0x411dd0ee4d2d1401 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed55a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521289.452366:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fee42410200/0x411dd0ee4d2d1401 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed55a expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521289.452377:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fee42410200/0x411dd0ee4d2d1401 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed55a expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521289.452387:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42410200, rc 0) 00000100:00100000:0.0:1788521289.452455:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+12:6169:x1875400201358336:12345-192.168.203.41@tcp:101:ll_cfg_requeue.0 Request processed in 159us (1609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521289.452463:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333 00000100:00100000:0.0:1788521289.459560:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521289.459598:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201358464 00000100:00100000:0.0:1788521289.459607:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201358464 00000100:00100000:0.0:1788521289.459652:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 334 00000100:00100000:0.0:1788521289.459662:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+12:6169:x1875400201358464:12345-192.168.203.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521289.459809:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+12:6169:x1875400201358464:12345-192.168.203.41@tcp:501:ll_cfg_requeue.0 Request processed in 147us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521289.459816:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 334 00000100:00100000:3.0:1788521289.465800:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521289.465863:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201358592 00000100:00100000:3.0:1788521289.465875:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201358592 00000100:00100000:3.0:1788521289.465971:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 335 00000100:00100000:3.0:1788521289.465985:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+12:6169:x1875400201358592:12345-192.168.203.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521289.466168:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+12:6169:x1875400201358592:12345-192.168.203.41@tcp:503:ll_cfg_requeue.0 Request processed in 186us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521289.466176:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 335 00000100:00100000:0.0:1788521289.473613:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521289.473656:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201358720 00000100:00100000:0.0:1788521289.473666:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201358720 00000100:00100000:0.0:1788521289.473734:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 336 00000100:00100000:0.0:1788521289.473744:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+12:6169:x1875400201358720:12345-192.168.203.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521289.473760:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521289.473779:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fee42410c00/0x411dd0ee4d2d1408 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed561 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521289.473805:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fee42410c00/0x411dd0ee4d2d1408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed561 expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521289.473816:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fee42410c00/0x411dd0ee4d2d1408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed561 expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521289.473825:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42410c00, rc 0) 00000100:00100000:0.0:1788521289.473876:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+13:6169:x1875400201358720:12345-192.168.203.41@tcp:101:ll_cfg_requeue.0 Request processed in 133us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521289.473913:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 336 00000100:00100000:0.0:1788521289.481146:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521289.482793:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201358848 00000100:00100000:1.0:1788521289.482807:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201358848 00000100:00100000:1.0:1788521289.482865:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 337 00000100:00100000:1.0:1788521289.482874:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+13:6169:x1875400201358848:12345-192.168.203.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521289.483043:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+13:6169:x1875400201358848:12345-192.168.203.41@tcp:501:ll_cfg_requeue.0 Request processed in 170us (1907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521289.483051:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 337 00000100:00100000:0.0:1788521289.484832:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521289.484912:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201358976 00000100:00100000:3.0:1788521289.484920:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201358976 00000100:00100000:3.0:1788521289.484971:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 338 00000100:00100000:3.0:1788521289.484980:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+13:6169:x1875400201358976:12345-192.168.203.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521289.485101:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+13:6169:x1875400201358976:12345-192.168.203.41@tcp:503:ll_cfg_requeue.0 Request processed in 122us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521289.485108:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 338 00000100:00100000:0.0:1788521289.829758:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521289.830133:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521289.830152:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521289.830182:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521289.830214:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201359232 00000100:00100000:0.0:1788521289.830224:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201359232 00000100:00100000:0.0:1788521289.830285:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201359488 00000100:00100000:0.0:1788521289.830288:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201359488 00000100:00100000:0.0:1788521289.830301:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201359104 00000100:00100000:0.0:1788521289.830303:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201359104 00000100:00100000:0.0:1788521289.830319:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201359360 00000100:00100000:0.0:1788521289.830322:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201359360 00000100:00100000:0.0:1788521289.830339:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 202 00000100:00100000:0.0:1788521289.830347:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201359232:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521289.830420:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201359232:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 73us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521289.830440:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 202 00000100:00100000:0.0:1788521289.830459:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 203 00000100:00100000:0.0:1788521289.830465:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201359488:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521289.830490:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201359488:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 26us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521289.830496:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 203 00000100:00100000:0.0:1788521289.830507:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 204 00000100:00100000:0.0:1788521289.830561:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+6:2396:x1875400201359104:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521289.830586:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+6:2396:x1875400201359104:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 27us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521289.830877:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 205 00000100:00100000:1.0:1788521289.830916:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2396:x1875400201359360:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521289.830948:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2396:x1875400201359360:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 37us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521289.830955:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 205 00000100:00100000:0.0:1788521289.831375:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 204 00000100:00080000:0.0:1788521289.831400:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788521289.831404:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788521289.869084:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4325a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222418304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521289.869144:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521289.869255:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222418304 00000100:00100000:1.0:1788521289.869262:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222418304 00000100:00100000:1.0:1788521289.869311:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788521289.869318:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222418304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521289.869341:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521289.869379:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222418304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521289.869393:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1788521289.869460:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788521289.869497:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4325a680 x1875400222418304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521289.869515:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4325a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222418304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521289.869921:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4325a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222418432:0@lo:400:kworker.0 00000100:00100000:0.0:1788521289.869958:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521289.869981:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875400222418944:0@lo:400:kworker.0 00000100:00100000:0.0:1788521289.870001:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521289.870017:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222419456:0@lo:400:kworker.0 00000100:00100000:0.0:1788521289.870036:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521289.870055:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788521289.870060:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222418560:0@lo:400:kworker.0 00000100:00100000:0.0:1788521289.870083:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521289.870100:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222419072:0@lo:400:kworker.0 00000100:00100000:0.0:1788521289.870120:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521289.870134:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875400222419584:0@lo:400:kworker.0 00000100:00100000:0.0:1788521289.870153:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521289.870180:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222418432 00000100:00100000:0.0:1788521289.870185:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222418432 00000100:00100000:0.0:1788521289.870215:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222418944 00000100:00100000:0.0:1788521289.870217:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222418944 00000100:00100000:0.0:1788521289.870235:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222419456 00000100:00100000:0.0:1788521289.870237:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222419456 00000100:00100000:0.0:1788521289.870257:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222419072 00000100:00100000:0.0:1788521289.870260:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222419072 00000100:00100000:0.0:1788521289.870271:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222419584 00000100:00100000:0.0:1788521289.870274:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222419584 00000100:00100000:0.0:1788521289.870289:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788521289.870296:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222418432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521289.870337:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222418432:12345-0@lo:400:kworker.0 Request processed in 42us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521289.870343:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788521289.870353:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4325a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222418432:0@lo:400:kworker.0 00000100:00100000:0.0:1788521289.870357:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788521289.870363:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875400222418944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521289.870395:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875400222418944:12345-0@lo:400:kworker.0 Request processed in 32us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521289.870402:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788521289.870412:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788521289.870418:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222419456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521289.870440:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222419456:12345-0@lo:400:kworker.0 Request processed in 23us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521289.870446:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788521289.870455:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788521289.870460:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222419072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521289.870496:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222419072:12345-0@lo:400:kworker.0 Request processed in 36us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521289.870511:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788521289.870524:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788521289.870530:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875400222419584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521289.870558:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875400222419584:12345-0@lo:400:kworker.0 Request processed in 28us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521289.870564:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788521289.870587:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222418560 00000100:00100000:0.0:1788521289.870591:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222418560 00000100:00100000:0.0:1788521289.870615:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788521289.870621:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222418560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521289.870649:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222418560:12345-0@lo:400:kworker.0 Request processed in 29us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521289.870656:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788521289.870677:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222418688:0@lo:400:kworker.0 00000100:00100000:0.0:1788521289.870699:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521289.870727:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222418688 00000100:00100000:0.0:1788521289.870728:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222419200:0@lo:400:kworker.0 00000100:00100000:2.0:1788521289.870730:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222418688 00000100:00100000:0.0:1788521289.870751:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521289.870755:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788521289.870761:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222418688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521289.870767:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222419712:0@lo:400:kworker.0 00000100:00100000:0.0:1788521289.870786:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521289.870790:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222418688:12345-0@lo:400:kworker.0 Request processed in 30us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521289.870796:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788521289.870810:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222418688:0@lo:400:kworker.0 00000100:00100000:2.0:1788521289.870812:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222419200 00000100:00100000:0.0:1788521289.870819:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788521289.870820:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222419200 00000100:00100000:0.0:1788521289.870825:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222418816:0@lo:400:kworker.0 00000100:00100000:2.0:1788521289.870846:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222419712 00000100:00100000:0.0:1788521289.870846:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521289.870848:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222419712 00000100:00100000:0.0:1788521289.870862:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222419328:0@lo:400:kworker.0 00000100:00100000:2.0:1788521289.870868:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788521289.870874:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222419200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521289.870923:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788521289.870941:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef71521880 x1875400222419200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521289.870953:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222419200:0@lo:400:kworker.0 00000100:00080000:0.0:1788521289.870970:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521289.870974:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788521289.870977:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788521289.870978:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521289.870994:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222419200:12345-0@lo:400:kworker.0 Request processed in 54us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521289.871000:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788521289.871009:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222418560:0@lo:400:kworker.0 00000100:00100000:2.0:1788521289.871011:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222419328 00000100:00100000:2.0:1788521289.871014:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222419328 00010000:00080000:0.0:1788521289.871020:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef71521f80 x1875400222419072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521289.871028:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222419072:0@lo:400:kworker.0 00000100:00100000:2.0:1788521289.871035:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00010000:00080000:0.0:1788521289.871039:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef71520380 x1875400222419584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521289.871040:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222419712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521289.871047:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875400222419584:0@lo:400:kworker.0 00000100:00100000:0.0:1788521289.871057:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875400222418944:0@lo:400:kworker.0 00000100:00100000:0.0:1788521289.871066:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222419456:0@lo:400:kworker.0 00000100:00100000:2.0:1788521289.871072:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222419712:12345-0@lo:400:kworker.0 Request processed in 32us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521289.871077:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788521289.871088:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788521289.871094:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222419328:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788521289.871095:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef71520a80 x1875400222419712/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521289.871103:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222419712:0@lo:400:kworker.0 00000100:00100000:2.0:1788521289.871125:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222419328:12345-0@lo:400:kworker.0 Request processed in 31us (201us total) trans 0 rc 0/0 00010000:00080000:0.0:1788521289.871129:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef71522680 x1875400222419328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521289.871131:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788521289.871138:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222419328:0@lo:400:kworker.0 00000100:00100000:2.0:1788521289.871154:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222418816 00000100:00100000:2.0:1788521289.871157:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222418816 00000100:00100000:2.0:1788521289.871175:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788521289.871180:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222418816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521289.871223:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222418816:12345-0@lo:400:kworker.0 Request processed in 42us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521289.871229:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:2.0:1788521289.871255:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521289.871501:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222419840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788521289.871528:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521289.871572:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222418816:0@lo:400:kworker.0 00000100:00100000:1.0:1788521289.871584:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222419840 00000100:00100000:1.0:1788521289.871588:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222419840 00000100:00100000:1.0:1788521289.871615:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788521289.871621:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222419840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788521289.871647:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788521289.871699:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222419840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521289.871706:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788521289.871786:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222419840:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788521289.933925:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521290.385486:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222420096:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788521290.385559:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521290.385621:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788521290.385628:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222419968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788521290.385654:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521290.385684:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222420096 00000100:00100000:2.0:1788521290.385703:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222420096 00000100:00100000:2.0:1788521290.385759:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788521290.385767:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43602a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222420096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788521290.385788:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521290.385828:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43602a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222420096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521290.385835:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788521290.385857:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222419968 00000100:00100000:2.0:1788521290.385861:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222419968 00000100:00100000:2.0:1788521290.385914:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788521290.385922:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222419968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788521290.385948:0:10099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788521290.385980:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43601f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222419968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521290.385985:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788521290.386027:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43600700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222419968:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1788521290.386040:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43601880 x1875400222420096/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521290.386067:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43601880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222420096:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788521290.957123:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788521291.843098:0:13387:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg341-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788521291.981031:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521292.429567:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222420224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521292.429636:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521292.429861:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222420224 00000100:00100000:3.0:1788521292.429870:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222420224 00000100:00100000:3.0:1788521292.429946:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788521292.429961:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222420224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788521292.432400:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788521292.432490:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43255880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222420224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2532us (2849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521292.432499:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:0.0:1788521292.432639:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef76714000 x1875400222420224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521292.432662:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222420224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521292.432683:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521292.432701:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222420352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788521292.432737:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521292.432830:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222420352 00000100:00100000:1.0:1788521292.432839:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222420352 00000100:00080000:2.0:1788521292.432980:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521292.432995:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788521292.433010:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222420352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788521292.433026:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788521292.433071:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222420352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521292.433076:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:1.0:1788521292.433148:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef71521500 x1875400222420352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521292.433161:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222420352:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788521293.005761:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521294.037535:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521294.951041:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521294.951146:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201359616 00000100:00100000:0.0:1788521294.951155:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201359616 00000100:00100000:0.0:1788521294.951218:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 339 00000100:00100000:0.0:1788521294.951229:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2396:x1875400201359616:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521294.951314:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2396:x1875400201359616:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 86us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521294.951322:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 339 00000100:00100000:0.0:1788521294.960069:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521294.960115:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521294.960278:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521294.962996:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521294.965144:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201359744 00000100:00100000:2.0:1788521294.965160:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201359744 00000100:00100000:2.0:1788521294.965236:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201360000 00000100:00100000:2.0:1788521294.965240:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201360000 00000100:00100000:2.0:1788521294.965262:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201359872 00000100:00100000:2.0:1788521294.965266:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201359872 00000100:00100000:2.0:1788521294.965506:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 212 00000100:00100000:2.0:1788521294.965518:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+6:2396:x1875400201359744:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521294.965690:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+6:2396:x1875400201359744:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 87us (5543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521294.965698:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 212 00000100:00100000:2.0:1788521294.965716:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 213 00000100:00100000:2.0:1788521294.965723:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201360000:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521294.965749:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201360000:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 27us (5634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521294.965756:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 213 00000100:00100000:2.0:1788521294.965768:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 214 00000100:00100000:2.0:1788521294.965774:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201359872:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521294.965798:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201359872:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 24us (5521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521294.965818:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 214 00000100:00080000:2.0:1788521294.965849:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788521294.965853:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521294.969655:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201360128 00000100:00100000:2.0:1788521294.969670:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201360128 00000100:00100000:2.0:1788521294.969767:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 215 00000100:00100000:2.0:1788521294.969779:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201360128:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521294.969878:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201360128:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 102us (6890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521294.969909:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 215 00000100:00080000:0.0:1788521294.971230:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788521294.989490:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875400222420608:0@lo:400:kworker.0 00000100:00100000:2.0:1788521294.989574:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521294.989647:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875400222421120:0@lo:400:kworker.0 00000100:00100000:2.0:1788521294.989671:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521294.989707:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef8149ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875400222421632:0@lo:400:kworker.0 00000100:00100000:2.0:1788521294.989728:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521294.989763:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788521294.989770:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222420480:0@lo:400:kworker.0 00000100:00100000:2.0:1788521294.989798:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521294.989821:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222420992:0@lo:400:kworker.0 00000100:00100000:2.0:1788521294.989846:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521294.989861:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef8149aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222421504:0@lo:400:kworker.0 00000100:00100000:2.0:1788521294.989904:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521294.989923:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee437c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222422016:0@lo:400:kworker.0 00000100:00100000:2.0:1788521294.989974:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521294.990006:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875400222420864:0@lo:400:kworker.0 00000100:00100000:2.0:1788521294.990032:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521294.990049:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222421376:0@lo:400:kworker.0 00000100:00100000:2.0:1788521294.990068:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521294.990088:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef8149a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222421888:0@lo:400:kworker.0 00000100:00100000:2.0:1788521294.990109:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521294.990126:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788521294.990193:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222420608 00000100:00100000:3.0:1788521294.990218:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222420608 00000100:00100000:3.0:1788521294.990269:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222421120 00000100:00100000:3.0:1788521294.990273:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222421120 00000100:00100000:2.0:1788521294.990482:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222420736:0@lo:400:kworker.0 00000100:00100000:3.0:1788521294.990525:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222421632 00000100:00100000:3.0:1788521294.990529:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222421632 00000100:00100000:3.0:1788521294.990544:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222420864 00000100:00100000:3.0:1788521294.990547:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222420864 00000100:00100000:3.0:1788521294.990560:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788521294.990568:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875400222420608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521294.990627:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875400222420608:12345-0@lo:400:kworker.0 Request processed in 60us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521294.990634:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788521294.990654:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788521294.990660:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875400222421120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521294.990701:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875400222421120:12345-0@lo:400:kworker.0 Request processed in 42us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521294.990707:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788521294.990718:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788521294.990725:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875400222421632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521294.990764:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875400222421632:12345-0@lo:400:kworker.0 Request processed in 41us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521294.990770:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788521294.990781:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788521294.990787:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef41326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875400222420864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521294.990813:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef41326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875400222420864:12345-0@lo:400:kworker.0 Request processed in 27us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521294.990819:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:3.0:1788521294.990848:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521294.990878:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222421504 00000100:00100000:3.0:1788521294.990907:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222421504 00000100:00100000:3.0:1788521294.990932:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222422016 00000100:00100000:3.0:1788521294.990935:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222422016 00000100:00100000:3.0:1788521294.990945:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222421376 00000100:00100000:3.0:1788521294.990948:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222421376 00000100:00100000:3.0:1788521294.990959:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222421888 00000100:00100000:3.0:1788521294.990961:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222421888 00000100:00100000:3.0:1788521294.990974:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788521294.990980:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4325a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222421504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521294.991011:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4325a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222421504:12345-0@lo:400:kworker.0 Request processed in 32us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521294.991017:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788521294.991028:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788521294.991035:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef41325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222422016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521294.991061:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef41325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222422016:12345-0@lo:400:kworker.0 Request processed in 28us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521294.991067:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788521294.991077:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788521294.991084:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef41324380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222421376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521294.991110:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef41324380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222421376:12345-0@lo:400:kworker.0 Request processed in 27us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521294.991116:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788521294.991126:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788521294.991132:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef41326300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222421888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521294.991173:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef41326300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222421888:12345-0@lo:400:kworker.0 Request processed in 41us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521294.991187:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788521294.991224:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222420480 00000100:00100000:3.0:1788521294.991229:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222420480 00000100:00100000:3.0:1788521294.991256:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788521294.991268:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3644:x1875400222420480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521294.991351:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222420992 00000100:00100000:0.0:1788521294.991356:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222420992 00000100:00100000:0.0:1788521294.991387:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788521294.991394:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222420992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521294.991431:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222420992:12345-0@lo:400:kworker.0 Request processed in 38us (1585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521294.991437:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788521294.991491:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788521294.991501:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222422144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521294.991532:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521294.991610:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222420992:0@lo:400:kworker.0 00010000:00080000:0.0:1788521294.991625:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef8149aa00 x1875400222421504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521294.991635:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef8149aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222421504:0@lo:400:kworker.0 00010000:00080000:0.0:1788521294.991644:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee437c3100 x1875400222422016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521294.991652:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee437c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222422016:0@lo:400:kworker.0 00000100:00100000:0.0:1788521294.991663:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875400222420608:0@lo:400:kworker.0 00000100:00100000:0.0:1788521294.991684:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875400222421120:0@lo:400:kworker.0 00000100:00100000:0.0:1788521294.991696:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef8149ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875400222421632:0@lo:400:kworker.0 00000100:00080000:0.0:1788521294.991747:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521294.991750:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521294.991766:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222422144 00000100:00100000:0.0:1788521294.991770:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222422144 00000100:00100000:3.0:1788521294.991776:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3644:x1875400222420480:12345-0@lo:400:kworker.0 Request processed in 514us (1977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521294.991783:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1788521294.991800:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788521294.991805:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222422144:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521294.991820:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222420480:0@lo:400:kworker.0 00002000:00000024:0.0:1788521294.991826:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521294.991863:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222422144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521294.991869:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:3.0:1788521294.991897:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f071180 x1875400222422144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521310 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521294.991912:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222422144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521294.993420:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee437c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222422272:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788521294.993481:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521294.994459:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521294.997605:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875400222421248:0@lo:400:kworker.0 00000100:00100000:2.0:1788521294.997682:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521294.997707:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef81498380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875400222421760:0@lo:400:kworker.0 00000100:00100000:2.0:1788521294.997730:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521294.997846:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71520a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875400222420864:0@lo:400:kworker.0 00010000:00080000:2.0:1788521294.997862:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef71521880 x1875400222421376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521294.997872:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222421376:0@lo:400:kworker.0 00010000:00080000:2.0:1788521294.997905:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef8149a680 x1875400222421888/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521294.997913:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef8149a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222421888:0@lo:400:kworker.0 00000100:00100000:2.0:1788521294.997949:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222421248 00000100:00100000:2.0:1788521294.997955:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222421248 00000100:00100000:2.0:1788521294.998022:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222421760 00000100:00100000:2.0:1788521294.998026:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222421760 00000100:00100000:2.0:1788521294.998048:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788521294.998057:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef41326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875400222421248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521294.998106:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef41326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875400222421248:12345-0@lo:400:kworker.0 Request processed in 51us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521294.998113:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788521294.998129:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00080000:3.0:1788521294.998480:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788521294.999064:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222422272 00000100:00100000:0.0:1788521294.999073:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222422272 00000100:00100000:0.0:1788521294.999111:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222420736 00000100:00100000:0.0:1788521294.999114:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222420736 00000100:00100000:0.0:1788521294.999129:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788521294.999146:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1875400222422272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788521294.999179:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788521294.999250:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1875400222422272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (5769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521294.999269:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788521294.999287:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788521294.999293:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef41324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222420736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521294.999324:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef41324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222420736:12345-0@lo:400:kworker.0 Request processed in 32us (4868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521294.999331:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788521294.999419:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef41327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875400222421760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521294.999454:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef41327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875400222421760:12345-0@lo:400:kworker.0 Request processed in 39us (1723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521295.001956:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee437c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222422272:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788521295.002115:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222420736:0@lo:400:kworker.0 00010000:00080000:3.0:1788521295.002131:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef71521f80 x1875400222421248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521295.002143:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875400222421248:0@lo:400:kworker.0 00010000:00080000:3.0:1788521295.002155:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef81498380 x1875400222421760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521295.002162:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef81498380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875400222421760:0@lo:400:kworker.0 00000100:00100000:2.0:1788521295.003375:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00010000:00010000:1.0:1788521295.054016:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521295.501315:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef41325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222422400:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788521295.501421:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521295.501582:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222422528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788521295.501625:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521295.501698:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222422528 00000100:00100000:0.0:1788521295.501708:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222422528 00000100:00100000:0.0:1788521295.501774:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788521295.501785:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222422528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788521295.501931:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788521295.501992:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222422528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 207us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521295.502000:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788521295.502063:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222422528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788521295.502109:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222422400 00000100:00100000:0.0:1788521295.502113:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222422400 00000100:00100000:0.0:1788521295.502144:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788521295.502151:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee437c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222422400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788521295.502167:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521295.503909:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee437c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222422400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1721us (2451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521295.504135:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:1.0:1788521295.506426:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef41325f80 x1875400222422400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521295.506464:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef41325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222422400:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788521296.077275:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521297.104283:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521297.550140:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222422656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521297.550255:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521297.550649:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222422656 00000100:00100000:3.0:1788521297.550671:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222422656 00000100:00100000:3.0:1788521297.550749:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788521297.550771:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222422656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788521297.550807:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788521297.550868:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222422656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521297.550876:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1788521297.552241:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788521297.552620:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f071180 x1875400222422656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521297.552652:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f071180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222422656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521297.554374:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788521297.554398:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef81498380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222422784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788521297.554505:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521297.554575:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222422784 00000100:00100000:0.0:1788521297.554584:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222422784 00000100:00100000:0.0:1788521297.554670:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788521297.554693:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef8149a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222422784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788521297.554722:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521297.554771:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef8149a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222422784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521297.554779:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1788521297.554806:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788521297.554837:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef81498380 x1875400222422784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521297.554858:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef81498380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222422784:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788521298.126693:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788521298.337586:0:13536:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 07:28:15 (1788521295) === 00000100:00100000:1.0:1788521298.578387:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521298.579303:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521298.579674:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201360384 00000100:00100000:1.0:1788521298.579703:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201360384 00000100:00100000:1.0:1788521298.579792:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 2 00000100:00100000:1.0:1788521298.579805:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fc75e887-507e-4861-8203-e266d82f5177+6:10520:x1875400201360384:12345-192.168.203.41@tcp:700:mkdir.0 00000100:00080000:3.0:1788521298.580097:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521298.580201:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201360256 00000100:00100000:0.0:1788521298.580208:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201360256 00000100:00100000:0.0:1788521298.580239:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 22 00000100:00100000:0.0:1788521298.580246:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee437c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+7:2395:x1875400201360256:12345-192.168.203.41@tcp:41:mkdir.0 00000004:00000024:0.0:1788521298.580277:0:9815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788521298.580337:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee437c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+7:2395:x1875400201360256:12345-192.168.203.41@tcp:41:mkdir.0 Request processed in 91us (1968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521298.580345:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 22 00000100:00100000:1.0:1788521298.580454:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fc75e887-507e-4861-8203-e266d82f5177+6:10520:x1875400201360384:12345-192.168.203.41@tcp:700:mkdir.0 Request processed in 148us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521298.580466:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 2 00000100:00100000:1.0:1788521298.585849:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521298.586394:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201360640 00000100:00100000:3.0:1788521298.586408:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201360640 00000100:00100000:3.0:1788521298.586600:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 23 00000100:00100000:3.0:1788521298.586614:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee437c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+6:10520:x1875400201360640:12345-192.168.203.41@tcp:36:mkdir.0 00010000:00010000:3.0:1788521298.586707:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521298.591729:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d12b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed4d5 expref: 6 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.591760:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fee42476f00) 00010000:00010000:3.0:1788521298.591806:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788521298.592022:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d140f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.592036:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d140f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.592047:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d140f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.592093:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1416 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.592102:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1416 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.592109:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1416 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.594154:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d141d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.594175:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d141d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.594186:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d141d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788521298.594204:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009901e679 reply state 0000000071b50d81 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d141d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.594217:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d141d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.594225:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8fef51671100) 00010000:00010000:3.0:1788521298.594228:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788521298.594232:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788521298.594239:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788521298.594246:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d140f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.594253:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d140f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.594400:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d140f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.594406:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cb600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521298.594411:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d140f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.594430:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d140f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.594441:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef51671e00) 00010000:00010000:3.0:1788521298.594444:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521298.594448:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d140f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.594455:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d140f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788521298.594675:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009901e679 reply state 0000000071b50d81 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1416 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.594687:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1416 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.594694:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8fef51671800) 00010000:00010000:3.0:1788521298.594696:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788521298.594698:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788521298.594801:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee437c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+7:10520:x1875400201360640:12345-192.168.203.41@tcp:36:mkdir.0 Request processed in 8188us (8964us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788521298.594810:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 23 00000100:00100000:3.0:1788521298.615635:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521298.616646:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201360768 00000100:00100000:2.0:1788521298.616673:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201360768 00000100:00100000:2.0:1788521298.616752:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 24 00000100:00100000:2.0:1788521298.616765:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+7:10521:x1875400201360768:12345-192.168.203.41@tcp:101:chmod.0 00010000:00010000:2.0:1788521298.616792:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521298.616826:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1424 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed568 expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.616941:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d142b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.616970:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d142b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.617009:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d142b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521298.620158:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788521298.620169:0:12956:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788521298.620230:0:12956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d142b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.620273:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1424 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed568 expref: 9 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.620299:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d142b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed568 expref: 8 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.620309:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fee410f5f00) 00010000:00010000:3.0:1788521298.620312:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788521298.620316:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7c00, rc 0) 00000100:00100000:3.0:1788521298.620407:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+8:10521:x1875400201360768:12345-192.168.203.41@tcp:101:chmod.0 Request processed in 3642us (4779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521298.620416:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 24 00000100:00100000:3.0:1788521298.629023:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521298.631055:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201361024 00000100:00100000:0.0:1788521298.631072:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201361024 00000100:00100000:1.0:1788521298.632167:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 25 00000100:00100000:1.0:1788521298.632195:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+8:10521:x1875400201361024:12345-192.168.203.41@tcp:36:chmod.0 00010000:00010000:1.0:1788521298.632282:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521298.632317:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d142b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed568 expref: 8 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.632346:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fee410f5f00) 00010000:00010000:1.0:1788521298.632360:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788521298.632397:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab800/0x411dd0ee4d2d1432 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.632413:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab800/0x411dd0ee4d2d1432 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.632424:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab800/0x411dd0ee4d2d1432 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788521298.632700:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5f0776e reply state 000000009bd40146 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab800/0x411dd0ee4d2d1432 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.632713:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab800/0x411dd0ee4d2d1432 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.632727:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef51db3a00) 00010000:00010000:1.0:1788521298.632730:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788521298.632733:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788521298.632744:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788521298.632870:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+9:10521:x1875400201361024:12345-192.168.203.41@tcp:36:chmod.0 Request processed in 689us (3861us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788521298.632878:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 25 00000100:00100000:1.0:1788521298.704485:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521298.704583:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201361152 00000100:00100000:0.0:1788521298.704657:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201361152 00000100:00100000:0.0:1788521298.704735:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 26 00000100:00100000:0.0:1788521298.704748:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+9:10522:x1875400201361152:12345-192.168.203.41@tcp:101:chown.0 00010000:00010000:0.0:1788521298.704780:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521298.704807:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1439 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed56f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.704942:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1440 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.704959:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1440 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.704973:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1440 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521298.705033:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788521298.705037:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788521298.705702:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1440 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.705738:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1439 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed56f expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.705757:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1440 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed56f expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.705767:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef51db3a00) 00010000:00010000:0.0:1788521298.705771:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788521298.705775:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411e00, rc 0) 00000100:00100000:0.0:1788521298.705854:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+10:10522:x1875400201361152:12345-192.168.203.41@tcp:101:chown.0 Request processed in 1108us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521298.705862:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 26 00000100:00100000:1.0:1788521298.715802:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521298.720772:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201361280 00000100:00100000:2.0:1788521298.720794:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201361280 00000100:00100000:2.0:1788521298.720899:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 27 00000100:00100000:2.0:1788521298.720911:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+10:10522:x1875400201361280:12345-192.168.203.41@tcp:101:chown.0 00010000:00010000:2.0:1788521298.720939:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521298.720969:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1447 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed576 expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.721065:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d144e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.721083:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d144e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.721098:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d144e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.721110:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1455 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.721117:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1455 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.721124:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1455 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.721227:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d145c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.721252:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d145c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.721259:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d145c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521298.721323:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788521298.721328:0:12956:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788521298.721353:0:12956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d145c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.721368:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d144e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.721376:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d144e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.721383:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d144e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.721389:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521298.721393:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d144e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.721402:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d144e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.721416:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef51db3a00) 00010000:00010000:2.0:1788521298.721419:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521298.721426:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d144e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.721443:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d144e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.721458:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1455 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.721464:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1455 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.721471:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1455 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.721477:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6e00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521298.721480:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1455 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.721486:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1455 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.721494:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8fef51671800) 00010000:00010000:2.0:1788521298.721497:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521298.721500:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1455 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.721506:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1455 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.721536:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1447 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed576 expref: 12 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.721549:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d145c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed576 expref: 11 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.721563:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8fef51671100) 00010000:00010000:2.0:1788521298.721565:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788521298.721568:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7c00, rc 0) 00000100:00100000:2.0:1788521298.721679:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+11:10522:x1875400201361280:12345-192.168.203.41@tcp:101:chown.0 Request processed in 769us (5885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521298.721687:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 27 00000100:00100000:2.0:1788521298.729777:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521298.731155:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201361408 00000100:00100000:1.0:1788521298.731172:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201361408 00000100:00100000:0.0:1788521298.731447:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 6 00000100:00100000:0.0:1788521298.731462:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef41327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fc75e887-507e-4861-8203-e266d82f5177+11:10522:x1875400201361408:12345-192.168.203.41@tcp:900:chown.0 00000100:00100000:0.0:1788521298.731736:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef41327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fc75e887-507e-4861-8203-e266d82f5177+11:10522:x1875400201361408:12345-192.168.203.41@tcp:900:chown.0 Request processed in 276us (1972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521298.731746:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 6 00000100:00100000:2.0:1788521298.735368:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521298.735452:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201361664 00000100:00100000:0.0:1788521298.735469:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201361664 00000100:00100000:0.0:1788521298.735573:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 28 00000100:00100000:0.0:1788521298.735586:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef41326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+11:10522:x1875400201361664:12345-192.168.203.41@tcp:36:chown.0 00010000:00010000:0.0:1788521298.735694:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521298.735732:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d145c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed576 expref: 11 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.735758:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8fef51671100) 00010000:00010000:0.0:1788521298.735765:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521298.735796:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1463 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.735813:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1463 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.735827:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1463 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521298.738390:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:1.0:1788521298.738528:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1416 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.738541:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1416 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.738549:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1416 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.738555:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cb200 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521298.738560:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1416 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.738577:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1416 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.738596:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8fef51671800) 00010000:00010000:1.0:1788521298.738600:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521298.738616:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1416 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.738623:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1416 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.738644:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d141d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.738659:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d141d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.738664:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d141d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.738669:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cb400 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521298.738672:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d141d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.738678:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d141d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.738687:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8fef51671100) 00010000:00010000:1.0:1788521298.738689:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521298.738692:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d141d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.738697:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d141d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.738908:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab800/0x411dd0ee4d2d1432 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.738914:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab800/0x411dd0ee4d2d1432 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.738927:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab800/0x411dd0ee4d2d1432 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.738931:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434ab800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521298.738934:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab800/0x411dd0ee4d2d1432 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.738940:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab800/0x411dd0ee4d2d1432 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.738948:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef51db3a00) 00010000:00010000:1.0:1788521298.738950:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788521298.738953:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab800/0x411dd0ee4d2d1432 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.738958:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab800/0x411dd0ee4d2d1432 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788521298.739352:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031c12f63 reply state 0000000098d3be72 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1463 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.739380:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1463 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.739390:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8fef51671100) 00010000:00010000:0.0:1788521298.739408:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788521298.739414:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788521298.739431:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:0.0:1788521298.739559:0:6521:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00010000:00010000:1.0:1788521298.739696:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1463 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521298.739731:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef41326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+7:10522:x1875400201361664:12345-192.168.203.41@tcp:36:chown.0 Request processed in 4009us (4234us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788521298.739743:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 28 00010000:00010000:1.0:1788521298.739829:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1463 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.739835:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1463 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.739840:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42411800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521298.739844:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1463 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.739861:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1463 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.739873:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8fef51671100) 00010000:00010000:1.0:1788521298.739876:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788521298.739880:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1463 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.739910:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1463 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521298.754639:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521298.754827:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201361792 00000100:00100000:3.0:1788521298.754837:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201361792 00000100:00100000:3.0:1788521298.754915:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 29 00000100:00100000:3.0:1788521298.754925:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+6:10523:x1875400201361792:12345-192.168.203.41@tcp:101:touch.500 00010000:00010000:3.0:1788521298.754948:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521298.754966:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbe00/0x411dd0ee4d2d146a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed57d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788521298.755963:0:6520:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 946us 00010000:00010000:3.0:1788521298.785114:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1471 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.785141:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1471 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.785154:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1471 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.785168:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1478 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.785175:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1478 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.785181:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1478 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.785293:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d147f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.785301:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d147f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.785307:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d147f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521298.785333:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788521298.785337:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788521298.785371:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d147f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.785383:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1471 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.785398:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1471 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.785405:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1471 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.785411:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cb600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521298.785415:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1471 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.785422:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1471 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.785433:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef51db3a00) 00010000:00010000:3.0:1788521298.785446:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521298.785450:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1471 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.785456:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1471 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.785468:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1478 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.785473:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1478 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.785479:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1478 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.785483:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cbc00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521298.785492:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1478 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.785498:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1478 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.785506:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8fef51671e00) 00010000:00010000:3.0:1788521298.785509:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521298.785511:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1478 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.785517:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1478 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.785556:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbe00/0x411dd0ee4d2d146a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed57d expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.785569:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d147f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed57d expref: 7 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.785575:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8fef51671600) 00010000:00010000:3.0:1788521298.785577:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788521298.785579:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749ca200, rc 0) 00000100:00100000:3.0:1788521298.785645:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+7:10523:x1875400201361792:12345-192.168.203.41@tcp:101:touch.500 Request processed in 30722us (31016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521298.785665:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 29 00000100:00100000:0.0:1788521298.794754:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521298.794835:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201362048 00000100:00100000:1.0:1788521298.794845:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201362048 00000100:00100000:1.0:1788521298.795080:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 30 00000100:00100000:1.0:1788521298.795091:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef81498380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+7:10523:x1875400201362048:12345-192.168.203.41@tcp:101:touch.500 00010000:00010000:1.0:1788521298.795113:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521298.795132:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab800/0x411dd0ee4d2d1486 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed584 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.795238:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d148d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.795253:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d148d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.795266:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d148d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.795322:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aae00/0x411dd0ee4d2d1494 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xda267534 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.795344:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aae00/0x411dd0ee4d2d1494 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.795351:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aae00/0x411dd0ee4d2d1494 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788521298.795785:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788521298.795991:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa400/0x411dd0ee4d2d149b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.796000:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa400/0x411dd0ee4d2d149b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.796009:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa400/0x411dd0ee4d2d149b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.796042:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d148d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.796050:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d148d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.796056:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d148d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.796062:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521298.796071:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d148d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.796080:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d148d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.796102:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8fef51671600) 00010000:00010000:1.0:1788521298.796105:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521298.796111:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d148d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.796117:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d148d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788521298.796130:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000084551407 reply state 00000000f3bff4e7 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aae00/0x411dd0ee4d2d1494 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.796140:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aae00/0x411dd0ee4d2d1494 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.796147:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xda267534 (ffff8fef51db3e00) 00010000:00010000:1.0:1788521298.796148:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788521298.796151:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788521298.796180:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab800/0x411dd0ee4d2d1486 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed584 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.796192:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa400/0x411dd0ee4d2d149b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed584 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.796199:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:1.0:1788521298.796201:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521298.796203:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434aa400, rc 0) 00000100:00100000:1.0:1788521298.796269:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef81498380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+10:10523:x1875400201362048:12345-192.168.203.41@tcp:101:touch.500 Request processed in 1180us (1526us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788521298.796276:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 30 00000100:00100000:3.0:1788521298.808717:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521298.808877:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201362304 00000100:00100000:0.0:1788521298.808921:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201362304 00000100:00100000:0.0:1788521298.808972:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 31 00000100:00100000:0.0:1788521298.808981:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+10:10523:x1875400201362304:12345-192.168.203.41@tcp:36:touch.500 00010000:00010000:0.0:1788521298.809038:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521298.809064:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa400/0x411dd0ee4d2d149b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed584 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.809084:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:0.0:1788521298.809096:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521298.809172:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d14a9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.809186:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d14a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.809196:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d14a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788521298.809296:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000051901d0 reply state 00000000c83e64be transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d14a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.809315:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d14a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.809321:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8fee42474a00) 00010000:00010000:0.0:1788521298.809323:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788521298.809326:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788521298.809473:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+11:10523:x1875400201362304:12345-192.168.203.41@tcp:36:touch.500 Request processed in 492us (766us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788521298.809480:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 31 00000100:00100000:3.0:1788521298.821209:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521298.821639:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201362432 00000100:00100000:0.0:1788521298.821659:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201362432 00000100:00100000:0.0:1788521298.821719:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 32 00000100:00100000:0.0:1788521298.821729:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+11:10523:x1875400201362432:12345-192.168.203.41@tcp:101:touch.500 00010000:00010000:0.0:1788521298.821754:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521298.821774:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410800/0x411dd0ee4d2d14b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed58b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.821828:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410800/0x411dd0ee4d2d14b0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed58b expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.821844:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410800/0x411dd0ee4d2d14b0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed58b expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.821865:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8fee42474a00) 00010000:00010000:0.0:1788521298.821868:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788521298.821872:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42410800, rc 0) 00000100:00100000:0.0:1788521298.821959:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+12:10523:x1875400201362432:12345-192.168.203.41@tcp:101:touch.500 Request processed in 232us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521298.821980:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 32 00000100:00100000:2.0:1788521298.828089:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521298.828307:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201362560 00000100:00100000:3.0:1788521298.828318:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201362560 00000100:00100000:3.0:1788521298.828378:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 24 00000100:00100000:3.0:1788521298.828387:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef41325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1875400201362560:12345-192.168.203.41@tcp:8:touch.500 00010000:00080000:3.0:1788521298.828433:0:8437:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from fc75e887-507e-4861-8203-e266d82f5177@192.168.203.41@tcp t0 exp 0000000000000000 cur 348 last 0 00000020:00000080:3.0:1788521298.828464:0:8437:0:(genops.c:1385:class_connect()) connect: client fc75e887-507e-4861-8203-e266d82f5177, cookie 0x411dd0ee4d2d14b7 00002000:00100000:3.0:1788521298.828476:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fc75e887-507e-4861-8203-e266d82f5177/ffff8fef7f065800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788521298.828493:0:8437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788521298.828570:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788521298.828778:0:8437:0:(import.c:65:import_set_state_nolock()) ffff8fef7f061800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788521298.828850:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef41325c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc75e887-507e-4861-8203-e266d82f5177+6:2392:x1875400201362560:12345-192.168.203.41@tcp:8:touch.500 Request processed in 461us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521298.828857:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 24 00000100:00100000:3.0:1788521298.832330:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521298.832495:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201362688 00000100:00100000:0.0:1788521298.832506:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201362688 00000100:00100000:0.0:1788521298.832603:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 25 00000100:00100000:0.0:1788521298.832614:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+6:0:x1875400201362688:12345-192.168.203.41@tcp:2:touch.500 00000100:00080000:3.0:1788521298.832849:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788521298.853609:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:1.0:1788521298.853624:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fc75e887-507e-4861-8203-e266d82f5177 00000100:00100000:0.0:1788521298.853839:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+5:0:x1875400201362688:12345-192.168.203.41@tcp:2:touch.500 Request processed in 21223us (21514us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788521298.853850:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 25 00000100:00100000:1.0:1788521298.857934:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521298.858024:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201362944 00000100:00100000:2.0:1788521298.858034:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201362944 00000100:00100000:2.0:1788521298.858088:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 2 00000100:00100000:2.0:1788521298.858098:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+12:10523:x1875400201362944:12345-192.168.203.41@tcp:35:touch.500 00000100:00100000:2.0:1788521298.858360:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+13:10523:x1875400201362944:12345-192.168.203.41@tcp:35:touch.500 Request processed in 264us (438us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788521298.858368:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 2 00000100:00100000:2.0:1788521298.890515:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521298.891176:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201363072 00000100:00100000:1.0:1788521298.891189:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201363072 00000100:00100000:1.0:1788521298.891254:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 33 00000100:00100000:1.0:1788521298.891264:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef41325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+13:10524:x1875400201363072:12345-192.168.203.41@tcp:101:rm.0 00010000:00010000:1.0:1788521298.891288:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521298.891308:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d14be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed592 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.891376:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d14c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.891391:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d14c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.891402:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d14c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521298.891466:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788521298.891470:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788521298.891529:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d14c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.891559:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d14be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed592 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.891579:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d14c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed592 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.891600:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8fef51671600) 00010000:00010000:1.0:1788521298.891603:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788521298.891607:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434aac00, rc 0) 00000100:00100000:1.0:1788521298.891683:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef41325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+14:10524:x1875400201363072:12345-192.168.203.41@tcp:101:rm.0 Request processed in 420us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521298.891690:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 33 00000100:00100000:0.0:1788521298.897332:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521298.897424:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201363328 00000100:00100000:2.0:1788521298.897620:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201363328 00000100:00100000:2.0:1788521298.897872:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 34 00000100:00100000:2.0:1788521298.897921:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef81498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+14:10524:x1875400201363328:12345-192.168.203.41@tcp:101:rm.0 00010000:00010000:2.0:1788521298.897944:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521298.897968:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d14cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed599 expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521298.898087:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788521298.898221:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d14cc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed599 expref: 16 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.898236:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef51db3a00) 00010000:00010000:2.0:1788521298.898239:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521298.898244:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d14cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed599 expref: 16 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.898258:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7800, rc 0) 00000100:00100000:2.0:1788521298.898329:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef81498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+15:10524:x1875400201363328:12345-192.168.203.41@tcp:101:rm.0 Request processed in 448us (1007us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1788521298.898337:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 34 00000100:00100000:3.0:1788521298.906071:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521298.906178:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201363456 00000100:00100000:2.0:1788521298.906188:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201363456 00000100:00100000:2.0:1788521298.906248:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 3 00000100:00100000:2.0:1788521298.906258:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+15:10524:x1875400201363456:12345-192.168.203.41@tcp:37:rm.0 00000100:00100000:2.0:1788521298.918085:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+15:10524:x1875400201363456:12345-192.168.203.41@tcp:37:rm.0 Request processed in 11815us (12013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521298.918100:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 3 00000100:00100000:0.0:1788521298.922776:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521298.922958:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201363712 00000100:00100000:3.0:1788521298.922969:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201363712 00000100:00100000:3.0:1788521298.923040:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 4 00000100:00100000:3.0:1788521298.923051:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6d4aa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+15:10524:x1875400201363712:12345-192.168.203.41@tcp:35:rm.0 00000100:00100000:3.0:1788521298.923278:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6d4aa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+16:10524:x1875400201363712:12345-192.168.203.41@tcp:35:rm.0 Request processed in 229us (513us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788521298.923287:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 4 00000100:00100000:3.0:1788521298.932981:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521298.934855:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201363968 00000100:00100000:2.0:1788521298.934871:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201363968 00000100:00100000:2.0:1788521298.934984:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 35 00000100:00100000:2.0:1788521298.934995:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+16:10524:x1875400201363968:12345-192.168.203.41@tcp:101:rm.0 00010000:00010000:2.0:1788521298.935020:0:9815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521298.935055:0:9815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d14da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed5a0 expref: -99 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.935161:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d14e1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.935175:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d14e1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.935189:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d14e1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521298.935199:0:9815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788521298.935332:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d14da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5a0 expref: 19 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.935351:0:9815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d14e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5a0 expref: 18 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.935359:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8fef51671600) 00010000:00010000:2.0:1788521298.935362:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788521298.935366:0:9815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b6e00, rc 0) 00000100:00100000:2.0:1788521298.935450:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+18:10524:x1875400201363968:12345-192.168.203.41@tcp:101:rm.0 Request processed in 456us (2478us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788521298.935739:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 35 00000100:00100000:0.0:1788521298.940153:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521298.940238:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201364096 00000100:00100000:3.0:1788521298.940248:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201364096 00000100:00100000:3.0:1788521298.940313:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 36 00000100:00100000:3.0:1788521298.940324:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef81499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+18:10524:x1875400201364096:12345-192.168.203.41@tcp:41:rm.0 00000004:00000024:3.0:1788521298.940400:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1788521298.940726:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef81499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+18:10524:x1875400201364096:12345-192.168.203.41@tcp:41:rm.0 Request processed in 403us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521298.940735:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 36 00000100:00100000:0.0:1788521298.962048:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521298.962119:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201364224 00000100:00100000:3.0:1788521298.962129:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201364224 00000100:00100000:3.0:1788521298.962190:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 37 00000100:00100000:3.0:1788521298.962202:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef8149ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+18:10524:x1875400201364224:12345-192.168.203.41@tcp:101:rm.0 00010000:00010000:3.0:1788521298.962221:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521298.962241:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d14ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed5a7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.962306:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbe00/0x411dd0ee4d2d14f6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.962322:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbe00/0x411dd0ee4d2d14f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.962335:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbe00/0x411dd0ee4d2d14f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.962346:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d14fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xda267534 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.962353:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d14fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.962359:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d14fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.962472:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1504 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.962481:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1504 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.962488:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1504 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521298.962526:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788521298.962531:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788521298.962548:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1504 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.962560:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1504 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.962568:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbe00/0x411dd0ee4d2d14f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.962575:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbe00/0x411dd0ee4d2d14f6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.962766:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbe00/0x411dd0ee4d2d14f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.962775:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cbe00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521298.962779:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbe00/0x411dd0ee4d2d14f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.962787:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbe00/0x411dd0ee4d2d14f6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.962806:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8fef51671600) 00010000:00010000:3.0:1788521298.962809:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521298.962813:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbe00/0x411dd0ee4d2d14f6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.962820:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbe00/0x411dd0ee4d2d14f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.962833:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d14fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.962839:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d14fd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.962845:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d14fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.962850:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cbc00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521298.962853:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d14fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.962858:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d14fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.962866:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xda267534 (ffff8fef51db3e00) 00010000:00010000:3.0:1788521298.962868:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521298.962871:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d14fd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.962877:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d14fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.962954:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d14ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5a7 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.962968:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1504 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5a7 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.962975:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8fee42474a00) 00010000:00010000:3.0:1788521298.962977:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521298.962982:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749cb600, rc 0) 00000100:00100000:3.0:1788521298.963033:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef8149ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+19:10524:x1875400201364224:12345-192.168.203.41@tcp:101:rm.0 Request processed in 834us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521298.963041:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 37 00000100:00100000:1.0:1788521298.967241:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521298.967340:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201364480 00000100:00100000:2.0:1788521298.967350:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201364480 00000100:00100000:2.0:1788521298.967446:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 38 00000100:00100000:2.0:1788521298.967458:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+19:10524:x1875400201364480:12345-192.168.203.41@tcp:36:rm.0 00010000:00010000:2.0:1788521298.967526:0:9815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788521298.967552:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1504 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5a7 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.967574:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410800/0x411dd0ee4d2d14b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed58b expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.967595:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8fee42474a00) 00010000:00010000:2.0:1788521298.967607:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d14c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed592 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.967617:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8fef51671600) 00010000:00010000:2.0:1788521298.967620:0:9815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521298.967641:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d150b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.967663:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d150b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.967672:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d150b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.967682:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1512 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xda267534 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.967697:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1512 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.967704:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1512 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.967802:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d1519 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.967811:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d1519 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.967817:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d1519 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788521298.968106:0:9815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788521298.968118:0:9815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 349034233430ns, next at 350034230512ns, rc = 0 00010000:00010000:2.0:1788521298.968160:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1520 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.968168:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1520 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.968176:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1520 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.968182:0:9815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1520 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.968188:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1520 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.968194:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1520 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.968212:0:9815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521298.968228:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d1519 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.968240:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d1519 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.968247:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d1519 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.968252:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7c00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521298.968257:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d1519 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.968264:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d1519 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.968274:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8fee42474a00) 00010000:00010000:2.0:1788521298.968277:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788521298.968280:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d1519 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.968286:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d1519 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.968302:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d150b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.968315:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d150b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.968320:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d150b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.968325:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521298.968334:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d150b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.968340:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d150b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.968349:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8fef51671600) 00010000:00010000:2.0:1788521298.968351:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521298.968354:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d150b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.968360:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d150b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788521298.968370:0:9815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b09683a8 reply state 0000000071b5ce1f transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1512 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.968380:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1512 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.968386:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xda267534 (ffff8fef51db3e00) 00010000:00010000:2.0:1788521298.968389:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788521298.968392:0:9815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788521298.968471:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+18:10524:x1875400201364480:12345-192.168.203.41@tcp:36:rm.0 Request processed in 1015us (1239us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788521298.968479:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 38 00010000:00010000:0.0:1788521298.973568:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521298.973591:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1520 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.973604:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6800 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:0.0:1788521298.973609:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1520 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.973619:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1520 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.973638:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8fee42474a00) 00010000:00010000:0.0:1788521298.973642:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788521298.973656:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1520 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.973684:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1520 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.973700:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521298.973702:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521298.973703:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521298.979455:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521298.979948:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201364736 00000100:00100000:3.0:1788521298.979959:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201364736 00000100:00100000:3.0:1788521298.980032:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 5 00000100:00100000:3.0:1788521298.980042:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef8149aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+18:10524:x1875400201364736:12345-192.168.203.41@tcp:35:rm.0 00000100:00100000:3.0:1788521298.980278:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef8149aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+19:10524:x1875400201364736:12345-192.168.203.41@tcp:35:rm.0 Request processed in 237us (833us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788521298.980287:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 5 00000100:00100000:1.0:1788521298.987827:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521298.988151:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201364992 00000100:00100000:2.0:1788521298.988161:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201364992 00000100:00100000:2.0:1788521298.988252:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 39 00000100:00100000:2.0:1788521298.988263:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+19:10524:x1875400201364992:12345-192.168.203.41@tcp:36:rm.0 00010000:00010000:2.0:1788521298.988324:0:12956:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788521298.988366:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d14e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5a0 expref: 19 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.988385:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d147f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed57d expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.988396:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8fef51671600) 00010000:00010000:2.0:1788521298.988425:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1440 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed56f expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.988435:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef51db3a00) 00010000:00010000:2.0:1788521298.988442:0:12956:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521298.988479:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d1527 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.988492:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d1527 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.988502:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d1527 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.988514:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030200/0x411dd0ee4d2d152e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.988521:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030200/0x411dd0ee4d2d152e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.988528:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030200/0x411dd0ee4d2d152e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.988607:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031a00/0x411dd0ee4d2d1535 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.988620:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031a00/0x411dd0ee4d2d1535 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.988626:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031a00/0x411dd0ee4d2d1535 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521298.988868:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788521298.988902:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031a00/0x411dd0ee4d2d1535 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.988909:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031a00/0x411dd0ee4d2d1535 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.988915:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031a00/0x411dd0ee4d2d1535 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.988921:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40031a00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521298.988925:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031a00/0x411dd0ee4d2d1535 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.988933:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031a00/0x411dd0ee4d2d1535 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.988943:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8fef71591f00) 00010000:00010000:2.0:1788521298.988946:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788521298.988949:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031a00/0x411dd0ee4d2d1535 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.988955:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031a00/0x411dd0ee4d2d1535 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.988973:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d1527 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.988985:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d1527 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.988989:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d1527 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.988994:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40030800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521298.988997:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d1527 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.989002:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d1527 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.989009:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef71591700) 00010000:00010000:2.0:1788521298.989011:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521298.989014:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d1527 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.989019:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d1527 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788521298.989030:0:12956:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006351e7dc reply state 000000009ef02a91 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030200/0x411dd0ee4d2d152e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.989039:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030200/0x411dd0ee4d2d152e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.989045:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8fef71591200) 00010000:00010000:2.0:1788521298.989047:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788521298.989049:0:12956:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788521298.989910:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+18:10524:x1875400201364992:12345-192.168.203.41@tcp:36:rm.0 Request processed in 1624us (2069us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788521298.989928:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 39 00010000:00010000:2.0:1788521299.149595:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521300.070982:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521300.071031:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521300.071055:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521300.071107:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201365504 00000100:00100000:3.0:1788521300.071119:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201365504 00000100:00100000:3.0:1788521300.071191:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 92 00000100:00100000:3.0:1788521300.071207:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef41327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+5:2396:x1875400201365504:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521300.074575:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201365248 00000100:00100000:0.0:1788521300.074601:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201365248 00000100:00100000:0.0:1788521300.074723:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201365760 00000100:00100000:0.0:1788521300.074727:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201365760 00000100:00100000:0.0:1788521300.074899:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 222 00000100:00100000:0.0:1788521300.074926:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef41324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+18:2396:x1875400201365248:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521300.076449:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 223 00000100:00100000:3.0:1788521300.076477:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef41324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2396:x1875400201365760:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521300.076572:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef41324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2396:x1875400201365760:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 111us (5514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521300.076581:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 223 00000100:00080000:3.0:1788521300.076627:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788521300.076634:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788521300.076650:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788521300.076821:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef41327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+5:2396:x1875400201365504:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 5621us (5789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521300.076832:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 92 00000100:00100000:0.0:1788521300.080373:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef41324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+18:2396:x1875400201365248:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 5436us (9387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521300.080391:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 222 00000100:00100000:2.0:1788521300.080555:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521300.080631:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201365120 00000100:00100000:3.0:1788521300.080653:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201365120 00000100:00100000:3.0:1788521300.080732:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 341 00000100:00100000:3.0:1788521300.080745:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2396:x1875400201365120:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521300.086834:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2396:x1875400201365120:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 6073us (6262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521300.086855:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 341 00000100:00100000:0.0:1788521300.088275:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521300.088314:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521300.088607:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201365376 00000100:00100000:1.0:1788521300.088618:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201365376 00000100:00100000:1.0:1788521300.088704:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201365632 00000100:00100000:1.0:1788521300.088707:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201365632 00000100:00100000:1.0:1788521300.088729:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 224 00000100:00100000:1.0:1788521300.088739:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2396:x1875400201365376:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521300.088824:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2396:x1875400201365376:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 86us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521300.088832:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 224 00000100:00100000:1.0:1788521300.088852:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 225 00000100:00100000:1.0:1788521300.088858:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2396:x1875400201365632:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521300.088909:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2396:x1875400201365632:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 25us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521300.088916:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 225 00000100:00080000:0.0:1788521300.089147:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788521300.089152:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788521300.110022:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222422912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788521300.110109:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788521300.110357:0:9967:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 350176471766ns, next at 351176468725ns, rc = 0 00000100:00100000:2.0:1788521300.110382:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788521300.110391:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef41324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222423040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521300.110434:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521300.110471:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222423040 00000100:00100000:2.0:1788521300.110478:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222423040 00000100:00100000:2.0:1788521300.110540:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788521300.110549:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef41325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222423040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788521300.110584:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521300.110625:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef41325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222423040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521300.110632:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:2.0:1788521300.110671:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788521300.110703:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef41324a80 x1875400222423040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521300.110723:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef41324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222423040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521300.111763:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222422912 00000100:00100000:2.0:1788521300.111774:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222422912 00000100:00100000:2.0:1788521300.111825:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788521300.111834:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222422912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788521300.111903:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788521300.112500:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222422912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 664us (2388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521300.112508:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788521300.112600:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222422912:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788521300.118609:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef41324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222423168:0@lo:400:kworker.0 00000100:00100000:2.0:1788521300.118714:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521300.118782:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222423168 00000100:00100000:2.0:1788521300.118791:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222423168 00000100:00100000:2.0:1788521300.118841:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788521300.118850:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3644:x1875400222423168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521300.118917:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3644:x1875400222423168:12345-0@lo:400:kworker.0 Request processed in 68us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521300.118925:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788521300.121165:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef41324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222423168:0@lo:400:kworker.0 00000100:00100000:2.0:1788521300.121259:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef41324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222423296:0@lo:400:kworker.0 00000100:00100000:2.0:1788521300.121325:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521300.121372:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222423296 00000100:00100000:2.0:1788521300.121379:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222423296 00000100:00100000:2.0:1788521300.121446:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788521300.121455:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef41327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222423296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521300.121505:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef41327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222423296:12345-0@lo:400:kworker.0 Request processed in 51us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521300.121512:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788521300.121544:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef41324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222423296:0@lo:400:kworker.0 00000100:00100000:2.0:1788521300.121573:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef41324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875400222423424:0@lo:400:kworker.0 00000100:00100000:2.0:1788521300.121609:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521300.121665:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef41324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222423552:0@lo:400:kworker.0 00000100:00100000:2.0:1788521300.121695:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521300.121735:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef41325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875400222423680:0@lo:400:kworker.0 00000100:00100000:2.0:1788521300.121757:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521300.121794:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4321ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875400222423808:0@lo:400:kworker.0 00000100:00100000:2.0:1788521300.121815:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521300.121837:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222423424 00000100:00100000:2.0:1788521300.121840:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222423424 00000100:00100000:2.0:1788521300.121860:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222423680 00000100:00100000:2.0:1788521300.121862:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222423680 00000100:00100000:2.0:1788521300.121903:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222423808 00000100:00100000:2.0:1788521300.121906:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222423808 00000100:00100000:2.0:1788521300.121922:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788521300.121928:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef41325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875400222423424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521300.122065:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef41325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875400222423424:12345-0@lo:400:kworker.0 Request processed in 136us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521300.122073:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788521300.122088:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788521300.122094:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef41325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875400222423680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521300.122125:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef41325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875400222423680:12345-0@lo:400:kworker.0 Request processed in 32us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521300.122131:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788521300.122140:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788521300.122146:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875400222423808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521300.122169:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875400222423808:12345-0@lo:400:kworker.0 Request processed in 24us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521300.122182:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00080000:2.0:1788521300.122199:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788521300.122204:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788521300.122224:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4321ea00 x1875400222423808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521300.122236:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4321ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875400222423808:0@lo:400:kworker.0 00000100:00100000:2.0:1788521300.122255:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef41324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875400222423424:0@lo:400:kworker.0 00000100:00100000:2.0:1788521300.122270:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef41325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875400222423680:0@lo:400:kworker.0 00000100:00100000:2.0:1788521300.122297:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4321ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222423936:0@lo:400:kworker.0 00000100:00100000:2.0:1788521300.122322:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521300.122348:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222423936 00000100:00100000:2.0:1788521300.122351:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222423936 00000100:00100000:2.0:1788521300.122379:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788521300.122385:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222423936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521300.123239:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222423936:12345-0@lo:400:kworker.0 Request processed in 847us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521300.123249:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1788521300.123273:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788521300.123314:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4321ea00 x1875400222423936/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521300.123328:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4321ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222423936:0@lo:400:kworker.0 00000100:00100000:2.0:1788521300.123375:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4321ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222424064:0@lo:400:kworker.0 00000100:00100000:0.0:1788521300.123688:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222423552 00000100:00100000:0.0:1788521300.123696:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222423552 00000100:00100000:0.0:1788521300.123739:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788521300.123746:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef41326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222423552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521300.123793:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef41326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222423552:12345-0@lo:400:kworker.0 Request processed in 48us (2097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521300.123800:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788521300.124180:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521300.124238:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef41324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222423552:0@lo:400:kworker.0 00000100:00100000:2.0:1788521300.124295:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef41324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875400222424192:0@lo:400:kworker.0 00000100:00100000:2.0:1788521300.124324:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521300.124354:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222424192 00000100:00100000:2.0:1788521300.124358:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222424192 00000100:00100000:2.0:1788521300.124395:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788521300.125035:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef41325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875400222424192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521300.125095:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef41325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875400222424192:12345-0@lo:400:kworker.0 Request processed in 694us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521300.125104:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00080000:2.0:1788521300.125131:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521300.125158:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef41324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875400222424192:0@lo:400:kworker.0 00000100:00100000:2.0:1788521300.125201:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef41324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222424320:0@lo:400:kworker.0 00000100:00100000:2.0:1788521300.125228:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521300.125278:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222424448:0@lo:400:kworker.0 00000100:00100000:2.0:1788521300.125303:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521300.125417:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222424320 00000100:00100000:0.0:1788521300.125423:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222424320 00000100:00100000:0.0:1788521300.125469:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788521300.125477:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef41324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222424320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521300.125513:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef41324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222424320:12345-0@lo:400:kworker.0 Request processed in 37us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521300.125519:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00010000:00080000:0.0:1788521300.125544:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef41324380 x1875400222424320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521300.125556:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef41324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222424320:0@lo:400:kworker.0 00000100:00100000:3.0:1788521300.126508:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222424064 00000100:00100000:3.0:1788521300.126518:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222424064 00000100:00100000:3.0:1788521300.126565:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222424448 00000100:00100000:3.0:1788521300.126567:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222424448 00000100:00100000:3.0:1788521300.126596:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788521300.126604:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222424064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521300.126683:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222424064:12345-0@lo:400:kworker.0 Request processed in 79us (3280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521300.126698:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788521300.126713:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788521300.126720:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222424448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521300.126749:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222424448:12345-0@lo:400:kworker.0 Request processed in 30us (1445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521300.126755:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1788521300.127071:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521300.127076:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788521300.127079:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788521300.127129:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4321ea00 x1875400222424064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521300.127143:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4321ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222424064:0@lo:400:kworker.0 00010000:00080000:2.0:1788521300.127175:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef715a1180 x1875400222424448/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521300.127184:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222424448:0@lo:400:kworker.0 00010000:00010000:3.0:1788521300.175586:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521300.622159:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef41324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222424576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788521300.622262:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521300.622354:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222424576 00000100:00100000:0.0:1788521300.622364:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222424576 00000100:00100000:0.0:1788521300.622420:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788521300.622431:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee437c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222424576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788521300.622473:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788521300.622525:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee437c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222424576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521300.622533:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788521300.622589:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef41324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222424576:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788521300.628343:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222424704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788521300.628436:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521300.630737:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222424704 00000100:00100000:0.0:1788521300.630753:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222424704 00000100:00100000:0.0:1788521300.630832:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788521300.630844:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222424704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788521300.630877:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521300.632539:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222424704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1688us (4094us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521300.632552:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:3.0:1788521300.634468:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43c6a680 x1875400222424704/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521300.634504:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222424704:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788521301.198266:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521302.221094:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521302.669325:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788521302.669349:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee437c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222424832:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788521302.669442:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521302.669909:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222424832 00000100:00100000:0.0:1788521302.669918:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222424832 00000100:00100000:0.0:1788521302.669974:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788521302.669985:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222424832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788521302.670013:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521302.670068:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222424832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521302.670074:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:0.0:1788521302.670114:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee437c2a00 x1875400222424832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521302.670131:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee437c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222424832:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788521302.672167:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521302.675800:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788521302.675824:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222424960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521302.675925:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521302.675990:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222424960 00000100:00100000:0.0:1788521302.676006:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222424960 00000100:00100000:0.0:1788521302.676075:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788521302.676085:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222424960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788521302.676106:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521302.676150:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222424960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521302.676157:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1788521302.676778:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788521302.676813:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43c6a680 x1875400222424960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521302.676833:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222424960:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788521303.246112:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788521304.091565:0:13684:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1788521304.274620:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788521304.725180:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1788521304.725324:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:3.0:1788521304.725334:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:1.0:1788521304.726144:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aae00/0x411dd0ee4d2d1494 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.726157:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aae00/0x411dd0ee4d2d1494 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.726165:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aae00/0x411dd0ee4d2d1494 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.726172:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aae00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521304.726177:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aae00/0x411dd0ee4d2d1494 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.726186:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aae00/0x411dd0ee4d2d1494 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.726202:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xda267534 (ffff8fef51db3e00) 00010000:00010000:1.0:1788521304.726205:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521304.726211:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aae00/0x411dd0ee4d2d1494 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.726217:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aae00/0x411dd0ee4d2d1494 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.726238:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d14a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.726245:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d14a9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.726251:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d14a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.726264:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42411c00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521304.726267:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d14a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.726272:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d14a9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.726281:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8fee42474a00) 00010000:00010000:1.0:1788521304.726283:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521304.726287:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d14a9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.726292:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d14a9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.726313:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1512 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.726320:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1512 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.726325:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1512 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.726330:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6000 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521304.726333:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1512 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.726339:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1512 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.726358:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xda267534 (ffff8fef51db3e00) 00010000:00010000:1.0:1788521304.726361:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521304.726364:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1512 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.727095:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1512 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xda267534 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.727118:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030200/0x411dd0ee4d2d152e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.727124:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030200/0x411dd0ee4d2d152e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.727129:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030200/0x411dd0ee4d2d152e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.727135:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40030200 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521304.727138:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030200/0x411dd0ee4d2d152e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.727144:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030200/0x411dd0ee4d2d152e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.727155:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8fef71591200) 00010000:00010000:1.0:1788521304.727157:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521304.727160:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030200/0x411dd0ee4d2d152e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.727165:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030200/0x411dd0ee4d2d152e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521304.729422:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee437c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222425088:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788521304.729492:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521304.730494:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222425088 00000100:00100000:0.0:1788521304.730504:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222425088 00000100:00100000:0.0:1788521304.730584:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788521304.730595:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222425088:12345-0@lo:6:osp-syn-1-0.0 00000100:00080000:1.0:1788521304.730633:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1788521304.730644:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:0.0:1788521304.730686:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9aab52, atime: 0x6a9aab52, ctime: 0x6a9aab52, blocks: 0x0 00010000:00010000:0.0:1788521304.730694:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c79b1790/0x411dd0ee4d2d153c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521304.730712:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=354s v=(0 0) 00010000:00010000:0.0:1788521304.730717:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521304.730729:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c79b1790/0x411dd0ee4d2d153c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521304.730748:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c79b1790/0x411dd0ee4d2d153c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521304.730758:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c79b1790/0x411dd0ee4d2d153c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521304.730767:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c79b1790/0x411dd0ee4d2d153c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521304.730793:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788521304.730928:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521304.730935:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c79b1790/0x411dd0ee4d2d153c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.730945:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410800 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:1.0:1788521304.730949:0:7461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c79b1790/0x411dd0ee4d2d153c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.730958:0:7461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c79b1790/0x411dd0ee4d2d153c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.730976:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c79b1790/0x411dd0ee4d2d153c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.730984:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c79b1790/0x411dd0ee4d2d153c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521304.731012:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521304.731014:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521304.731016:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521304.732107:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875400222425088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1511us (2611us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788521304.732117:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:1.0:1788521304.732185:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fee437c2a00/2, rc 0, transno 4294967301 00000100:00100000:1.0:1788521304.732192:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee437c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222425088:0@lo:6:osp-syn-1-0.0 00000020:00000080:3.0:1788521305.152976:0:13732:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd0c4d1880 20000000:00000080:3.0:1788521305.152992:0:13732:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8fef41219c00 uarg=0000000000000000 20000000:01000000:3.0:1788521305.153037:0:13732:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788521305.153043:0:13732:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788521305.153047:0:13732:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788521305.153559:0:13733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788521305.154421:0:13732:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788521305.161385:0:13732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788521305.161419:0:13732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788521305.161559:0:13732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788521305.161577:0:13732:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788521305.161597:0:13732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fef40030800/0x411dd0ee4d2d1543 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521305.161629:0:13732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef749cb800/0x411dd0ee4d2d13d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d13c9 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521305.161638:0:13732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fee42410a00/0x411dd0ee4d2d13de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d13d7 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521305.161644:0:13732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef6d7b7600/0x411dd0ee4d2d13ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d13e5 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521305.161652:0:13732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef6d7b7000/0x411dd0ee4d2d13fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d13f3 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521305.161663:0:13732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fee42410200/0x411dd0ee4d2d1401 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed55a expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521305.161672:0:13732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fee42410c00/0x411dd0ee4d2d1408 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed561 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521305.161680:0:13732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fef40030800/0x411dd0ee4d2d1543 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521305.161735:0:13732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fee42410c00/0x411dd0ee4d2d1408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed561 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521305.161750:0:13732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fee42410c00/0x411dd0ee4d2d1408 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed561 expref: 12 pid: 6512 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521305.161764:0:13732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875400222425216:192.168.203.41@tcp:104: 00010000:00010000:2.0:1788521305.161997:0:13732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fee42410200/0x411dd0ee4d2d1401 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed55a expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521305.162008:0:13732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fee42410200/0x411dd0ee4d2d1401 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed55a expref: 12 pid: 6512 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521305.162019:0:13732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875400222425344:192.168.203.41@tcp:104: 00010000:00010000:2.0:1788521305.162052:0:13732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef6d7b7000/0x411dd0ee4d2d13fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d13f3 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521305.162060:0:13732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef6d7b7000/0x411dd0ee4d2d13fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d13f3 expref: 23 pid: 6512 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521305.162080:0:13732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875400222425472:0@lo:104: 00000100:00100000:2.0:1788521305.162120:0:13732:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788521305.162160:0:13732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef6d7b7600/0x411dd0ee4d2d13ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d13e5 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521305.162170:0:13732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef6d7b7600/0x411dd0ee4d2d13ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d13e5 expref: 23 pid: 6514 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521305.162181:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788521305.162203:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222425472 00000100:00100000:1.0:1788521305.162210:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222425472 00000100:00100000:2.0:1788521305.162244:0:13732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4321ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875400222425600:0@lo:104: 00000100:00100000:1.0:1788521305.162264:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788521305.162269:0:13732:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521305.162278:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43262050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:13732:x1875400222425472:12345-0@lo:104: 00010000:00010000:2.0:1788521305.162290:0:13732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fee42410a00/0x411dd0ee4d2d13de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d13d7 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521305.162292:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef749ca000/0x411dd0ee4d2d13f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d13fa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521305.162299:0:13732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fee42410a00/0x411dd0ee4d2d13de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d13d7 expref: 23 pid: 6513 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521305.162314:0:13732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4358e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875400222425728:0@lo:104: 00000100:00100000:2.0:1788521305.162347:0:13732:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788521305.162372:0:13732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef749cb800/0x411dd0ee4d2d13d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d13c9 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521305.162378:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1788521305.162382:0:13732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fef749cb800/0x411dd0ee4d2d13d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d13c9 expref: 23 pid: 6513 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521305.162389:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43262050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:13732:x1875400222425472:12345-0@lo:104: Request processed in 113us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521305.162399:0:13732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4358d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875400222425856:0@lo:104: 00000100:00100000:1.0:1788521305.162401:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788521305.162500:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222425600 00000100:00100000:3.0:1788521305.162504:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222425600 00000100:00100000:3.0:1788521305.162525:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222425728 00000100:00100000:3.0:1788521305.162527:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222425728 00000100:00100000:2.0:1788521305.162528:0:13732:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521305.162540:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222425856 00000100:00100000:3.0:1788521305.162543:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222425856 00000100:00100000:2.0:1788521305.162544:0:13732:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee433e4900 going to sleep for 11 seconds 00000100:00100000:3.0:1788521305.162559:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788521305.162566:0:13732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875400222425472:0@lo:104: 00000100:00100000:3.0:1788521305.162570:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4358c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+5:13732:x1875400222425600:12345-0@lo:104: 00010000:00010000:3.0:1788521305.162580:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef749cae00/0x411dd0ee4d2d13e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d13ec expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521305.162645:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788521305.162652:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4358c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+5:13732:x1875400222425600:12345-0@lo:104: Request processed in 85us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521305.162660:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788521305.162662:0:13732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4321ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875400222425600:0@lo:104: 00000100:00100000:3.0:1788521305.162681:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788521305.162690:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4358f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+4:13732:x1875400222425728:12345-0@lo:104: 00010000:00010000:3.0:1788521305.162698:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef749ca400/0x411dd0ee4d2d13d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d13de expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521305.162750:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788521305.162755:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4358f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+4:13732:x1875400222425728:12345-0@lo:104: Request processed in 67us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521305.162761:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788521305.162772:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788521305.162786:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4358ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:13732:x1875400222425856:12345-0@lo:104: 00010000:00010000:3.0:1788521305.162793:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7200/0x411dd0ee4d2d13c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d13d0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521305.162821:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788521305.162822:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788521305.162830:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4358ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+3:13732:x1875400222425856:12345-0@lo:104: Request processed in 45us (401us total) trans 0 rc 0/0 00010000:00010000:0.0:1788521305.162831:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef749ca000/0x411dd0ee4d2d13f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d13fa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521305.162839:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1788521305.162857:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788521305.162857:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749ca000 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:0.0:1788521305.162864:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef749ca000/0x411dd0ee4d2d13f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d13fa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521305.162865:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef749cae00/0x411dd0ee4d2d13e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d13ec expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521305.162903:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cae00 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:3.0:1788521305.162907:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef749cae00/0x411dd0ee4d2d13e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d13ec expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521305.162909:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef749ca000/0x411dd0ee4d2d13f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d13fa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521305.162921:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef749cae00/0x411dd0ee4d2d13e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d13ec expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521305.162924:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef749ca000/0x411dd0ee4d2d13f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d13fa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521305.162934:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef749cae00/0x411dd0ee4d2d13e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d13ec expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521305.162936:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788521305.162945:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788521305.163019:0:13732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4358e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875400222425728:0@lo:104: 00010000:00010000:1.0:1788521305.163085:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1788521305.163190:0:13732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4358d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875400222425856:0@lo:104: 00010000:00010000:2.0:1788521305.163734:0:13734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521305.163849:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef749ca400/0x411dd0ee4d2d13d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d13de expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521305.163949:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521305.163955:0:13734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7200/0x411dd0ee4d2d13c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d13d0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521305.164090:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749ca400 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:1.0:1788521305.164101:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef749ca400/0x411dd0ee4d2d13d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d13de expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521305.164110:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef749ca400/0x411dd0ee4d2d13d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d13de expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521305.164117:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef749ca400/0x411dd0ee4d2d13d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d13de expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521305.164123:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788521305.164145:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef749ca400/0x411dd0ee4d2d13d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d13de expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521305.164151:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788521305.164176:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef749ca400/0x411dd0ee4d2d13d7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d13de expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521305.164184:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef749ca400/0x411dd0ee4d2d13d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d13de expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521305.164197:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521305.164198:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521305.164200:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521305.164214:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222426112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788521305.164255:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788521305.164399:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef749cae00/0x411dd0ee4d2d13e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d13ec expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521305.164406:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788521305.164707:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222426240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788521305.164736:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521305.164766:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222426112 00000100:00100000:1.0:1788521305.164771:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222426112 00010000:00010000:1.0:1788521305.164793:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fee42410a00/0x411dd0ee4d2d13de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d13d7 expref: 24 pid: 6513 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521305.164812:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222426240 00000100:00100000:1.0:1788521305.164815:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222426240 00010000:00010000:1.0:1788521305.164824:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef6d7b7600/0x411dd0ee4d2d13ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d13e5 expref: 25 pid: 6514 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521305.164834:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788521305.164840:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f077800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+25:3644:x1875400222426112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788521305.164850:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521305.164854:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fee42410a00/0x411dd0ee4d2d13de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d13d7 expref: 25 pid: 6513 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521305.164864:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fee42410a00/0x411dd0ee4d2d13de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d13d7 expref: 25 pid: 6513 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521305.164906:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fee42410a00/0x411dd0ee4d2d13de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d13d7 expref: 25 pid: 6513 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521305.164919:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521305.164947:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f077800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3644:x1875400222426112:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521305.164954:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788521305.164972:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788521305.164978:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f075c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:3645:x1875400222426240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788521305.164985:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521305.164990:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef6d7b7600/0x411dd0ee4d2d13ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d13e5 expref: 23 pid: 6514 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521305.164998:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef6d7b7600/0x411dd0ee4d2d13ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d13e5 expref: 23 pid: 6514 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521305.165009:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef6d7b7600/0x411dd0ee4d2d13ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d13e5 expref: 23 pid: 6514 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521305.165017:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521305.165044:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f075c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:3645:x1875400222426240:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521305.165049:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788521305.165080:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222426240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788521305.165114:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222426112:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521305.165224:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef749ca000/0x411dd0ee4d2d13f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d13fa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521305.165233:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521305.165360:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef749cae00/0x411dd0ee4d2d13e5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d13ec expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521305.165380:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef749cae00/0x411dd0ee4d2d13e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d13ec expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521305.165391:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521305.165392:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521305.165394:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521305.165545:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee437c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222425984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788521305.165576:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521305.165641:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222425984 00000100:00100000:3.0:1788521305.165647:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222425984 00010000:00010000:0.0:1788521305.165647:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef749ca000/0x411dd0ee4d2d13f3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d13fa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521305.165658:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef749ca000/0x411dd0ee4d2d13f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d13fa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521305.165671:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521305.165673:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef6d7b7000/0x411dd0ee4d2d13fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d13f3 expref: 22 pid: 6512 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521305.165674:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521305.165677:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521305.165700:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788521305.165708:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f075f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:3646:x1875400222425984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788521305.165717:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521305.165721:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef6d7b7000/0x411dd0ee4d2d13fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d13f3 expref: 22 pid: 6512 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521305.165729:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef6d7b7000/0x411dd0ee4d2d13fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d13f3 expref: 22 pid: 6512 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521305.165740:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef6d7b7000/0x411dd0ee4d2d13fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d13f3 expref: 22 pid: 6512 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521305.165749:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521305.165773:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f075f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:3646:x1875400222425984:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521305.165779:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:2.0:1788521305.165834:0:13734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7200 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:2.0:1788521305.165839:0:13734:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7200/0x411dd0ee4d2d13c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d13d0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521305.165848:0:13734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7200/0x411dd0ee4d2d13c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d13d0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521305.165855:0:13734:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7200/0x411dd0ee4d2d13c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d13d0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521305.165860:0:13734:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788521305.165880:0:13734:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7200/0x411dd0ee4d2d13c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d13d0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521305.165930:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521305.165937:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521305.165972:0:13734:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788521305.166017:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222426368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521305.166044:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521305.166110:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222426368 00000100:00100000:0.0:1788521305.166114:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222426368 00010000:00010000:0.0:1788521305.166129:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef749cb800/0x411dd0ee4d2d13d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d13c9 expref: 21 pid: 6513 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521305.166145:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788521305.166155:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:3643:x1875400222426368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521305.166163:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521305.166167:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef749cb800/0x411dd0ee4d2d13d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d13c9 expref: 21 pid: 6513 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521305.166174:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef749cb800/0x411dd0ee4d2d13d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d13c9 expref: 21 pid: 6513 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521305.166185:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef749cb800/0x411dd0ee4d2d13d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d13c9 expref: 21 pid: 6513 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521305.166194:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521305.166235:0:13734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7200/0x411dd0ee4d2d13c9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d13d0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521305.166243:0:13734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7200/0x411dd0ee4d2d13c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d13d0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521305.166257:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521305.166258:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521305.166261:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521305.166370:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee437c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222425984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521305.166499:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:3643:x1875400222426368:12345-0@lo:103:ldlm_bl.0 Request processed in 342us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521305.166505:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788521305.166549:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222426368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788521305.169319:0:13732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875400222425216:192.168.203.41@tcp:104: 00000100:00100000:1.0:1788521305.180472:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521305.180640:0:13732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875400222425344:192.168.203.41@tcp:104: 00010000:00010000:3.0:1788521305.180695:0:13732:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fef40030800/0x411dd0ee4d2d1543 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521305.181170:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201365888 00000100:00100000:0.0:1788521305.181178:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201365888 00010000:00010000:0.0:1788521305.181213:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fee42410c00/0x411dd0ee4d2d1408 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed561 expref: 13 pid: 6512 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521305.181253:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 50 00000100:00100000:0.0:1788521305.181262:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f075180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2395:x1875400201365888:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521305.181277:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521305.181283:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fee42410c00/0x411dd0ee4d2d1408 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed561 expref: 13 pid: 6512 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521305.181295:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fee42410c00/0x411dd0ee4d2d1408 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed561 expref: 13 pid: 6512 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521305.181330:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fee42410c00/0x411dd0ee4d2d1408 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed561 expref: 13 pid: 6512 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521305.181344:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521305.181527:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f075180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f234d90e-c25e-4162-a7b5-1cc50583b917+12:2395:x1875400201365888:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 264us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521305.181535:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 50 00000100:00100000:0.0:1788521305.184438:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521305.184661:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201366016 00000100:00100000:2.0:1788521305.184669:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201366016 00010000:00010000:2.0:1788521305.184717:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fee42410200/0x411dd0ee4d2d1401 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed55a expref: 12 pid: 6512 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521305.184786:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 51 00000100:00100000:2.0:1788521305.184797:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee437c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f234d90e-c25e-4162-a7b5-1cc50583b917+12:2396:x1875400201366016:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521305.184812:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521305.184819:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fee42410200/0x411dd0ee4d2d1401 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed55a expref: 12 pid: 6512 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521305.184832:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fee42410200/0x411dd0ee4d2d1401 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed55a expref: 12 pid: 6512 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521305.184853:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fee42410200/0x411dd0ee4d2d1401 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed55a expref: 12 pid: 6512 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521305.184871:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fef40030800/0x411dd0ee4d2d1543 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521305.184925:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef40030800/0x411dd0ee4d2d1543 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521305.184943:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fef40030800/0x411dd0ee4d2d1543 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521305.184951:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fef40030800/0x411dd0ee4d2d1543 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521305.184958:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fef40030800/0x411dd0ee4d2d1543 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521305.184965:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fef40030800/0x411dd0ee4d2d1543 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521305.184982:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40030800 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:2.0:1788521305.184987:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fef40030800/0x411dd0ee4d2d1543 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521305.185008:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fef40030800/0x411dd0ee4d2d1543 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521305.185027:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fef40030800/0x411dd0ee4d2d1543 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521305.185040:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521305.185087:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee437c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f234d90e-c25e-4162-a7b5-1cc50583b917+11:2396:x1875400201366016:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 291us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521305.185095:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 51 00010000:00010000:0.0:1788521305.185321:0:13732:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fef40030800/0x411dd0ee4d2d1543 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521305.185330:0:13732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fef40030800/0x411dd0ee4d2d1543 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521305.185337:0:13732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef40030800/0x411dd0ee4d2d1543 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521305.193509:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521305.193555:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521305.193577:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521305.193616:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521305.193646:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521305.193670:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201366272 00000100:00100000:1.0:1788521305.193670:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201366528 00000100:00100000:3.0:1788521305.193678:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201366272 00000100:00100000:1.0:1788521305.193689:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201366528 00000100:00100000:0.0:1788521305.193762:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201366144 00000100:00100000:0.0:1788521305.193766:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201366144 00000100:00100000:3.0:1788521305.200015:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201366656 00000100:00100000:3.0:1788521305.200028:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201366656 00000100:00100000:1.0:1788521305.205410:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 232 00000100:00100000:1.0:1788521305.205430:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+5:2393:x1875400201366272:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521305.205526:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+5:2393:x1875400201366272:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 103us (12026us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521305.205534:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 232 00000100:00100000:1.0:1788521305.205553:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 233 00000100:00100000:1.0:1788521305.205561:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2393:x1875400201366528:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521305.205589:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2393:x1875400201366528:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 29us (12033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521305.205597:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 233 00000100:00100000:1.0:1788521305.205639:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201366400 00000100:00100000:1.0:1788521305.205647:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201366400 00000100:00100000:1.0:1788521305.205685:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 96 00000100:00100000:0.0:1788521305.211230:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 234 00000100:00100000:0.0:1788521305.211247:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+5:2393:x1875400201366144:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521305.211342:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+5:2393:x1875400201366144:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 100us (17762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521305.211349:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 234 00000100:00100000:1.0:1788521305.213291:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43519c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2393:x1875400201366400:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521305.213372:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43519c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2393:x1875400201366400:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 102us (19755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521305.213394:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 96 00000100:00080000:1.0:1788521305.213445:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788521305.213451:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788521305.213453:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788521305.231714:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee437c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222426496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521305.231801:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521305.231858:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222426496 00000100:00100000:0.0:1788521305.231875:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222426496 00000100:00100000:0.0:1788521305.231937:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788521305.231945:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee437c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875400222426496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788521305.231975:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521305.232017:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee437c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875400222426496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521305.232023:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788521305.232069:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee437c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222426496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521305.237356:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222426624:0@lo:400:kworker.0 00000100:00100000:0.0:1788521305.238189:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875400222426880:0@lo:400:kworker.0 00000100:00100000:2.0:1788521305.239038:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 235 00000100:00100000:2.0:1788521305.239053:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2393:x1875400201366656:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521305.242693:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521305.242754:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222427392:0@lo:400:kworker.0 00000100:00100000:0.0:1788521305.242804:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521305.242825:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222427904:0@lo:400:kworker.0 00000100:00100000:0.0:1788521305.242848:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521305.242877:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788521305.242899:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222427008:0@lo:400:kworker.0 00000100:00100000:0.0:1788521305.242925:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521305.242943:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222427520:0@lo:400:kworker.0 00000100:00100000:0.0:1788521305.242962:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521305.242987:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222428032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788521305.243008:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521305.243041:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222427392 00000100:00100000:0.0:1788521305.243048:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222427392 00000100:00100000:0.0:1788521305.243096:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222427904 00000100:00100000:0.0:1788521305.243099:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222427904 00000100:00100000:0.0:1788521305.243121:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222427520 00000100:00100000:0.0:1788521305.243137:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222427520 00000100:00100000:0.0:1788521305.243157:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788521305.243165:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef41324380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222427392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521305.243218:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef41324380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222427392:12345-0@lo:400:kworker.0 Request processed in 54us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521305.243226:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788521305.243242:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788521305.243248:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222427904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521305.243274:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222427904:12345-0@lo:400:kworker.0 Request processed in 27us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521305.243280:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788521305.243291:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788521305.243297:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222427520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521305.243322:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222427520:12345-0@lo:400:kworker.0 Request processed in 26us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521305.243326:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788521305.243346:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222427008 00000100:00100000:0.0:1788521305.243349:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222427008 00000100:00100000:0.0:1788521305.243383:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222428032 00000100:00100000:0.0:1788521305.243386:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222428032 00000100:00100000:3.0:1788521305.243391:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788521305.243400:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788521305.243401:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222427008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521305.243404:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222428032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788521305.243429:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788521305.243436:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222427008:12345-0@lo:400:kworker.0 Request processed in 39us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521305.243442:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788521305.243456:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222428032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521305.243461:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:0.0:1788521305.243481:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521305.243491:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521305.243502:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222426880 00000100:00100000:0.0:1788521305.243506:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222426880 00000100:00100000:0.0:1788521305.243540:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788521305.243546:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee437c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875400222426880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521305.243580:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee437c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875400222426880:12345-0@lo:400:kworker.0 Request processed in 35us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521305.243586:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788521305.243633:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43602d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222427008:0@lo:400:kworker.0 00010000:00080000:0.0:1788521305.243647:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43256300 x1875400222427520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521305.243657:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222427520:0@lo:400:kworker.0 00000100:00100000:0.0:1788521305.243670:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222428032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788521305.243679:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43600e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875400222426880:0@lo:400:kworker.0 00010000:00080000:0.0:1788521305.243689:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43256d80 x1875400222427392/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521305.243696:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222427392:0@lo:400:kworker.0 00000100:00100000:0.0:1788521305.243705:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222427904:0@lo:400:kworker.0 00000100:00100000:1.0:1788521305.253202:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222426752:0@lo:400:kworker.0 00000100:00100000:1.0:1788521305.253267:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521305.253308:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875400222427264:0@lo:400:kworker.0 00000100:00100000:1.0:1788521305.253332:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521305.253352:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875400222427776:0@lo:400:kworker.0 00000100:00100000:1.0:1788521305.253373:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521305.253425:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222427264 00000100:00100000:1.0:1788521305.253433:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222427264 00000100:00100000:1.0:1788521305.253482:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222427776 00000100:00100000:1.0:1788521305.253485:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222427776 00000100:00100000:1.0:1788521305.253506:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788521305.253507:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222426752 00000100:00100000:3.0:1788521305.253510:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222426752 00000100:00100000:1.0:1788521305.253514:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875400222427264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521305.253538:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788521305.253545:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222426752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521305.253563:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71521500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875400222427264:12345-0@lo:400:kworker.0 Request processed in 50us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521305.253571:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788521305.253577:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222426752:12345-0@lo:400:kworker.0 Request processed in 33us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521305.253582:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788521305.253586:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788521305.253591:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875400222427776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521305.253631:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875400222427776:12345-0@lo:400:kworker.0 Request processed in 39us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521305.253637:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00080000:1.0:1788521305.253670:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788521305.253703:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222426752:0@lo:400:kworker.0 00010000:00080000:1.0:1788521305.253715:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43256680 x1875400222427264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521305.253724:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875400222427264:0@lo:400:kworker.0 00010000:00080000:1.0:1788521305.253733:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef71522680 x1875400222427776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521305.253740:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875400222427776:0@lo:400:kworker.0 00000100:00100000:1.0:1788521305.253780:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521305.253820:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875400222427136:0@lo:400:kworker.0 00000100:00100000:3.0:1788521305.253833:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222426624 00000100:00100000:3.0:1788521305.253837:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222426624 00000100:00100000:1.0:1788521305.253842:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521305.253857:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222427136 00000100:00100000:3.0:1788521305.253859:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222427136 00000100:00100000:1.0:1788521305.253860:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788521305.253867:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222426624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521305.253909:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788521305.253912:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222426624:12345-0@lo:400:kworker.0 Request processed in 46us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521305.253916:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875400222427136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521305.253918:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00080000:1.0:1788521305.253933:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521305.253954:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875400222427648:0@lo:400:kworker.0 00000100:00100000:3.0:1788521305.253958:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875400222427136:12345-0@lo:400:kworker.0 Request processed in 44us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521305.253965:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788521305.253978:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521305.254006:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43603800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222426624:0@lo:400:kworker.0 00000100:00100000:3.0:1788521305.254016:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222427648 00000100:00100000:1.0:1788521305.254017:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43600380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875400222427136:0@lo:400:kworker.0 00000100:00100000:3.0:1788521305.254019:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222427648 00000100:00080000:1.0:1788521305.254038:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521305.254054:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788521305.254061:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875400222427648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521305.254103:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875400222427648:12345-0@lo:400:kworker.0 Request processed in 44us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521305.254109:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788521305.254228:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875400222427648:0@lo:400:kworker.0 00000100:00100000:2.0:1788521305.254372:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2393:x1875400201366656:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 15320us (60719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521305.254381:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 235 00010000:00010000:1.0:1788521305.294120:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521305.741130:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788521305.741157:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222428160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788521305.741228:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521305.741332:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222428160 00000100:00100000:0.0:1788521305.741341:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222428160 00000100:00100000:0.0:1788521305.741396:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788521305.741405:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222428160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788521305.741439:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788521305.741488:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222428160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521305.741507:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788521305.741552:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222428160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788521305.753040:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788521305.753061:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222428288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788521305.753122:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521305.753166:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222428288 00000100:00100000:2.0:1788521305.753176:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222428288 00000100:00100000:2.0:1788521305.753223:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788521305.753233:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222428288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788521305.753266:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521305.753315:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71521880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222428288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521305.753323:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788521305.753368:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222428288:0@lo:13:osp-pre-1-1.0 00000020:00000080:0.0:1788521306.010024:0:13783:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc30106770 20000000:00000080:0.0:1788521306.010041:0:13783:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8fee4366f000 uarg=0000000000000000 20000000:01000000:0.0:1788521306.010082:0:13783:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1788521306.010088:0:13783:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1788521306.010094:0:13783:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1788521306.010807:0:13784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:0.0:1788521306.011025:0:13783:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1788521306.011090:0:13783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:0.0:1788521306.011119:0:13783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:0.0:1788521306.011134:0:13783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:0.0:1788521306.011145:0:13783:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788521306.011164:0:13783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fee42410200/0x411dd0ee4d2d154a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521306.011179:0:13783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fee42410200/0x411dd0ee4d2d154a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521306.011189:0:13783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fee42410200/0x411dd0ee4d2d154a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521306.011195:0:13783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fee42410200/0x411dd0ee4d2d154a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521306.011203:0:13783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fee42410200/0x411dd0ee4d2d154a lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521306.011211:0:13783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fee42410200/0x411dd0ee4d2d154a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521306.011230:0:13783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410200 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:0.0:1788521306.011235:0:13783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fee42410200/0x411dd0ee4d2d154a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521306.011244:0:13783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fee42410200/0x411dd0ee4d2d154a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521306.011258:0:13783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fee42410200/0x411dd0ee4d2d154a lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521306.011267:0:13783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fee42410200/0x411dd0ee4d2d154a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521306.011274:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fee42410200/0x411dd0ee4d2d154a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521306.193366:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788521306.193373:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fef7675d800 from 7 10000000:01000000:2.0:1788521306.193378:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788521306.193421:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef40030800/0x411dd0ee4d2d1551 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521306.193432:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef40030800/0x411dd0ee4d2d1551 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521306.193443:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef40030800/0x411dd0ee4d2d1551 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521306.193468:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222428416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788521306.193542:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521306.193589:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee436499c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521306.193937:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222428416 00000100:00100000:1.0:1788521306.193946:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222428416 00000100:00100000:1.0:1788521306.193991:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788521306.193999:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:6517:x1875400222428416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521306.194014:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521306.194029:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fee434aa400/0x411dd0ee4d2d1558 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d1551 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521306.194051:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fee434aa400/0x411dd0ee4d2d1558 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1551 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521306.194063:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fee434aa400/0x411dd0ee4d2d1558 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d1551 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521306.194072:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434aa400, rc 0) 00000100:00100000:1.0:1788521306.194112:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222428416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521306.194118:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1788521306.194219:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222428416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521306.194234:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef40030800/0x411dd0ee4d2d1551 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1558 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521306.194244:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef40030800/0x411dd0ee4d2d1551 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d1558 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521306.194315:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222428544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521306.194366:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521306.194395:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee436499c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521306.194494:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222428544 00000100:00100000:1.0:1788521306.194499:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222428544 00000100:00100000:1.0:1788521306.194530:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788521306.194547:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222428544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521306.194662:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222428544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521306.194677:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1788521306.194863:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222428544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521306.194917:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222428672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521306.194950:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521306.194973:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee436499c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521306.195115:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222428672 00000100:00100000:1.0:1788521306.195119:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222428672 00000100:00100000:1.0:1788521306.195148:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788521306.195155:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222428672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521306.195236:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222428672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521306.195243:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1788521306.195319:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222428672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521306.195923:0:13795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:13795:1875400222428800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521306.195964:0:13795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521306.195989:0:13795:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee43649c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788521306.196045:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222428800 00000100:00100000:1.0:1788521306.196050:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222428800 00000100:00100000:1.0:1788521306.196081:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788521306.196088:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:13795:x1875400222428800:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521306.196160:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:13795:x1875400222428800:12345-0@lo:502:llog_process_th.0 Request processed in 73us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521306.196167:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1788521306.196239:0:13795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:13795:1875400222428800:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788521306.196260:0:13795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521306.196269:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521306.196271:0:13795:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788521306.196277:0:13795:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fef7675d800 00000020:00000080:2.0:1788521306.196280:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788521306.196489:0:13795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521306.196494:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521306.196495:0:13795:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788521306.196498:0:13795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521306.196501:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521306.196502:0:13795:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788521306.196506:0:13795:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fef7675d800 00000020:00000080:2.0:1788521306.196508:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788521306.199898:0:13795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:13795:1875400222428928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521306.199981:0:13795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521306.205042:0:13795:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee43649c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788521306.206466:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222428928 00000100:00100000:0.0:1788521306.206476:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222428928 00000100:00100000:0.0:1788521306.206527:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1788521306.206823:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:13795:x1875400222428928:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521306.206994:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:13795:x1875400222428928:12345-0@lo:502:llog_process_th.0 Request processed in 458us (7012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521306.207002:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1788521306.207540:0:13795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:13795:1875400222428928:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788521306.207575:0:13795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521306.207583:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521306.207586:0:13795:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788521306.207590:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788521306.210034:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788521306.210075:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788521306.210087:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef40030800/0x411dd0ee4d2d1551 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1558 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521306.210100:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef40030800/0x411dd0ee4d2d1551 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1558 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521306.210109:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788521306.210112:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fef76680800 from 7 10000000:01000000:1.0:1788521306.210115:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788521306.210150:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434aae00/0x411dd0ee4d2d155f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521306.210168:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fee434aae00/0x411dd0ee4d2d155f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521306.210178:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fee434aae00/0x411dd0ee4d2d155f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521306.210202:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222429056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788521306.210264:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521306.210310:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee4226b780 going to sleep for 11 seconds 00000100:00100000:0.0:1788521306.212673:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222429056 00000100:00100000:0.0:1788521306.212687:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222429056 00000100:00100000:0.0:1788521306.212754:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788521306.212764:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:6517:x1875400222429056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521306.212782:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521306.212808:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fee42410200/0x411dd0ee4d2d1566 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d155f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521306.212839:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fee42410200/0x411dd0ee4d2d1566 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d155f expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521306.212852:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fee42410200/0x411dd0ee4d2d1566 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d155f expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521306.212862:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42410200, rc 0) 00000100:00100000:0.0:1788521306.212963:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:6517:x1875400222429056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (2698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521306.212970:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1788521306.213114:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222429056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521306.213131:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fee434aae00/0x411dd0ee4d2d155f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1566 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521306.213140:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fee434aae00/0x411dd0ee4d2d155f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d1566 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521306.213208:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222429184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521306.213241:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521306.213267:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee43649c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788521306.213311:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222429184 00000100:00100000:0.0:1788521306.213317:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222429184 00000100:00100000:0.0:1788521306.213441:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788521306.213449:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:6517:x1875400222429184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521306.213563:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:6517:x1875400222429184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521306.213570:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788521306.234126:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222429184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521306.234194:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222429312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521306.234267:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521306.234308:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef767bcb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788521306.236843:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222429312 00000100:00100000:2.0:1788521306.236855:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222429312 00000100:00100000:2.0:1788521306.236924:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788521306.236934:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:6517:x1875400222429312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521306.237086:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:6517:x1875400222429312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (2819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521306.237094:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788521306.237157:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222429312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521306.237350:0:13800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:13800:1875400222429440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521306.237393:0:13800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521306.237423:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222429440 00000100:00100000:2.0:1788521306.237427:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222429440 00000100:00100000:2.0:1788521306.237449:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788521306.237455:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:13800:x1875400222429440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521306.237525:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:13800:x1875400222429440:12345-0@lo:502:llog_process_th.0 Request processed in 70us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521306.238230:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788521306.238293:0:13800:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee43649b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788521306.238315:0:13800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:13800:1875400222429440:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788521306.238353:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521306.238364:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521306.238367:0:13800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788521306.238374:0:13800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fef76680800 00000020:00000080:2.0:1788521306.238376:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788521306.238435:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521306.239338:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521306.239342:0:13800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788521306.239350:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521306.239355:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521306.239357:0:13800:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788521306.239361:0:13800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fef76680800 00000020:00000080:2.0:1788521306.239364:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788521306.239718:0:13800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:13800:1875400222429568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521306.239792:0:13800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521306.239829:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222429568 00000100:00100000:2.0:1788521306.239836:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222429568 00000100:00100000:2.0:1788521306.239877:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788521306.239910:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:13800:x1875400222429568:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521306.240015:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:13800:x1875400222429568:12345-0@lo:502:llog_process_th.0 Request processed in 129us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521306.240030:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788521306.240075:0:13800:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee43649b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788521306.240093:0:13800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:13800:1875400222429568:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788521306.240121:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521306.240127:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521306.240130:0:13800:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788521306.240134:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788521306.240558:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788521306.240581:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788521306.240592:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434aae00/0x411dd0ee4d2d155f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1566 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521306.240612:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fee434aae00/0x411dd0ee4d2d155f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1566 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521306.240624:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788521306.240627:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fef81580000 from 7 10000000:01000000:1.0:1788521306.240630:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788521306.240663:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d156d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521306.240672:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d156d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521306.240688:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d156d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521306.240703:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222429696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788521306.240755:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521306.240779:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef767bc9c0 going to sleep for 11 seconds 00000040:00080000:0.0:1788521306.241165:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788521306.242053:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222429696 00000100:00100000:2.0:1788521306.242063:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222429696 00000100:00100000:2.0:1788521306.242169:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788521306.242179:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:6517:x1875400222429696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521306.242195:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521306.242214:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef40030400/0x411dd0ee4d2d1574 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d156d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521306.242240:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef40030400/0x411dd0ee4d2d1574 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d156d expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521306.242312:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef40030400/0x411dd0ee4d2d1574 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d156d expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521306.242322:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef40030400, rc 0) 00000100:00100000:2.0:1788521306.242387:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:6517:x1875400222429696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (1630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521306.242393:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788521306.244366:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222429696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521306.244399:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d156d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1574 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521306.244412:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d156d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d1574 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521306.244511:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43256680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222429824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521306.244661:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521306.245453:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a68840 going to sleep for 11 seconds 00000100:00100000:2.0:1788521306.246464:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222429824 00000100:00100000:2.0:1788521306.246473:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222429824 00000100:00100000:2.0:1788521306.246524:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788521306.246790:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:6517:x1875400222429824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521306.246953:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:6517:x1875400222429824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 414us (2293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521306.246961:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788521306.248920:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43256680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222429824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521306.248979:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222429952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521306.249045:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521306.249078:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee43649d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521306.249105:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222429952 00000100:00100000:2.0:1788521306.249111:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222429952 00000100:00100000:2.0:1788521306.249151:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1788521306.249159:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:6517:x1875400222429952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521306.249266:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:6517:x1875400222429952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521306.249272:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1788521306.249316:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222429952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521306.249488:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:13801:1875400222430080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521306.249521:0:13801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521306.249543:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222430080 00000100:00100000:2.0:1788521306.249547:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222430080 00000100:00100000:2.0:1788521306.249567:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788521306.249572:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:13801:x1875400222430080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521306.249652:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:13801:x1875400222430080:12345-0@lo:502:llog_process_th.0 Request processed in 79us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521306.249668:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788521306.249694:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee43649c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788521306.249706:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:13801:1875400222430080:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788521306.249724:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521306.249732:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521306.249734:0:13801:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788521306.249741:0:13801:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fef81580000 00000020:00000080:2.0:1788521306.249743:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788521306.249786:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521306.250015:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521306.250018:0:13801:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788521306.250023:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521306.250026:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521306.250028:0:13801:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788521306.250031:0:13801:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fef81580000 00000020:00000080:2.0:1788521306.250034:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788521306.250196:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:13801:1875400222430208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521306.250232:0:13801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521306.250251:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222430208 00000100:00100000:2.0:1788521306.250255:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222430208 00000100:00100000:2.0:1788521306.250277:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1788521306.250283:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:13801:x1875400222430208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521306.250347:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:13801:x1875400222430208:12345-0@lo:502:llog_process_th.0 Request processed in 63us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521306.250354:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1788521306.250383:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee433e4900 going to sleep for 11 seconds 00000100:00100000:2.0:1788521306.250395:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:13801:1875400222430208:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788521306.250418:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521306.250421:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521306.250423:0:13801:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788521306.250427:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788521306.250477:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788521306.250497:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788521306.250506:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d156d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1574 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521306.250517:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d156d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1574 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521306.250527:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788521306.250530:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fef58328000 from 7 10000000:01000000:2.0:1788521306.250532:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788521306.250553:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d157b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521306.250561:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d157b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521306.250570:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d157b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521306.250582:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222430336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788521306.254949:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521306.254993:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee433e4900 going to sleep for 11 seconds 00000100:00100000:2.0:1788521306.255017:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222430336 00000100:00100000:2.0:1788521306.255025:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222430336 00000100:00100000:2.0:1788521306.255070:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1788521306.255181:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:6517:x1875400222430336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521306.255198:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521306.255215:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef40030200/0x411dd0ee4d2d1582 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d157b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521306.255241:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef40030200/0x411dd0ee4d2d1582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d157b expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521306.255265:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef40030200/0x411dd0ee4d2d1582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d157b expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521306.255275:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef40030200, rc 0) 00000100:00100000:2.0:1788521306.255331:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:6517:x1875400222430336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 235us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521306.255338:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1788521306.255390:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222430336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521306.255408:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d157b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1582 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521306.255418:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d157b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d1582 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521306.255484:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222430464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521306.255514:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521306.255528:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee433e4900 going to sleep for 11 seconds 00000100:00100000:2.0:1788521306.255541:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222430464 00000100:00100000:2.0:1788521306.255544:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222430464 00000100:00100000:2.0:1788521306.255567:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788521306.255579:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:6517:x1875400222430464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521306.256056:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:6517:x1875400222430464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 476us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521306.256064:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788521306.256105:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222430464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521306.256133:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222430592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521306.256172:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521306.256186:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee433e4900 going to sleep for 11 seconds 00000100:00100000:2.0:1788521306.256198:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222430592 00000100:00100000:2.0:1788521306.256202:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222430592 00000100:00100000:2.0:1788521306.256222:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788521306.256236:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:6517:x1875400222430592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521306.256462:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:6517:x1875400222430592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 226us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521306.256469:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788521306.256505:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:6517:1875400222430592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521306.274946:0:13803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:13803:1875400222430720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521306.275029:0:13803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521306.275071:0:13803:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee433e4900 going to sleep for 11 seconds 00000100:00100000:3.0:1788521306.277388:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222430720 00000100:00100000:3.0:1788521306.277399:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222430720 00000100:00100000:3.0:1788521306.277475:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1788521306.277485:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:13803:x1875400222430720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521306.278099:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:13803:x1875400222430720:12345-0@lo:502:llog_process_th.0 Request processed in 614us (3068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521306.278107:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788521306.278305:0:13803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:13803:1875400222430720:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788521306.278340:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521306.278349:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521306.278351:0:13803:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788521306.278369:0:13803:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fef58328000 00000020:00000080:2.0:1788521306.278378:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788521306.278428:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521306.279006:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521306.279010:0:13803:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788521306.279014:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521306.279018:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521306.279019:0:13803:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788521306.279022:0:13803:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fef58328000 00000020:00000080:2.0:1788521306.279024:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788521306.279180:0:13803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:13803:1875400222430848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521306.279230:0:13803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521306.279512:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222430848 00000100:00100000:2.0:1788521306.279518:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222430848 00000100:00100000:2.0:1788521306.280239:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1788521306.280315:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:13803:x1875400222430848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521306.280772:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:13803:x1875400222430848:12345-0@lo:502:llog_process_th.0 Request processed in 524us (1541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521306.280780:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1788521306.280830:0:13803:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee433e4900 going to sleep for 11 seconds 00000100:00100000:2.0:1788521306.280857:0:13803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:13803:1875400222430848:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788521306.281237:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:2.0:1788521306.282332:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521306.282355:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521306.282604:0:13803:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788521306.282612:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788521306.284282:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788521306.284315:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788521306.284327:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d157b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1582 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521306.284338:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d157b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1582 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521306.328246:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521307.053958:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521307.054644:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201366784 00000100:00100000:3.0:1788521307.054655:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201366784 00000100:00100000:3.0:1788521307.054720:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 363 00000100:00100000:3.0:1788521307.054732:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+11:6169:x1875400201366784:12345-192.168.203.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521307.054748:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521307.054766:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef749cae00/0x411dd0ee4d2d1589 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed5ae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521307.054797:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef749cae00/0x411dd0ee4d2d1589 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5ae expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521307.054809:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef749cae00/0x411dd0ee4d2d1589 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5ae expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521307.054819:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749cae00, rc 0) 00000100:00100000:3.0:1788521307.054875:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+12:6169:x1875400201366784:12345-192.168.203.41@tcp:101:ll_cfg_requeue.0 Request processed in 146us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521307.054908:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 363 00000100:00100000:1.0:1788521307.069956:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521307.072928:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201366912 00000100:00100000:2.0:1788521307.072943:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201366912 00000100:00100000:2.0:1788521307.073013:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 364 00000100:00100000:2.0:1788521307.073023:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+12:6169:x1875400201366912:12345-192.168.203.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521307.073194:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+12:6169:x1875400201366912:12345-192.168.203.41@tcp:501:ll_cfg_requeue.0 Request processed in 171us (3248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521307.073201:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 364 00000100:00100000:2.0:1788521307.077154:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521307.077232:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201367040 00000100:00100000:3.0:1788521307.077240:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201367040 00000100:00100000:3.0:1788521307.077310:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 365 00000100:00100000:3.0:1788521307.077321:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+12:6169:x1875400201367040:12345-192.168.203.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521307.077461:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+12:6169:x1875400201367040:12345-192.168.203.41@tcp:503:ll_cfg_requeue.0 Request processed in 141us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521307.077470:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 365 00000100:00100000:3.0:1788521307.083145:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521307.083650:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201367168 00000100:00100000:0.0:1788521307.083660:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201367168 00000100:00100000:0.0:1788521307.083719:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 366 00000100:00100000:0.0:1788521307.083730:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+12:10811:x1875400201367168:12345-192.168.203.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788521307.083925:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+12:10811:x1875400201367168:12345-192.168.203.41@tcp:502:llog_process_th.0 Request processed in 158us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521307.083934:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 366 00000100:00100000:1.0:1788521307.102936:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521307.103104:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201367296 00000100:00100000:2.0:1788521307.103114:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201367296 00000100:00100000:2.0:1788521307.103168:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 367 00000100:00100000:2.0:1788521307.103179:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+12:10811:x1875400201367296:12345-192.168.203.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788521307.103334:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+12:10811:x1875400201367296:12345-192.168.203.41@tcp:502:llog_process_th.0 Request processed in 156us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521307.103342:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 367 00000100:00100000:2.0:1788521307.115703:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521307.115821:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201367424 00000100:00100000:0.0:1788521307.115920:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201367424 00000100:00100000:0.0:1788521307.115982:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 368 00000100:00100000:0.0:1788521307.115992:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+12:6169:x1875400201367424:12345-192.168.203.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521307.116009:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521307.116027:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fee42410800/0x411dd0ee4d2d1590 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed5b5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521307.116056:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fee42410800/0x411dd0ee4d2d1590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5b5 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521307.116068:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fee42410800/0x411dd0ee4d2d1590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5b5 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521307.116077:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42410800, rc 0) 00000100:00100000:0.0:1788521307.116610:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+13:6169:x1875400201367424:12345-192.168.203.41@tcp:101:ll_cfg_requeue.0 Request processed in 616us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521307.116634:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 368 00000100:00100000:0.0:1788521307.142824:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521307.143020:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201367552 00000100:00100000:3.0:1788521307.143030:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201367552 00000100:00100000:3.0:1788521307.143097:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 369 00000100:00100000:3.0:1788521307.143107:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+13:6169:x1875400201367552:12345-192.168.203.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521307.143242:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+13:6169:x1875400201367552:12345-192.168.203.41@tcp:501:ll_cfg_requeue.0 Request processed in 136us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521307.143250:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 369 00000100:00100000:1.0:1788521307.161571:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521307.161702:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201367680 00000100:00100000:0.0:1788521307.161713:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201367680 00000100:00100000:0.0:1788521307.161775:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 370 00000100:00100000:0.0:1788521307.161785:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+13:6169:x1875400201367680:12345-192.168.203.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521307.161969:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+13:6169:x1875400201367680:12345-192.168.203.41@tcp:503:ll_cfg_requeue.0 Request processed in 185us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521307.161978:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 370 00000100:00100000:1.0:1788521307.172324:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521307.172491:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201367808 00000100:00100000:2.0:1788521307.172500:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201367808 00000100:00100000:2.0:1788521307.172565:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 371 00000100:00100000:2.0:1788521307.172576:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+13:10814:x1875400201367808:12345-192.168.203.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788521307.172934:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+13:10814:x1875400201367808:12345-192.168.203.41@tcp:502:llog_process_th.0 Request processed in 359us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521307.172943:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 371 00000100:00100000:1.0:1788521307.201289:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521307.201563:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201367936 00000100:00100000:3.0:1788521307.201575:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201367936 00000100:00100000:3.0:1788521307.201652:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 372 00000100:00100000:3.0:1788521307.201686:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+13:10814:x1875400201367936:12345-192.168.203.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788521307.202171:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+13:10814:x1875400201367936:12345-192.168.203.41@tcp:502:llog_process_th.0 Request processed in 496us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521307.202180:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 372 00000040:00080000:0.0:1788521307.278679:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788521307.341628:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788521307.346473:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521307.791773:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788521307.791798:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222430976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521307.791914:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521307.792041:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222430976 00000100:00100000:0.0:1788521307.792050:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222430976 00000100:00080000:1.0:1788521307.792081:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521307.792113:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788521307.792124:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222430976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788521307.792157:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521307.792183:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef71521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222431104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788521307.792204:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222430976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521307.792212:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788521307.792227:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521307.792271:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222431104 00000100:00100000:0.0:1788521307.792275:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222431104 00010000:00080000:2.0:1788521307.792288:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43c69c00 x1875400222430976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521307.792307:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222430976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521307.792319:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788521307.792329:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222431104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788521307.792341:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521307.792385:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222431104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521307.792398:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:2.0:1788521307.792537:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef71521f80 x1875400222431104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521307.792552:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef71521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222431104:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788521307.792617:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788521308.366748:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521309.390906:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521310.312233:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521310.312280:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521310.312310:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521310.312354:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521310.312385:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521310.312412:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201368320 00000100:00100000:1.0:1788521310.312421:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521310.312442:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201368320 00000100:00100000:1.0:1788521310.312454:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201368576 00000100:00100000:1.0:1788521310.312463:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201368576 00000100:00100000:1.0:1788521310.312803:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201368192 00000100:00100000:1.0:1788521310.312808:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201368192 00000100:00100000:3.0:1788521310.314629:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201368704 00000100:00100000:3.0:1788521310.314644:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201368704 00000100:00100000:3.0:1788521310.314708:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 242 00000100:00100000:3.0:1788521310.314722:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201368576:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521310.314838:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201368576:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 120us (2528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521310.314848:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 242 00000100:00100000:3.0:1788521310.314871:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 243 00000100:00100000:3.0:1788521310.314929:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201368320:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521310.315360:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 244 00000100:00100000:2.0:1788521310.315385:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201368192:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521310.316730:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201368320:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 1792us (4438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521310.316744:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 243 00000100:00100000:3.0:1788521310.316783:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 245 00000100:00100000:3.0:1788521310.316800:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201368704:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521310.318599:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201368448 00000100:00100000:0.0:1788521310.318614:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201368448 00000100:00100000:0.0:1788521310.318681:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 100 00000100:00100000:0.0:1788521310.318693:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4325a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201368448:12345-192.168.203.41@tcp:400:kworker.0 00000100:00080000:1.0:1788521310.318800:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788521310.318805:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788521310.318807:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788521310.318927:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201368192:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 3553us (6570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521310.318937:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 244 00000100:00100000:2.0:1788521310.318969:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201368064 00000100:00100000:2.0:1788521310.318973:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201368064 00000100:00100000:2.0:1788521310.319002:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 373 00000100:00100000:2.0:1788521310.319008:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2395:x1875400201368064:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521310.319042:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2395:x1875400201368064:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 35us (6820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521310.319049:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 373 00000100:00100000:3.0:1788521310.327723:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201368704:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 10910us (15281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521310.327745:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 245 00000100:00100000:0.0:1788521310.339726:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4325a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201368448:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 21024us (27327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521310.339741:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 100 00000100:00100000:2.0:1788521310.350339:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7ef8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222431232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788521310.350407:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521310.351643:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222431360:0@lo:400:kworker.0 00000100:00100000:2.0:1788521310.351688:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521310.355307:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222431744:0@lo:400:kworker.0 00000100:00100000:0.0:1788521310.355396:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521310.358256:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222431232 00000100:00100000:3.0:1788521310.358270:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222431232 00000100:00100000:3.0:1788521310.358349:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222431744 00000100:00100000:3.0:1788521310.358353:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222431744 00000100:00100000:3.0:1788521310.358373:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788521310.358383:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222431232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788521310.358420:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788521310.358490:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222431232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (8082us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521310.358496:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788521310.358511:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788521310.358517:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222431744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521310.358547:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222431744:12345-0@lo:400:kworker.0 Request processed in 30us (3151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521310.358554:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788521310.358615:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222431488:0@lo:400:kworker.0 00000100:00100000:3.0:1788521310.358669:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521310.365235:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875400222431872:0@lo:400:kworker.0 00000100:00100000:0.0:1788521310.366626:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222431744:0@lo:400:kworker.0 00000100:00100000:0.0:1788521310.366638:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222432256:0@lo:400:kworker.0 00000100:00100000:0.0:1788521310.366688:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521310.366723:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4321ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222432768:0@lo:400:kworker.0 00000100:00100000:0.0:1788521310.366745:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521310.366784:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7ef8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222431232:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788521310.366814:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521310.366820:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222432896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521310.366847:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521310.366904:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222432256 00000100:00100000:0.0:1788521310.366910:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222432256 00000100:00100000:0.0:1788521310.366967:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222432768 00000100:00100000:0.0:1788521310.366970:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222432768 00000100:00100000:0.0:1788521310.366993:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788521310.367001:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222432256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521310.367716:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222432256:12345-0@lo:400:kworker.0 Request processed in 714us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521310.367725:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788521310.367744:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788521310.367751:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43600380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1875400222432768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521310.367778:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43600380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1875400222432768:12345-0@lo:400:kworker.0 Request processed in 29us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521310.367784:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:0.0:1788521310.367822:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43c69c00 x1875400222432256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521310.367832:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222432256:0@lo:400:kworker.0 00000100:00100000:0.0:1788521310.367844:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4321ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222432768:0@lo:400:kworker.0 00000100:00100000:0.0:1788521310.367866:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222432896 00000100:00100000:0.0:1788521310.367869:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222432896 00000100:00100000:0.0:1788521310.367920:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788521310.367928:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43603800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875400222432896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788521310.367948:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521310.367981:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43603800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875400222432896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521310.367987:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788521310.368128:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222432896:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788521310.369269:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521310.369275:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521310.369297:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222431488 00000100:00100000:0.0:1788521310.369303:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222431488 00000100:00100000:2.0:1788521310.369430:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521310.369467:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222431872 00000100:00100000:2.0:1788521310.369470:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222431872 00000100:00100000:2.0:1788521310.369510:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788521310.369518:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875400222431872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521310.369564:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875400222431872:12345-0@lo:400:kworker.0 Request processed in 48us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521310.369584:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:2.0:1788521310.369603:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521310.369617:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222431616:0@lo:400:kworker.0 00000100:00100000:2.0:1788521310.369650:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521310.369672:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222432128:0@lo:400:kworker.0 00000100:00100000:2.0:1788521310.369696:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521310.369714:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4358e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222432640:0@lo:400:kworker.0 00000100:00100000:2.0:1788521310.369733:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521310.369761:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222432128 00000100:00100000:2.0:1788521310.369765:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222432128 00000100:00100000:2.0:1788521310.369791:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222432640 00000100:00100000:2.0:1788521310.369794:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222432640 00000100:00100000:2.0:1788521310.369814:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788521310.369819:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222432128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521310.369852:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222432128:12345-0@lo:400:kworker.0 Request processed in 33us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521310.369858:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788521310.369869:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788521310.369875:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222432640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521310.369929:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222432640:12345-0@lo:400:kworker.0 Request processed in 54us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521310.369935:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:2.0:1788521310.369953:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521310.369955:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521310.369963:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222431616 00000100:00100000:2.0:1788521310.369967:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222431616 00000100:00100000:2.0:1788521310.369998:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788521310.370005:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222431616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521310.370135:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788521310.370142:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222431488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521310.370235:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222431616:12345-0@lo:400:kworker.0 Request processed in 230us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521310.370242:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788521310.370277:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222431616:0@lo:400:kworker.0 00010000:00080000:2.0:1788521310.370290:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43c6b100 x1875400222432128/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521310.370301:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222432128:0@lo:400:kworker.0 00000100:00100000:2.0:1788521310.370311:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4358e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222432640:0@lo:400:kworker.0 00000100:00100000:0.0:1788521310.370431:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222431488:12345-0@lo:400:kworker.0 Request processed in 289us (11761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521310.370438:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788521310.370475:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222431360 00000100:00100000:0.0:1788521310.370479:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222431360 00000100:00100000:2.0:1788521310.370531:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875400222431872:0@lo:400:kworker.0 00000100:00100000:2.0:1788521310.370539:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875400222432384:0@lo:400:kworker.0 00000100:00100000:2.0:1788521310.370563:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521310.370608:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1788521310.370616:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3646:x1875400222431360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521310.370649:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3646:x1875400222431360:12345-0@lo:400:kworker.0 Request processed in 35us (18961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521310.370655:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1788521310.377560:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222432384 00000100:00100000:3.0:1788521310.377585:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222432384 00000100:00100000:3.0:1788521310.377668:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788521310.377679:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875400222432384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521310.377755:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875400222432384:12345-0@lo:400:kworker.0 Request processed in 79us (7191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521310.377762:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788521310.377810:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222431488:0@lo:400:kworker.0 00000100:00100000:3.0:1788521310.377821:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222432000:0@lo:400:kworker.0 00000100:00100000:3.0:1788521310.377854:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521310.377873:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4358d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875400222432512:0@lo:400:kworker.0 00000100:00100000:3.0:1788521310.377911:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521310.377943:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222432000 00000100:00100000:3.0:1788521310.377947:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222432000 00000100:00100000:3.0:1788521310.377970:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222432512 00000100:00100000:3.0:1788521310.377973:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222432512 00000100:00100000:3.0:1788521310.377988:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788521310.377995:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222432000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521310.379653:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222432000:12345-0@lo:400:kworker.0 Request processed in 1651us (1791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521310.379664:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788521310.379696:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788521310.379711:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875400222432512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521310.379759:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875400222432512:12345-0@lo:400:kworker.0 Request processed in 56us (1847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521310.379780:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00010000:00080000:3.0:1788521310.379827:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4358d880 x1875400222432512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521310.379840:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4358d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875400222432512:0@lo:400:kworker.0 00010000:00080000:3.0:1788521310.379871:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43c69180 x1875400222432000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521310.379880:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222432000:0@lo:400:kworker.0 00000100:00100000:3.0:1788521310.379936:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875400222432384:0@lo:400:kworker.0 00000100:00100000:3.0:1788521310.379953:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222431360:0@lo:400:kworker.0 00000100:00080000:0.0:1788521310.382288:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788521310.382298:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788521310.413373:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521310.861952:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222433024:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788521310.862037:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521310.862407:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222433024 00000100:00100000:0.0:1788521310.862416:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222433024 00000100:00100000:0.0:1788521310.862461:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788521310.862470:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee435efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222433024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788521310.862560:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788521310.862781:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee435efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222433024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 311us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521310.862788:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788521310.863648:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43601c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222433024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788521310.864429:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788521310.864473:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222433152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788521310.864557:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521310.865217:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222433152 00000100:00100000:3.0:1788521310.865228:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222433152 00000100:00100000:3.0:1788521310.865314:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788521310.865332:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222433152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788521310.865362:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788521310.865438:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222433152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521310.865446:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788521310.865652:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222433152:0@lo:13:osp-pre-1-1.0 00000001:00080000:2.0:1788521310.866118:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:3.0:1788521311.438705:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521312.462405:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521312.912386:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222433280:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788521312.912500:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521312.912752:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222433280 00000100:00100000:1.0:1788521312.912763:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222433280 00000100:00100000:1.0:1788521312.912837:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788521312.912849:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43600e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222433280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788521312.912916:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521312.912974:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43600e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222433280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 127us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521312.912982:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:0.0:1788521312.913248:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788521312.913290:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef767d2d80 x1875400222433280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521312.913313:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222433280:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788521312.914096:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222433408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521312.914168:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521312.914829:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222433408 00000100:00100000:3.0:1788521312.914839:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222433408 00000100:00100000:3.0:1788521312.915003:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788521312.915014:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222433408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788521312.915040:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788521312.915098:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222433408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521312.915105:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:2.0:1788521312.915614:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788521312.915667:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee435ec000 x1875400222433408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521312.915690:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222433408:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788521313.485350:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521314.509844:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521315.431015:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521315.431675:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201368832 00000100:00100000:2.0:1788521315.431691:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201368832 00000100:00100000:2.0:1788521315.431923:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 375 00000100:00100000:2.0:1788521315.431942:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2395:x1875400201368832:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521315.432044:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2395:x1875400201368832:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 105us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521315.432053:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 375 00000100:00100000:0.0:1788521315.438356:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521315.438400:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521315.438541:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521315.438931:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521315.438963:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521315.439058:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201369088 00000100:00100000:3.0:1788521315.439070:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201369088 00000100:00100000:3.0:1788521315.439143:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201369344 00000100:00100000:3.0:1788521315.439145:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201369344 00000100:00100000:3.0:1788521315.439164:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201368960 00000100:00100000:3.0:1788521315.439166:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201368960 00000100:00100000:3.0:1788521315.439190:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 252 00000100:00100000:3.0:1788521315.439201:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201369088:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521315.439290:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43602d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201369088:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 92us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521315.439297:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 252 00000100:00100000:3.0:1788521315.439316:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 253 00000100:00100000:3.0:1788521315.439323:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201369344:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521315.439345:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201369344:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 23us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521315.439351:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 253 00000100:00100000:3.0:1788521315.439360:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 254 00000100:00100000:3.0:1788521315.439366:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201368960:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521315.439385:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201368960:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 19us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521315.440915:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 254 00000100:00080000:3.0:1788521315.440969:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788521315.440975:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788521315.441417:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201369216 00000100:00100000:0.0:1788521315.441426:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201369216 00000100:00100000:0.0:1788521315.441480:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 105 00000100:00100000:0.0:1788521315.441490:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201369216:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521315.441566:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201369216:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 77us (2635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521315.441572:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 105 00000100:00080000:0.0:1788521315.441618:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788521315.441626:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201369472 00000100:00100000:0.0:1788521315.441630:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201369472 00000100:00100000:0.0:1788521315.441657:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 255 00000100:00100000:0.0:1788521315.441663:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201369472:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521315.441689:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201369472:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 27us (2726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521315.441695:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 255 00000100:00080000:0.0:1788521315.441706:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788521315.470856:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222433536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521315.470969:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521315.471072:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222433536 00000100:00100000:1.0:1788521315.471081:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222433536 00000100:00100000:1.0:1788521315.471151:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788521315.471161:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222433536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521315.471201:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521315.471253:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222433536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521315.471260:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1788521315.471286:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788521315.471329:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1788521315.471335:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fee437c2a00, transno 4294967301 00000100:00100000:1.0:1788521315.471353:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222433536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521315.472150:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222433920:0@lo:400:kworker.0 00000100:00100000:2.0:1788521315.472202:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521315.472233:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875400222434432:0@lo:400:kworker.0 00000100:00100000:2.0:1788521315.472259:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521315.472275:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875400222434944:0@lo:400:kworker.0 00000100:00100000:2.0:1788521315.472304:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521315.472324:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788521315.472330:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875400222433792:0@lo:400:kworker.0 00000100:00100000:2.0:1788521315.472350:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521315.472365:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875400222434304:0@lo:400:kworker.0 00000100:00100000:2.0:1788521315.472390:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521315.472403:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875400222434816:0@lo:400:kworker.0 00000100:00100000:2.0:1788521315.472420:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521315.472464:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222434432 00000100:00100000:2.0:1788521315.472470:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222434432 00000100:00100000:2.0:1788521315.472507:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222434944 00000100:00100000:2.0:1788521315.472509:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222434944 00000100:00100000:2.0:1788521315.472526:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222433792 00000100:00100000:2.0:1788521315.472528:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222433792 00000100:00100000:2.0:1788521315.472553:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222434304 00000100:00100000:2.0:1788521315.472556:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222434304 00000100:00100000:2.0:1788521315.472566:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222434816 00000100:00100000:2.0:1788521315.472568:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222434816 00000100:00100000:2.0:1788521315.472581:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788521315.472588:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875400222434432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521315.472635:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875400222434432:12345-0@lo:400:kworker.0 Request processed in 47us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521315.472642:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788521315.472656:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788521315.472661:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4358d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875400222434944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521315.472685:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4358d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875400222434944:12345-0@lo:400:kworker.0 Request processed in 24us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521315.472691:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788521315.472699:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788521315.472704:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4358e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875400222433792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521315.472725:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4358e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875400222433792:12345-0@lo:400:kworker.0 Request processed in 21us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521315.472731:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788521315.472739:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788521315.472744:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875400222434304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521315.472764:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875400222434304:12345-0@lo:400:kworker.0 Request processed in 20us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521315.472775:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788521315.472785:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788521315.472790:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875400222434816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521315.472826:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875400222434816:12345-0@lo:400:kworker.0 Request processed in 36us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521315.472832:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788521315.472867:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875400222433792:0@lo:400:kworker.0 00000100:00100000:2.0:1788521315.472876:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875400222434304:0@lo:400:kworker.0 00000100:00100000:2.0:1788521315.472915:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875400222434816:0@lo:400:kworker.0 00010000:00080000:2.0:1788521315.472929:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43c68000 x1875400222434432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521315.472940:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875400222434432:0@lo:400:kworker.0 00010000:00080000:2.0:1788521315.472948:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43495500 x1875400222434944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521315.472956:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875400222434944:0@lo:400:kworker.0 00000100:00100000:0.0:1788521315.473143:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222433920 00000100:00100000:0.0:1788521315.473153:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222433920 00000100:00100000:0.0:1788521315.473191:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788521315.473197:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222433920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521315.473241:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222433920:12345-0@lo:400:kworker.0 Request processed in 44us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521315.473247:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788521315.473273:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222433920:0@lo:400:kworker.0 00000100:00100000:3.0:1788521315.473381:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222433664:0@lo:400:kworker.0 00000100:00100000:3.0:1788521315.473422:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521315.473456:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222434176:0@lo:400:kworker.0 00000100:00100000:3.0:1788521315.473477:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521315.473494:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222434688:0@lo:400:kworker.0 00000100:00100000:3.0:1788521315.473514:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521315.473529:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7ef8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222435200:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788521315.473563:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521315.473581:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788521315.473587:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222434048:0@lo:400:kworker.0 00000100:00100000:3.0:1788521315.473606:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521315.473621:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222434560:0@lo:400:kworker.0 00000100:00100000:3.0:1788521315.473653:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521315.473669:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222435072:0@lo:400:kworker.0 00000100:00100000:3.0:1788521315.473688:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521315.473711:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222434176 00000100:00100000:3.0:1788521315.473714:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222434176 00000100:00100000:3.0:1788521315.473733:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222435200 00000100:00100000:3.0:1788521315.473735:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222435200 00000100:00100000:3.0:1788521315.473745:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788521315.473751:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee435edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222434176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521315.473783:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee435edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222434176:12345-0@lo:400:kworker.0 Request processed in 32us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521315.473795:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788521315.474009:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788521315.474017:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee435ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222435200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788521315.474046:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788521315.474078:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee435ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222435200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521315.474084:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788521315.474100:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222434688 00000100:00100000:3.0:1788521315.474104:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222434688 00000100:00100000:3.0:1788521315.474131:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222434560 00000100:00100000:3.0:1788521315.474133:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222434560 00000100:00100000:3.0:1788521315.474144:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222435072 00000100:00100000:3.0:1788521315.474147:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222435072 00000100:00100000:3.0:1788521315.474161:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788521315.474168:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee435ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222434688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521315.474197:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee435ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222434688:12345-0@lo:400:kworker.0 Request processed in 30us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521315.474203:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788521315.474213:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788521315.474218:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee435ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222434560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521315.474242:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee435ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222434560:12345-0@lo:400:kworker.0 Request processed in 24us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521315.474247:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788521315.474256:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788521315.474262:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee435ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222435072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521315.474285:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee435ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222435072:12345-0@lo:400:kworker.0 Request processed in 25us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521315.474508:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222433664 00000100:00100000:0.0:1788521315.474512:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222433664 00000100:00100000:0.0:1788521315.474551:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788521315.474558:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef43042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3644:x1875400222433664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521315.474590:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef43042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3644:x1875400222433664:12345-0@lo:400:kworker.0 Request processed in 34us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521315.474596:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788521315.474655:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222434048 00000100:00100000:0.0:1788521315.474658:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222434048 00000100:00100000:0.0:1788521315.474679:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788521315.474684:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee435ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222434048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521315.474708:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee435ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222434048:12345-0@lo:400:kworker.0 Request processed in 24us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521315.474714:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788521315.474756:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222434048:0@lo:400:kworker.0 00010000:00080000:0.0:1788521315.474769:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43c6a680 x1875400222434560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521315.474780:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222434560:0@lo:400:kworker.0 00000100:00100000:0.0:1788521315.474811:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222435072:0@lo:400:kworker.0 00000100:00100000:0.0:1788521315.474821:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222433664:0@lo:400:kworker.0 00000100:00100000:0.0:1788521315.474831:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222434176:0@lo:400:kworker.0 00010000:00080000:0.0:1788521315.474841:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43494700 x1875400222434688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521315.474849:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222434688:0@lo:400:kworker.0 00000100:00100000:0.0:1788521315.474865:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7ef8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222435200:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788521315.476164:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1788521315.476396:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788521315.476404:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788521315.476425:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788521315.476428:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788521315.533105:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521315.981192:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222435328:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788521315.981270:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222435456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788521315.984276:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521315.984293:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521315.984388:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222435328 00000100:00100000:3.0:1788521315.984402:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222435328 00000100:00100000:3.0:1788521315.984479:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788521315.984494:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222435328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788521315.984554:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788521315.984635:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222435328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521315.984643:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788521315.984822:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222435328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788521315.985572:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222435456 00000100:00100000:1.0:1788521315.985582:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222435456 00000100:00100000:1.0:1788521315.985629:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788521315.985637:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222435456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788521315.985660:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521315.985838:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222435456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 202us (1546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521315.985846:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788521315.985966:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222435456:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788521316.558027:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788521317.524724:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788521317.582599:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788521317.583419:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788521318.029901:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222435584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521318.029998:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521318.030206:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222435584 00000100:00100000:3.0:1788521318.030215:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222435584 00000100:00100000:3.0:1788521318.030284:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788521318.030299:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222435584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788521318.030327:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788521318.030372:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222435584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521318.030379:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:0.0:1788521318.030441:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788521318.031292:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee435ece00 x1875400222435584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521318.031311:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222435584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521318.032426:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222435712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788521318.032483:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521318.032642:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222435712 00000100:00100000:1.0:1788521318.032659:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222435712 00000100:00100000:1.0:1788521318.032723:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788521318.032733:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222435712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788521318.032751:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521318.032799:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222435712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521318.032806:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:1.0:1788521318.032843:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef767d1c00 x1875400222435712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521318.032859:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222435712:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788521318.033140:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788521318.605725:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521319.629213:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521320.550544:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521320.550598:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521320.550650:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521320.550729:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201369856 00000100:00100000:0.0:1788521320.550745:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201369856 00000100:00100000:0.0:1788521320.550829:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201369728 00000100:00100000:0.0:1788521320.550834:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201369728 00000100:00100000:2.0:1788521320.550871:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201369600 00000100:00100000:0.0:1788521320.550936:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 262 00000100:00100000:2.0:1788521320.550943:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201369600 00000100:00100000:0.0:1788521320.550954:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee435edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+5:2393:x1875400201369856:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521320.551006:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 377 00000100:00100000:2.0:1788521320.551018:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4813ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2393:x1875400201369600:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521320.551044:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee435edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+5:2393:x1875400201369856:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 94us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521320.551071:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 262 00000100:00100000:2.0:1788521320.551095:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4813ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2393:x1875400201369600:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 77us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521320.551104:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 263 00000100:00100000:2.0:1788521320.551116:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 377 00000100:00100000:0.0:1788521320.551123:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee435eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+5:2393:x1875400201369728:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521320.551170:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee435eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+5:2393:x1875400201369728:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 52us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521320.551177:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 263 00000100:00080000:3.0:1788521320.551780:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788521320.551787:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788521320.576299:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521320.576366:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521320.576403:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521320.576473:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201370112 00000100:00100000:3.0:1788521320.576591:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201370240 00000100:00100000:3.0:1788521320.576609:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201370240 00000100:00100000:2.0:1788521320.576669:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201369984 00000100:00100000:2.0:1788521320.576681:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201369984 00000100:00100000:3.0:1788521320.576738:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 264 00000100:00100000:2.0:1788521320.576752:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 27 00000100:00100000:3.0:1788521320.576761:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2394:x1875400201370240:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521320.576790:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc75e887-507e-4861-8203-e266d82f5177+5:2392:x1875400201369984:12345-192.168.203.41@tcp:9:kworker.0 00000020:00000080:2.0:1788521320.576824:0:8437:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d14b7 00000100:00080000:2.0:1788521320.576836:0:8437:0:(import.c:65:import_set_state_nolock()) ffff8fef7f061800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788521320.576918:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1788521320.577074:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc75e887-507e-4861-8203-e266d82f5177+2:2392:x1875400201369984:12345-192.168.203.41@tcp:9:kworker.0 Request processed in 294us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521320.577082:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 27 00000100:00080000:0.0:1788521320.577226:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521320.577234:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788521320.577245:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521320.578779:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2394:x1875400201370240:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 2015us (2361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521320.578794:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 264 00000100:00100000:1.0:1788521320.579237:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201370112 00000100:00100000:1.0:1788521320.579455:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 265 00000100:00100000:1.0:1788521320.579466:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2394:x1875400201370112:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521320.579596:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2394:x1875400201370112:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 134us (3230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521320.579604:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 265 00000100:00100000:2.0:1788521320.590433:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222435840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521320.590769:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521320.591365:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222435840 00000100:00100000:1.0:1788521320.591377:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222435840 00000100:00080000:0.0:1788521320.592139:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521320.592146:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521320.593030:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788521320.593030:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222435968:0@lo:400:kworker.0 00000100:00100000:0.0:1788521320.593107:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521320.593143:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222436480:0@lo:400:kworker.0 00000100:00100000:0.0:1788521320.593172:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521320.593181:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222436352:0@lo:400:kworker.0 00000100:00100000:0.0:1788521320.593192:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58342300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222436992:0@lo:400:kworker.0 00000100:00100000:0.0:1788521320.593214:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521320.593215:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521320.593232:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222436864:0@lo:400:kworker.0 00000100:00100000:0.0:1788521320.593237:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222437504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788521320.593253:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521320.593257:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521320.593289:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222435968 00000100:00100000:0.0:1788521320.593296:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222435968 00000100:00100000:0.0:1788521320.593331:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1788521320.593338:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4813d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3646:x1875400222435968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521320.593406:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4813d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3646:x1875400222435968:12345-0@lo:400:kworker.0 Request processed in 67us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521320.593414:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1788521320.593453:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222436480 00000100:00100000:0.0:1788521320.593457:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222436480 00000100:00100000:1.0:1788521320.593468:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222435840:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521320.593483:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222437504 00000100:00100000:0.0:1788521320.593486:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222437504 00000100:00100000:0.0:1788521320.593509:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00002000:00000024:1.0:1788521320.593516:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521320.593516:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222436480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521320.593552:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222436480:12345-0@lo:400:kworker.0 Request processed in 37us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521320.593553:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222435840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 504us (2787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521320.593558:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788521320.593559:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788521320.593569:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788521320.593575:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222437504:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788521320.593586:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222436224:0@lo:400:kworker.0 00000004:00000024:0.0:1788521320.593599:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788521320.593610:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521320.593622:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875400222436736:0@lo:400:kworker.0 00000100:00100000:0.0:1788521320.593627:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222437504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521320.593633:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788521320.593643:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222436224 00000100:00100000:0.0:1788521320.593646:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222436224 00000100:00100000:1.0:1788521320.593657:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521320.593659:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788521320.593664:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222436224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521320.593677:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58342680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875400222437248:0@lo:400:kworker.0 00000100:00100000:1.0:1788521320.593700:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521320.593737:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58343b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222437376:0@lo:400:kworker.0 00000100:00100000:2.0:1788521320.593760:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521320.593805:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222435840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521320.593920:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222436224:12345-0@lo:400:kworker.0 Request processed in 254us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521320.593926:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788521320.594525:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222436992 00000100:00100000:0.0:1788521320.594541:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222436992 00000100:00100000:0.0:1788521320.594578:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222436864 00000100:00100000:0.0:1788521320.594581:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222436864 00000100:00100000:0.0:1788521320.594600:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222437376 00000100:00100000:0.0:1788521320.594602:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222437376 00000100:00100000:0.0:1788521320.594616:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788521320.594624:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222436992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521320.594663:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222436992:12345-0@lo:400:kworker.0 Request processed in 40us (1448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521320.594736:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788521320.594750:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788521320.594756:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43505f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222436864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521320.594793:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43505f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222436864:12345-0@lo:400:kworker.0 Request processed in 38us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521320.594800:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788521320.594810:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788521320.594816:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222437376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521320.594843:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222437376:12345-0@lo:400:kworker.0 Request processed in 28us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521320.594849:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:0.0:1788521320.594880:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521320.594904:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521320.594939:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222437504:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788521320.595028:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222435968:0@lo:400:kworker.0 00000100:00100000:0.0:1788521320.595041:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222436480:0@lo:400:kworker.0 00010000:00080000:0.0:1788521320.595057:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef58342300 x1875400222436992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521320.595077:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58342300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222436992:0@lo:400:kworker.0 00000100:00100000:3.0:1788521320.597321:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222436096:0@lo:400:kworker.0 00010000:00080000:3.0:1788521320.597530:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee435eca80 x1875400222436864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521320.597547:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222436864:0@lo:400:kworker.0 00000100:00100000:3.0:1788521320.597564:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58343b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222437376:0@lo:400:kworker.0 00000100:00100000:1.0:1788521320.599617:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222436224:0@lo:400:kworker.0 00000100:00100000:1.0:1788521320.599798:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521320.615193:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875400222436608:0@lo:400:kworker.0 00000100:00100000:1.0:1788521320.615962:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521320.616475:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222436352 00000100:00100000:2.0:1788521320.616488:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222436352 00000100:00100000:2.0:1788521320.616591:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222436736 00000100:00100000:2.0:1788521320.616595:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222436736 00000100:00100000:2.0:1788521320.616624:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222437248 00000100:00100000:2.0:1788521320.616627:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222437248 00000100:00100000:2.0:1788521320.616659:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222436096 00000100:00100000:2.0:1788521320.616662:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222436096 00000100:00100000:2.0:1788521320.616679:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788521320.616690:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222436352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521320.616788:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222436352:12345-0@lo:400:kworker.0 Request processed in 99us (23571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521320.616796:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788521320.616826:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788521320.616833:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875400222436736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521320.616870:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875400222436736:12345-0@lo:400:kworker.0 Request processed in 38us (23213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521320.617201:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788521320.617216:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788521320.617223:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875400222437248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521320.617281:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875400222437248:12345-0@lo:400:kworker.0 Request processed in 59us (23581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521320.617288:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788521320.617299:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788521320.617305:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222436096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521320.617334:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222436096:12345-0@lo:400:kworker.0 Request processed in 30us (17537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521320.617340:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:2.0:1788521320.617365:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788521320.617542:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222436352:0@lo:400:kworker.0 00010000:00080000:2.0:1788521320.617607:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee435ec000 x1875400222436736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521320.617618:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875400222436736:0@lo:400:kworker.0 00010000:00080000:2.0:1788521320.617630:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef58342680 x1875400222437248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521320.617650:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58342680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875400222437248:0@lo:400:kworker.0 00000100:00100000:2.0:1788521320.637395:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222436608 00000100:00100000:2.0:1788521320.637418:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222436608 00000100:00100000:2.0:1788521320.637550:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788521320.637564:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875400222436608:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788521320.637747:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521320.650633:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875400222436608:12345-0@lo:400:kworker.0 Request processed in 13057us (34658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521320.650653:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788521320.650932:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875400222436608:0@lo:400:kworker.0 00000100:00100000:1.0:1788521320.650951:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58340700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222437120:0@lo:400:kworker.0 00000100:00100000:1.0:1788521320.651006:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521320.651696:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222437120 00000100:00100000:2.0:1788521320.651714:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222437120 00000100:00100000:2.0:1788521320.651808:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788521320.652026:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222436096:0@lo:400:kworker.0 00000100:00080000:0.0:1788521320.652195:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521320.655244:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222437120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521320.655396:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222437120:12345-0@lo:400:kworker.0 Request processed in 187us (4388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521320.655610:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58340700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222437120:0@lo:400:kworker.0 00010000:00010000:0.0:1788521320.657177:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521320.673928:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788521321.101777:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788521321.101817:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222437632:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788521321.101946:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521321.102719:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222437632 00000100:00100000:1.0:1788521321.102733:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222437632 00000100:00100000:1.0:1788521321.102837:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788521321.102853:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43507480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222437632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788521321.102916:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521321.103011:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43507480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222437632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 161us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521321.103018:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788521321.103453:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788521321.103471:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58343b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222437760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788521321.103536:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521321.104100:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222437760 00000100:00100000:0.0:1788521321.104109:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222437760 00000100:00100000:0.0:1788521321.104166:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788521321.104176:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58341f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222437760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788521321.104225:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788521321.104288:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58341f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222437760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521321.104295:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788521321.104356:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222437632:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788521321.108313:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58343b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222437760:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788521321.678963:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521322.701967:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521323.149567:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222437888:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788521323.149673:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521323.149768:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222437888 00000100:00100000:2.0:1788521323.149776:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788521323.149780:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222437888 00000100:00100000:2.0:1788521323.149786:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58343800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222438016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521323.149814:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521323.149858:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222438016 00000100:00100000:3.0:1788521323.149862:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222438016 00000100:00100000:3.0:1788521323.149930:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788521323.149941:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222437888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788521323.149978:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788521323.150032:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222437888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521323.150040:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788521323.150138:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788521323.150146:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222438016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788521323.150178:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788521323.150206:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222438016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521323.150213:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1788521323.150652:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788521323.151207:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef58343800 x1875400222438016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521323.151238:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58343800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222438016:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788521323.151254:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef767d2d80 x1875400222437888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521323.151266:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222437888:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788521323.725102:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521324.749940:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521325.671358:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521325.671483:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521325.671521:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521325.671540:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521325.671565:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521325.671673:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201370624 00000100:00100000:2.0:1788521325.671686:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201370624 00000100:00100000:2.0:1788521325.671761:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201370880 00000100:00100000:2.0:1788521325.671764:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201370880 00000100:00100000:2.0:1788521325.671799:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201370496 00000100:00100000:2.0:1788521325.671803:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201370496 00000100:00100000:2.0:1788521325.671819:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201370752 00000100:00100000:2.0:1788521325.671821:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201370752 00000100:00100000:3.0:1788521325.671843:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 272 00000100:00100000:3.0:1788521325.671866:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201370624:12345-192.168.203.41@tcp:400:kworker.0 00000100:00080000:0.0:1788521325.671878:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788521325.671914:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788521325.671990:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201370624:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 136us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521325.684219:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201370368 00000100:00100000:1.0:1788521325.684240:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201370368 00000100:00100000:1.0:1788521325.684328:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 379 00000100:00100000:1.0:1788521325.684340:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4813f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2395:x1875400201370368:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521325.684436:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4813f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2395:x1875400201370368:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 99us (13092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521325.684445:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 379 00000100:00100000:2.0:1788521325.684733:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 273 00000100:00100000:2.0:1788521325.684750:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee435ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201370880:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521325.684791:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee435ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201370880:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 48us (13270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521325.684798:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 273 00000100:00100000:2.0:1788521325.684818:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 274 00000100:00100000:2.0:1788521325.684826:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee435eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201370496:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521325.684851:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee435eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201370496:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 28us (13310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521325.684858:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 274 00000100:00100000:2.0:1788521325.684871:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 275 00000100:00100000:2.0:1788521325.684878:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee435ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201370752:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521325.684918:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee435ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201370752:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 40us (13351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521325.684924:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 275 00000100:00100000:3.0:1788521325.692269:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 272 00000100:00100000:3.0:1788521325.709346:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58341880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222438400:0@lo:400:kworker.0 00000100:00100000:0.0:1788521325.709644:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58341c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875400222438272:0@lo:400:kworker.0 00000100:00100000:0.0:1788521325.709688:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521325.709715:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58340e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875400222438528:0@lo:400:kworker.0 00000100:00100000:2.0:1788521325.709758:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521325.709775:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58340000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875400222438784:0@lo:400:kworker.0 00000100:00100000:2.0:1788521325.709792:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58341180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222439040:0@lo:400:kworker.0 00000100:00100000:2.0:1788521325.709830:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521325.709842:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521325.709875:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58341500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875400222439296:0@lo:400:kworker.0 00000100:00100000:0.0:1788521325.709916:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521325.709933:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222439808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788521325.709979:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222438272 00000100:00100000:0.0:1788521325.709989:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222438272 00000100:00100000:0.0:1788521325.710058:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222438528 00000100:00100000:0.0:1788521325.710061:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222438528 00000100:00100000:0.0:1788521325.710079:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222438784 00000100:00100000:0.0:1788521325.710081:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222438784 00000100:00100000:0.0:1788521325.710106:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222439296 00000100:00100000:0.0:1788521325.710109:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222439296 00000100:00100000:0.0:1788521325.710124:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788521325.710133:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee435ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875400222438272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521325.710185:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58340380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222439552:0@lo:400:kworker.0 00000100:00100000:0.0:1788521325.710204:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee435ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875400222438272:12345-0@lo:400:kworker.0 Request processed in 70us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521325.710215:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788521325.710221:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521325.710241:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788521325.710250:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875400222438528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521325.710261:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788521325.710270:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222439936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521325.710284:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875400222438528:12345-0@lo:400:kworker.0 Request processed in 34us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521325.710291:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788521325.710304:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521325.710306:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788521325.710314:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee435ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875400222438784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521325.710349:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58340e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875400222438528:0@lo:400:kworker.0 00000100:00100000:0.0:1788521325.710368:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee435ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875400222438784:12345-0@lo:400:kworker.0 Request processed in 53us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521325.710385:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788521325.710387:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222439040 00000100:00100000:2.0:1788521325.710393:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222439040 00000100:00100000:0.0:1788521325.710403:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788521325.710412:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee435eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875400222439296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521325.710427:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222439552 00000100:00100000:2.0:1788521325.710431:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222439552 00000100:00100000:0.0:1788521325.710448:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee435eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875400222439296:12345-0@lo:400:kworker.0 Request processed in 37us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521325.710457:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788521325.710459:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1788521325.710489:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521325.710494:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788521325.710497:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521325.710638:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58342a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222438144:0@lo:400:kworker.0 00000100:00100000:1.0:1788521325.710679:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521325.710708:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58343480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222438656:0@lo:400:kworker.0 00000100:00100000:1.0:1788521325.710739:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222438144 00000100:00100000:1.0:1788521325.710742:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222438144 00000100:00100000:1.0:1788521325.710774:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1788521325.710781:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71ec6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3643:x1875400222438144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521325.710824:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71ec6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3643:x1875400222438144:12345-0@lo:400:kworker.0 Request processed in 44us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521325.710830:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1788521325.711112:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222439040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521325.711116:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521325.711161:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58340a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875400222438912:0@lo:400:kworker.0 00000100:00100000:2.0:1788521325.711175:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222439040:12345-0@lo:400:kworker.0 Request processed in 67us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521325.711199:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521325.711218:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58342d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222439424:0@lo:400:kworker.0 00000100:00100000:3.0:1788521325.711240:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521325.711273:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222439936 00000100:00100000:3.0:1788521325.711278:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222439936 00000100:00100000:3.0:1788521325.711323:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788521325.711393:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788521325.711403:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222439552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521325.711443:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222439552:12345-0@lo:400:kworker.0 Request processed in 43us (1225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521325.711450:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788521325.711481:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222438912 00000100:00100000:0.0:1788521325.711485:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222438912 00000100:00100000:0.0:1788521325.711507:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222439424 00000100:00100000:0.0:1788521325.711510:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222439424 00000100:00100000:0.0:1788521325.711523:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788521325.711530:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875400222438912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521325.712049:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222439936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788521325.712082:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788521325.712132:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222439936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 802us (1828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521325.712140:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788521325.712174:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222438400 00000100:00100000:3.0:1788521325.712179:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222438400 00000100:00100000:3.0:1788521325.712233:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788521325.712240:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222438400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521325.712286:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222438400:12345-0@lo:400:kworker.0 Request processed in 48us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521325.712293:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:3.0:1788521325.712317:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788521325.712322:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788521325.712451:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788521325.712473:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58342680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222439424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521325.712513:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58342680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222439424:12345-0@lo:400:kworker.0 Request processed in 54us (1272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521325.712520:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788521325.712632:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222439936:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788521325.712650:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef58341180 x1875400222439040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521325.712662:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58341180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222439040:0@lo:400:kworker.0 00000100:00100000:1.0:1788521325.712674:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58340380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222439552:0@lo:400:kworker.0 00000100:00100000:0.0:1788521325.713125:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875400222438912:12345-0@lo:400:kworker.0 Request processed in 1593us (1923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521325.713133:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788521325.714064:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521325.714121:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58343100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222439168:0@lo:400:kworker.0 00000100:00100000:3.0:1788521325.714170:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521325.715032:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58343800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222439680:0@lo:400:kworker.0 00000100:00100000:3.0:1788521325.715068:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521325.715131:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58342a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222438144:0@lo:400:kworker.0 00000100:00100000:3.0:1788521325.715164:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521325.715216:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58341c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875400222438272:0@lo:400:kworker.0 00000100:00100000:3.0:1788521325.716031:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58340000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875400222438784:0@lo:400:kworker.0 00000100:00100000:3.0:1788521325.716053:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58341500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875400222439296:0@lo:400:kworker.0 00000100:00100000:3.0:1788521325.716087:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222438656 00000100:00100000:3.0:1788521325.716095:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222438656 00000100:00100000:3.0:1788521325.716163:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222439808 00000100:00100000:3.0:1788521325.716167:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222439808 00000100:00100000:1.0:1788521325.716454:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222439168 00000100:00100000:1.0:1788521325.716459:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222439168 00000100:00100000:1.0:1788521325.716513:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222439680 00000100:00100000:1.0:1788521325.716516:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222439680 00000100:00100000:1.0:1788521325.716533:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788521325.716541:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58340380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222439168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521325.716625:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58340380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222439168:12345-0@lo:400:kworker.0 Request processed in 85us (2454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521325.716633:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788521325.716652:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788521325.716658:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58341180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222439680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521325.716704:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58341180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222439680:12345-0@lo:400:kworker.0 Request processed in 47us (1637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521325.716720:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788521325.721395:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788521325.721433:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222438656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521325.721569:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222438656:12345-0@lo:400:kworker.0 Request processed in 156us (7508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521325.721596:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788521325.721646:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788521325.721655:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222439808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788521325.721690:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788521325.721752:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222439808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (6586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521325.721759:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788521325.721794:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788521325.722146:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58341880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222438400:0@lo:400:kworker.0 00010000:00080000:2.0:1788521325.722169:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef58340a80 x1875400222438912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521325.722180:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58340a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875400222438912:0@lo:400:kworker.0 00010000:00080000:2.0:1788521325.722194:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef58342d80 x1875400222439424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521325.722203:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58342d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222439424:0@lo:400:kworker.0 00000100:00080000:2.0:1788521325.722248:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521325.722278:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58343480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222438656:0@lo:400:kworker.0 00010000:00080000:2.0:1788521325.722308:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef58343100 x1875400222439168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521325.722317:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58343100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222439168:0@lo:400:kworker.0 00000100:00100000:2.0:1788521325.722368:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58343800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222439680:0@lo:400:kworker.0 00000100:00100000:1.0:1788521325.725434:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222439808:0@lo:41:osp-pre-0-1.0 00000001:00100000:2.0:1788521325.726836:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fc75e887-507e-4861-8203-e266d82f5177 00000020:00000080:2.0:1788521325.726845:0:9512:0:(genops.c:885:class_export_put()) final put ffff8fef7f065800/fc75e887-507e-4861-8203-e266d82f5177 00000020:00000080:1.0:1788521325.727201:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef7f065800/fc75e887-507e-4861-8203-e266d82f5177 for lustre-OST0001 00000020:00000080:1.0:1788521325.727276:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fef7f061800 for lustre-OST0001 00010000:00010000:0.0:1788521325.774588:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521326.225171:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521326.225205:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222440064:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788521326.225309:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521326.225873:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58341500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222440192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788521326.225936:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521326.226365:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222440192 00000100:00100000:3.0:1788521326.226376:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222440192 00000100:00100000:3.0:1788521326.226449:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788521326.226471:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee435ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222440192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788521326.226522:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788521326.226611:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee435ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222440192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521326.226620:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788521326.226758:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222440064 00000100:00100000:1.0:1788521326.226763:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222440064 00000100:00100000:1.0:1788521326.226801:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788521326.226809:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee435ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222440064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788521326.226827:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521326.226866:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee435ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222440064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (1557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521326.226873:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788521326.227545:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58341500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222440192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788521326.227588:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222440064:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788521326.799554:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788521327.757590:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788521327.826479:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788521327.829012:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788521328.269117:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222440320:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788521328.269189:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521328.269262:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222440320 00000100:00100000:2.0:1788521328.269269:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222440320 00000100:00100000:2.0:1788521328.269318:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788521328.269329:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222440320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788521328.269357:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521328.269397:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222440320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521328.269404:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:2.0:1788521328.269422:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788521328.269458:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43c6a680 x1875400222440320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521328.269476:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222440320:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788521328.270918:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222440448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521328.270973:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521328.271084:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222440448 00000100:00100000:0.0:1788521328.271092:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222440448 00000100:00100000:0.0:1788521328.271149:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788521328.271158:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222440448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788521328.271178:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521328.271219:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222440448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521328.271226:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:2.0:1788521328.274898:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788521328.274956:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f070000 x1875400222440448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521328.274980:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222440448:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788521328.847512:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521329.871439:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521330.793313:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521330.793365:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521330.793396:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521330.793410:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521330.793439:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521330.793557:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201371008 00000100:00100000:1.0:1788521330.793566:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201371008 00000100:00100000:1.0:1788521330.793615:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 381 00000100:00100000:1.0:1788521330.793624:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71ec7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2396:x1875400201371008:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521330.793686:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71ec7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2396:x1875400201371008:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 64us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521330.793693:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 381 00000100:00100000:1.0:1788521330.793723:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201371264 00000100:00100000:1.0:1788521330.793726:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201371264 00000100:00100000:1.0:1788521330.793752:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201371520 00000100:00100000:1.0:1788521330.793760:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201371520 00000100:00100000:1.0:1788521330.793784:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201371136 00000100:00100000:1.0:1788521330.793786:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201371136 00000100:00100000:1.0:1788521330.793796:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201371392 00000100:00100000:1.0:1788521330.793798:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201371392 00000100:00100000:1.0:1788521330.793810:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 282 00000100:00100000:1.0:1788521330.793815:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+5:2396:x1875400201371264:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521330.793842:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+5:2396:x1875400201371264:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 27us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521330.793847:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 282 00000100:00100000:1.0:1788521330.793858:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 283 00000100:00100000:1.0:1788521330.793863:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f08b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2396:x1875400201371520:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521330.793879:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f08b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2396:x1875400201371520:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 17us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521330.793915:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 283 00000100:00100000:1.0:1788521330.793926:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 284 00000100:00100000:1.0:1788521330.793932:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f08aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+5:2396:x1875400201371136:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521330.795073:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f08aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+5:2396:x1875400201371136:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 1132us (1652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521330.795084:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 284 00000100:00100000:1.0:1788521330.795111:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 285 00000100:00100000:1.0:1788521330.795121:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2396:x1875400201371392:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521330.795156:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2396:x1875400201371392:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 39us (1717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521330.795161:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 285 00000100:00080000:2.0:1788521330.796068:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788521330.796075:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788521330.829584:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222440576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788521330.829677:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521330.829753:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222440576 00000100:00100000:2.0:1788521330.829761:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222440576 00000100:00100000:2.0:1788521330.833629:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788521330.833644:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222440576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788521330.833682:0:10099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788521330.833760:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222440576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (4082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521330.833770:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788521330.833827:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222440576:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788521330.834923:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222440704:0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.834983:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521330.835016:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875400222441216:0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.835042:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521330.835061:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef6e4bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222441728:0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.835081:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521330.835102:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788521330.835108:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f073800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222440832:0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.835131:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521330.835147:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222441344:0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.835166:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521330.835182:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875400222441856:0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.835201:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521330.835230:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222440704 00000100:00100000:0.0:1788521330.835236:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222440704 00000100:00100000:0.0:1788521330.835270:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1788521330.835277:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4875b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3643:x1875400222440704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.835330:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4875b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3643:x1875400222440704:12345-0@lo:400:kworker.0 Request processed in 53us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521330.835336:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1788521330.835364:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222441216 00000100:00100000:0.0:1788521330.835368:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222441216 00000100:00100000:0.0:1788521330.835395:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222441728 00000100:00100000:0.0:1788521330.835398:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222441728 00000100:00100000:0.0:1788521330.835408:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222440832 00000100:00100000:0.0:1788521330.835411:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222440832 00000100:00100000:0.0:1788521330.835419:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222441344 00000100:00100000:0.0:1788521330.835440:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222441344 00000100:00100000:0.0:1788521330.835457:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222441856 00000100:00100000:0.0:1788521330.835459:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222441856 00000100:00100000:0.0:1788521330.835471:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788521330.835477:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875400222441216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.835507:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875400222441216:12345-0@lo:400:kworker.0 Request processed in 30us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521330.835514:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788521330.835525:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788521330.835530:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222441728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.835553:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222441728:12345-0@lo:400:kworker.0 Request processed in 24us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521330.835558:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788521330.835568:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788521330.835573:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222440832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.835595:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222440832:12345-0@lo:400:kworker.0 Request processed in 22us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521330.835599:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788521330.835608:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788521330.835613:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222441344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.835636:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222441344:12345-0@lo:400:kworker.0 Request processed in 24us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521330.835641:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788521330.835650:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788521330.835656:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875400222441856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.835677:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875400222441856:12345-0@lo:400:kworker.0 Request processed in 22us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521330.835690:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788521330.835722:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f072a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222440960:0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.835746:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521330.835763:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222441472:0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.835784:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521330.835800:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222441984:0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.835818:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521330.835837:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788521330.835842:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222441088:0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.835870:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521330.835906:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222441600:0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.835928:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521330.835942:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222442112:0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.835960:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521330.835983:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222441472 00000100:00100000:0.0:1788521330.835987:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222441472 00000100:00100000:0.0:1788521330.836008:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222441984 00000100:00100000:0.0:1788521330.836011:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222441984 00000100:00100000:0.0:1788521330.836023:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222441600 00000100:00100000:0.0:1788521330.836025:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222441600 00000100:00100000:0.0:1788521330.836035:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222442112 00000100:00100000:0.0:1788521330.836037:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222442112 00000100:00100000:0.0:1788521330.836047:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788521330.836052:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222441472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.836086:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222441472:12345-0@lo:400:kworker.0 Request processed in 34us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521330.836102:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788521330.836115:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788521330.836121:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222441984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.836147:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222441984:12345-0@lo:400:kworker.0 Request processed in 27us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521330.836152:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788521330.836162:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788521330.836167:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222441600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.836190:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222441600:12345-0@lo:400:kworker.0 Request processed in 24us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521330.836195:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788521330.836204:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788521330.836211:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222442112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.836235:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222442112:12345-0@lo:400:kworker.0 Request processed in 26us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521330.836240:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788521330.836260:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222441088 00000100:00100000:0.0:1788521330.836263:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222441088 00000100:00100000:0.0:1788521330.836284:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788521330.836290:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222441088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.836318:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222441088:12345-0@lo:400:kworker.0 Request processed in 29us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521330.836323:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788521330.836356:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222441088:0@lo:400:kworker.0 00010000:00080000:0.0:1788521330.836369:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f070000 x1875400222441600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521330.836386:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222441600:0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.836397:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222442112:0@lo:400:kworker.0 00010000:00080000:0.0:1788521330.836407:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f070700 x1875400222441472/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521330.836414:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222441472:0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.836423:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222441984:0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.836470:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f073800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222440832:0@lo:400:kworker.0 00010000:00080000:0.0:1788521330.836480:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f073b80 x1875400222441344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521330.836488:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222441344:0@lo:400:kworker.0 00010000:00080000:0.0:1788521330.836497:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f0c8e00 x1875400222441856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521330.836504:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875400222441856:0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.836512:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222440704:0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.836521:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875400222441216:0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.836531:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef6e4bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222441728:0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.836556:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222440960 00000100:00100000:0.0:1788521330.836559:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222440960 00000100:00100000:0.0:1788521330.836583:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788521330.836589:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222440960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.836627:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222440960:12345-0@lo:400:kworker.0 Request processed in 39us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521330.836633:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788521330.836658:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f072a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222440960:0@lo:400:kworker.0 00000100:00100000:0.0:1788521330.837175:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222442240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521330.837206:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788521330.837397:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521330.837402:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788521330.837405:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788521330.837407:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521330.837425:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222442240 00000100:00100000:2.0:1788521330.837440:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222442240 00000100:00100000:2.0:1788521330.837478:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788521330.837485:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222442240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788521330.837509:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521330.837548:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222442240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521330.837564:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788521330.837600:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222442240:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788521330.898183:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521331.342909:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521331.342940:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef767d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222442368:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788521331.343002:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521331.343256:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222442368 00000100:00100000:1.0:1788521331.343264:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222442368 00000100:00100000:1.0:1788521331.343318:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788521331.343327:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222442368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788521331.343352:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521331.343404:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222442368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521331.343411:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788521331.343470:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef767d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222442368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788521331.343823:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58340000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222442496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788521331.343880:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521331.344153:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222442496 00000100:00100000:3.0:1788521331.344159:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222442496 00000100:00100000:3.0:1788521331.344199:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788521331.344208:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222442496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788521331.344234:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788521331.344273:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222442496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521331.344279:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788521331.344307:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58340000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222442496:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788521331.923462:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788521332.621618:0:14066:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 07:28:50 (1788521330) 00010000:00010000:3.0:1788521332.941363:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521333.389121:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521333.389208:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788521333.389228:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222442752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521333.389353:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521333.389439:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222442752 00000100:00100000:0.0:1788521333.389446:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222442752 00000100:00100000:0.0:1788521333.389496:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788521333.389506:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222442752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788521333.389536:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521333.389577:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222442752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521333.389583:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:0.0:1788521333.389602:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788521333.389650:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f0c8000 x1875400222442752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521333.389670:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222442752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521333.391370:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f08b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222442624:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788521333.391442:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521333.392183:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222442624 00000100:00100000:2.0:1788521333.392191:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222442624 00000100:00080000:0.0:1788521333.392331:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521333.392375:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788521333.392386:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58340000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222442624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788521333.392417:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521333.392478:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58340000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222442624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521333.392484:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:3.0:1788521333.392557:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f08b480 x1875400222442624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521333.392577:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f08b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222442624:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788521333.965707:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521334.823787:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521334.823870:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201371648 00000100:00100000:0.0:1788521334.823934:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201371648 00000100:00100000:0.0:1788521334.824018:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 40 00000100:00100000:0.0:1788521334.824031:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58341c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+5:11103:x1875400201371648:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788521334.824050:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521334.824104:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1597 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed5bc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.824269:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d159e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.824283:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d159e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.824296:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d159e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521334.824351:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788521334.824355:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788521334.824393:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d159e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788521334.824540:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788521334.824696:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1597 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5bc expref: 7 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.824733:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d159e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5bc expref: 6 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.824741:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fee42476700) 00010000:00010000:0.0:1788521334.824745:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788521334.824748:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411e00, rc 0) 00000100:00100000:0.0:1788521334.824878:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58341c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+6:11103:x1875400201371648:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 849us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521334.824931:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 40 00000100:00100000:1.0:1788521334.837510:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521334.837664:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201371776 00000100:00100000:0.0:1788521334.837675:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201371776 00000100:00100000:0.0:1788521334.837738:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 41 00000100:00100000:0.0:1788521334.837748:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee437c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+6:11104:x1875400201371776:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788521334.837767:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521334.837788:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d15a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed5c3 expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.837855:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d15ac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.837870:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d15ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.837909:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d15ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.837926:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d15b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.837934:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d15b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.837941:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d15b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.838047:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410c00/0x411dd0ee4d2d15ba lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.838069:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410c00/0x411dd0ee4d2d15ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.838077:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410c00/0x411dd0ee4d2d15ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521334.838114:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788521334.838117:0:12956:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788521334.838134:0:12956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410c00/0x411dd0ee4d2d15ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.838144:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d15ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.838151:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d15ac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.838158:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d15ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.838163:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42411c00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521334.838168:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d15ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.838177:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d15ac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.838189:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fee42476700) 00010000:00010000:0.0:1788521334.838192:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521334.838197:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d15ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.838213:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d15ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.838227:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d15b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.838233:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d15b3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.838239:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d15b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.838244:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410a00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521334.838247:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d15b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.838253:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d15b3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.838260:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8fee42476400) 00010000:00010000:0.0:1788521334.838263:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521334.838266:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d15b3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.838271:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d15b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.838299:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d15a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5c3 expref: 8 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.838324:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410c00/0x411dd0ee4d2d15ba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5c3 expref: 7 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521334.838331:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8fee42476a00) 00010000:00010000:0.0:1788521334.838334:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788521334.838336:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42410c00, rc 0) 00000100:00100000:0.0:1788521334.838473:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee437c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+7:11104:x1875400201371776:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 725us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521334.838480:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 41 00000100:00100000:2.0:1788521334.862080:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521334.862223:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201371904 00000100:00100000:0.0:1788521334.862232:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201371904 00000100:00100000:0.0:1788521334.862326:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 7 00000100:00100000:0.0:1788521334.862337:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fc75e887-507e-4861-8203-e266d82f5177+7:11104:x1875400201371904:12345-192.168.203.41@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788521334.862473:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fc75e887-507e-4861-8203-e266d82f5177+7:11104:x1875400201371904:12345-192.168.203.41@tcp:900:lhsmtool_posix.0 Request processed in 137us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521334.862480:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 7 00000100:00100000:3.0:1788521334.869745:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521334.869970:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201372160 00000100:00100000:2.0:1788521334.869980:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201372160 00000100:00100000:2.0:1788521334.870050:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 42 00000100:00100000:2.0:1788521334.870060:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58340e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+7:11104:x1875400201372160:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521334.870078:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521334.870408:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d15c1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed5ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521334.870553:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d15c8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521334.870586:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d15c8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521334.870599:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d15c8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521334.870641:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d15cf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521334.870650:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d15cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521334.870657:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d15cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521334.870765:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d15d6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521334.870773:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d15d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521334.870781:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d15d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521334.870790:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788521334.870912:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d15c8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521334.870919:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d15c8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521334.870926:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d15c8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521334.870938:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521334.870943:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d15c8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521334.870950:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d15c8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521334.870962:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8fee42476a00) 00010000:00010000:2.0:1788521334.870965:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521334.870969:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d15c8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521334.870976:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d15c8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521334.870988:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d15cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521334.870995:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d15cf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521334.871001:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d15cf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521334.871006:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521334.871009:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d15cf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521334.871027:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d15cf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521334.871045:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8fee410f5400) 00010000:00010000:2.0:1788521334.871048:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521334.871051:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d15cf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521334.871057:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d15cf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521334.873462:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d15c1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5ca expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521334.873499:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d15d6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5ca expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521334.873508:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fee410f5900) 00010000:00010000:2.0:1788521334.873511:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521334.873514:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7c00, rc 0) 00000100:00100000:2.0:1788521334.873589:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58340e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+9:11104:x1875400201372160:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 3529us (3856us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788521334.873598:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 42 00000100:00100000:1.0:1788521334.879522:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521334.880472:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201372288 00000100:00100000:0.0:1788521334.880484:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201372288 00000100:00100000:0.0:1788521334.880603:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 43 00000100:00100000:0.0:1788521334.880614:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+9:11104:x1875400201372288:12345-192.168.203.41@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788521334.880732:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+9:11104:x1875400201372288:12345-192.168.203.41@tcp:59:lhsmtool_posix.0 Request processed in 120us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521334.880740:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 43 00000100:00100000:3.0:1788521334.885387:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521334.885602:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201372416 00000100:00100000:2.0:1788521334.885612:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201372416 00000100:00080000:0.0:1788521334.885699:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788521334.885744:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 44 00000100:00100000:2.0:1788521334.885756:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58341500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+5:11104:x1875400201372416:12345-192.168.203.41@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1788521334.887820:0:9815:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2022us 00000100:00100000:0.0:1788521334.895644:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58341500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+5:11104:x1875400201372416:12345-192.168.203.41@tcp:59:lhsmtool_posix.0 Request processed in 9879us (10255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521334.895658:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 44 00000040:00080000:0.0:1788521334.925612:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788521334.989100:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788521334.989577:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788521335.915104:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521335.915143:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521335.915171:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521335.915215:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521335.915220:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201372800 00000100:00100000:3.0:1788521335.915238:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201372800 00000100:00100000:2.0:1788521335.915255:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521335.915292:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201373056 00000100:00100000:2.0:1788521335.915301:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201373056 00000100:00100000:3.0:1788521335.915317:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201372672 00000100:00100000:3.0:1788521335.915324:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201372672 00000100:00100000:2.0:1788521335.915351:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201372928 00000100:00100000:2.0:1788521335.915356:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201372928 00000100:00100000:3.0:1788521335.915383:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 292 00000100:00100000:3.0:1788521335.915411:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201372800:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521335.915495:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201372544 00000100:00100000:1.0:1788521335.915501:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201372544 00000100:00100000:3.0:1788521335.915526:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201372800:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 130us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521335.915561:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 293 00000100:00100000:2.0:1788521335.915573:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201373056:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521335.915638:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201373056:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 67us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521335.915645:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 293 00000100:00100000:2.0:1788521335.915664:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 294 00000100:00100000:2.0:1788521335.915669:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f08b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+9:2395:x1875400201372672:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521335.915686:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f08b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+9:2395:x1875400201372672:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 18us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521335.915690:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 294 00000100:00100000:2.0:1788521335.915698:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 295 00000100:00100000:2.0:1788521335.915702:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f089500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201372928:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521335.915713:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f089500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201372928:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 11us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521335.915716:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 295 00000100:00080000:0.0:1788521335.915946:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788521335.915951:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788521335.916000:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 383 00000100:00100000:1.0:1788521335.916010:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef48759050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2395:x1875400201372544:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521335.916038:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef48759050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2395:x1875400201372544:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 31us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521335.916043:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 383 00000100:00100000:3.0:1788521335.923278:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 292 00000100:00100000:1.0:1788521335.949102:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788521335.949129:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222442880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788521335.949228:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f088700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222443392:0@lo:400:kworker.0 00000100:00100000:1.0:1788521335.949253:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521335.949288:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521335.949333:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f08ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222443008:0@lo:400:kworker.0 00000100:00100000:1.0:1788521335.949334:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f08a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222443264:0@lo:400:kworker.0 00000100:00100000:0.0:1788521335.949334:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222443904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521335.949368:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521335.949384:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521335.949406:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58370380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875400222444416:0@lo:400:kworker.0 00000100:00100000:1.0:1788521335.949975:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f08b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222443776:0@lo:400:kworker.0 00000100:00100000:1.0:1788521335.950001:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521335.950094:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222444288:0@lo:400:kworker.0 00000100:00100000:1.0:1788521335.950117:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521335.950533:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222442880 00000100:00100000:1.0:1788521335.950541:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222442880 00000100:00100000:1.0:1788521335.950581:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222443264 00000100:00100000:1.0:1788521335.950584:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222443264 00000100:00100000:1.0:1788521335.950596:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788521335.950603:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875400222442880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788521335.950631:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788521335.950673:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875400222442880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521335.950679:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788521335.950694:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788521335.950698:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222443264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521335.950722:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222443264:12345-0@lo:400:kworker.0 Request processed in 24us (1339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521335.950728:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788521335.950763:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f08a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222443264:0@lo:400:kworker.0 00000100:00100000:1.0:1788521335.950779:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222442880:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788521335.950840:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222443392 00000100:00100000:3.0:1788521335.950845:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222443392 00000100:00100000:3.0:1788521335.951138:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222443776 00000100:00100000:3.0:1788521335.951142:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222443776 00000100:00100000:1.0:1788521335.951200:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222444288 00000100:00100000:1.0:1788521335.951204:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222444288 00000100:00100000:1.0:1788521335.951241:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788521335.951248:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222443392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521335.951283:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222443392:12345-0@lo:400:kworker.0 Request processed in 36us (1998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521335.951289:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788521335.951303:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788521335.951309:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222443776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521335.951337:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222443776:12345-0@lo:400:kworker.0 Request processed in 29us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521335.951343:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788521335.951354:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788521335.951359:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222444288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521335.951385:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222444288:12345-0@lo:400:kworker.0 Request processed in 26us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521335.951400:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00010000:00080000:1.0:1788521335.951428:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f08b480 x1875400222443776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521335.951439:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f08b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222443776:0@lo:400:kworker.0 00000100:00100000:1.0:1788521335.951450:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222444288:0@lo:400:kworker.0 00000100:00100000:3.0:1788521335.952309:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875400222443136:0@lo:400:kworker.0 00000100:00100000:3.0:1788521335.952356:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521335.952381:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f08bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875400222443648:0@lo:400:kworker.0 00000100:00100000:3.0:1788521335.952417:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521335.952445:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58371500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222444160:0@lo:400:kworker.0 00000100:00100000:3.0:1788521335.952470:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521335.952489:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58370700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222444672:0@lo:400:kworker.0 00000100:00100000:3.0:1788521335.952508:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521335.952537:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222443136 00000100:00100000:3.0:1788521335.952543:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222443136 00000100:00100000:3.0:1788521335.952569:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222443648 00000100:00100000:3.0:1788521335.952572:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222443648 00000100:00100000:3.0:1788521335.952587:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788521335.952594:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58343800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875400222443136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521335.952633:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58343800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875400222443136:12345-0@lo:400:kworker.0 Request processed in 40us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521335.952640:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788521335.952665:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1788521335.952672:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58343100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875400222443648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521335.952709:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58343100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875400222443648:12345-0@lo:400:kworker.0 Request processed in 39us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521335.952715:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1788521335.952742:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875400222443136:0@lo:400:kworker.0 00000100:00100000:3.0:1788521335.952750:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f08bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875400222443648:0@lo:400:kworker.0 00000100:00100000:1.0:1788521335.952847:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222443904 00000100:00100000:1.0:1788521335.952852:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222443904 00000100:00100000:1.0:1788521335.952914:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788521335.952921:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222443904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521335.952943:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521335.952975:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222443904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (3607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521335.952986:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788521335.953469:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521335.953549:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222443008 00000100:00100000:2.0:1788521335.953554:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f08a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222443520:0@lo:400:kworker.0 00000100:00100000:1.0:1788521335.953558:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222443008 00000100:00100000:1.0:1788521335.953622:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1788521335.953636:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3645:x1875400222443008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521335.953637:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521335.953701:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58373100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222444032:0@lo:400:kworker.0 00000100:00100000:1.0:1788521335.953701:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3645:x1875400222443008:12345-0@lo:400:kworker.0 Request processed in 69us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521335.953716:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1788521335.953825:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521335.953923:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f088700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222443392:0@lo:400:kworker.0 00000100:00100000:0.0:1788521335.953943:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222443904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521335.955031:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521335.955086:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58372300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222444544:0@lo:400:kworker.0 00000100:00100000:3.0:1788521335.955095:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222444416 00000100:00100000:3.0:1788521335.955108:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222444416 00000100:00100000:2.0:1788521335.955115:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521335.955170:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788521335.955179:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875400222444416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521335.955262:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222444160 00000100:00100000:1.0:1788521335.955266:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222444160 00000100:00100000:1.0:1788521335.955288:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222444672 00000100:00100000:1.0:1788521335.955290:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222444672 00000100:00100000:1.0:1788521335.955300:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222444032 00000100:00100000:1.0:1788521335.955303:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222444032 00000100:00100000:1.0:1788521335.955313:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222444544 00000100:00100000:1.0:1788521335.955315:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222444544 00000100:00100000:1.0:1788521335.955328:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788521335.955334:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58343480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222444160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521335.955408:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f08ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222443008:0@lo:400:kworker.0 00000100:00100000:2.0:1788521335.955460:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222443520 00000100:00100000:2.0:1788521335.955467:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222443520 00000100:00100000:2.0:1788521335.955520:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788521335.955529:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222443520:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788521335.955623:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788521335.955629:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521335.955632:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788521335.955634:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788521335.955649:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788521335.955659:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58342d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222444672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521335.955921:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875400222444416:12345-0@lo:400:kworker.0 Request processed in 743us (2096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521335.955928:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1788521335.956036:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58343480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222444160:12345-0@lo:400:kworker.0 Request processed in 702us (3565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521335.956042:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788521335.956054:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788521335.956058:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58373b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222444032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521335.956091:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58373b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222444032:12345-0@lo:400:kworker.0 Request processed in 25us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521335.956095:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788521335.956103:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788521335.956125:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58371f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222444544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521335.956145:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58371f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222444544:12345-0@lo:400:kworker.0 Request processed in 21us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521335.956148:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:3.0:1788521335.956218:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef58371500 x1875400222444160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521335.956229:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58371500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222444160:0@lo:400:kworker.0 00000100:00100000:0.0:1788521335.958020:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58342d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222444672:12345-0@lo:400:kworker.0 Request processed in 2352us (5499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521335.958036:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788521335.958078:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58370700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222444672:0@lo:400:kworker.0 00010000:00080000:0.0:1788521335.958149:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef58370380 x1875400222444416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521335.958274:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222443520:12345-0@lo:400:kworker.0 Request processed in 2743us (4640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521335.958285:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788521335.958342:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f08a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222443520:0@lo:400:kworker.0 00010000:00080000:2.0:1788521335.958363:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef58373100 x1875400222444032/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521335.958375:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58373100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222444032:0@lo:400:kworker.0 00000100:00100000:2.0:1788521335.958389:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58372300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222444544:0@lo:400:kworker.0 00000100:00100000:0.0:1788521335.961430:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58370380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875400222444416:0@lo:400:kworker.0 00010000:00010000:1.0:1788521336.013112:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521336.462802:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788521336.462824:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58340a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222444800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788521336.462922:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521336.463133:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222444800 00000100:00100000:1.0:1788521336.463142:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222444800 00000100:00100000:1.0:1788521336.463208:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788521336.463217:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222444800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788521336.463251:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788521336.463302:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222444800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521336.463309:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788521336.463353:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58340a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222444800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788521336.464302:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788521336.464315:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58340a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222444928:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788521336.464356:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521336.466814:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222444928 00000100:00100000:3.0:1788521336.466836:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222444928 00000100:00100000:3.0:1788521336.466917:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788521336.466936:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222444928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788521336.466981:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788521336.467073:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222444928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 141us (2710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521336.467080:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788521336.467411:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58340a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222444928:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788521337.040391:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788521337.042819:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788521337.349880:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521337.349991:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201373184 00000100:00100000:2.0:1788521337.350000:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201373184 00000100:00100000:2.0:1788521337.350074:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 45 00000100:00100000:2.0:1788521337.350083:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+9:11146:x1875400201373184:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:2.0:1788521337.350103:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521337.350123:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d15e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed5d1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.350202:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d15eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.350216:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d15eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.350228:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d15eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.350242:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d15f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.350248:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d15f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.350255:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d15f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.350296:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d15eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.350304:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d15eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.350310:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d15eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.350316:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7200 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521337.350320:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d15eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.350337:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d15eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.350350:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fee42476700) 00010000:00010000:2.0:1788521337.350353:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521337.350357:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d15eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.350363:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d15eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.350374:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d15f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.350390:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d15f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.350396:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d15f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.350402:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521337.350404:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d15f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.350411:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d15f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.350418:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8fee410f7100) 00010000:00010000:2.0:1788521337.350421:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521337.350424:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d15f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.350439:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d15f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.350472:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d15e4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5d1 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.350482:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fee42476700) 00010000:00010000:2.0:1788521337.350484:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521337.350488:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d15e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5d1 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.350495:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b6000, rc 0) 00000100:00100000:2.0:1788521337.350767:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+9:11146:x1875400201373184:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 684us (896us total) trans 0 rc 301/301 00000100:00100000:2.0:1788521337.350774:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 45 00000100:00080000:3.0:1788521337.351240:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521337.365974:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521337.368898:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201373440 00000100:00100000:1.0:1788521337.368911:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201373440 00000100:00100000:1.0:1788521337.368970:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 46 00000100:00100000:1.0:1788521337.368979:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58340a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+9:11146:x1875400201373440:12345-192.168.203.41@tcp:36:lfs.0 00010000:00010000:1.0:1788521337.369035:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521337.369063:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d159e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5bc expref: 9 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.369100:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fee42476700) 00010000:00010000:1.0:1788521337.369112:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788521337.369191:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d15f9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.369204:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d15f9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.369214:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d15f9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.369226:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1600 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.369232:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1600 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.369238:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1600 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.369710:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1607 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.369720:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1607 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.369728:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1607 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788521337.369744:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000071358319 reply state 00000000a10073c2 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1607 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.369766:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1607 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.369774:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:1.0:1788521337.369776:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788521337.369779:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788521337.369784:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788521337.369792:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d15f9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.369799:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d15f9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.369805:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d15f9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.369812:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521337.369817:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d15f9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.369824:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d15f9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.369832:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef51db3f00) 00010000:00010000:1.0:1788521337.369835:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521337.369839:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d15f9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.369845:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d15f9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788521337.369870:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000071358319 reply state 00000000a10073c2 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1600 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.369879:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1600 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.369908:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8fef51db3a00) 00010000:00010000:1.0:1788521337.369911:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788521337.369913:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788521337.370002:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58340a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+10:11146:x1875400201373440:12345-192.168.203.41@tcp:36:lfs.0 Request processed in 1023us (4037us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788521337.370009:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 46 00000100:00100000:2.0:1788521337.453067:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521337.453158:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201373568 00000100:00100000:3.0:1788521337.453174:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201373568 00000100:00100000:3.0:1788521337.453368:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 47 00000100:00100000:3.0:1788521337.453391:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58372300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+10:11154:x1875400201373568:12345-192.168.203.41@tcp:101:lctl.0 00010000:00010000:3.0:1788521337.453428:0:9815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521337.453460:0:9815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d160e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed5d8 expref: -99 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.453553:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbe00/0x411dd0ee4d2d1615 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.453571:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbe00/0x411dd0ee4d2d1615 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.453587:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbe00/0x411dd0ee4d2d1615 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521337.453654:0:9815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788521337.453659:0:9815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788521337.454008:0:9815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbe00/0x411dd0ee4d2d1615 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.454041:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d160e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5d8 expref: 12 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.454095:0:9815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbe00/0x411dd0ee4d2d1615 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5d8 expref: 11 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.454104:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef76505500) 00010000:00010000:3.0:1788521337.454107:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788521337.454110:0:9815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749cbe00, rc 0) 00000100:00100000:3.0:1788521337.454231:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58372300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+11:11154:x1875400201373568:12345-192.168.203.41@tcp:101:lctl.0 Request processed in 839us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521337.454242:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 47 00000100:00100000:1.0:1788521337.516590:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521337.516802:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201373696 00000100:00100000:2.0:1788521337.516812:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201373696 00000100:00100000:2.0:1788521337.516873:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 48 00000100:00100000:2.0:1788521337.516915:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+11:11160:x1875400201373696:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:2.0:1788521337.516936:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521337.516960:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d161c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed5df expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.527111:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1623 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.527136:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1623 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.527362:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1623 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.527389:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d162a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.527398:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d162a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.527405:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d162a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.527488:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca000/0x411dd0ee4d2d1631 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.528785:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca000/0x411dd0ee4d2d1631 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.528799:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca000/0x411dd0ee4d2d1631 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521337.528846:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788521337.528850:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788521337.529262:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca000/0x411dd0ee4d2d1631 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.529277:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1623 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.529284:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1623 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.529358:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1623 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.529366:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cbc00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521337.529371:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1623 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.529387:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1623 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.529401:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef76505500) 00010000:00010000:3.0:1788521337.529403:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521337.529408:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1623 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.529430:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1623 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.529446:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d162a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.529452:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d162a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.529458:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d162a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.529463:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cb800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521337.529466:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d162a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.529472:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d162a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.529480:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8fef51db3a00) 00010000:00010000:3.0:1788521337.529483:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521337.529486:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d162a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.529492:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d162a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.531322:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d161c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5df expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.531351:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca000/0x411dd0ee4d2d1631 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5df expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.531375:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:3.0:1788521337.531378:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788521337.531392:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749ca000, rc 0) 00000100:00100000:3.0:1788521337.531471:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+12:11160:x1875400201373696:12345-192.168.203.41@tcp:101:bash.0 Request processed in 14587us (14890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521337.531479:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 48 00000100:00100000:2.0:1788521337.536987:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521337.537630:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201373952 00000100:00100000:1.0:1788521337.537653:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201373952 00000100:00100000:1.0:1788521337.537715:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 49 00000100:00100000:1.0:1788521337.537724:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+12:11160:x1875400201373952:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:1.0:1788521337.537745:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521337.537762:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1638 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed5e6 expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.537851:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d163f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.537865:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d163f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.537876:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d163f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.537955:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1646 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.537963:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1646 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.537970:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1646 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788521337.540398:0:12956:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788521337.543365:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d164d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.543397:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d164d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.543411:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d164d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.543463:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d163f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.543470:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d163f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.543478:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d163f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.543484:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa000 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521337.543488:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d163f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.544363:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d163f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.544392:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:1.0:1788521337.544396:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521337.544402:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d163f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.544408:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d163f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788521337.544426:0:12956:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002989c6cc reply state 0000000097203943 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1646 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.544437:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1646 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.544444:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8fef51db3f00) 00010000:00010000:1.0:1788521337.544446:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788521337.544449:0:12956:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788521337.544499:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1638 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5e6 expref: 15 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.545166:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d164d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5e6 expref: 14 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521337.545176:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef51db3c00) 00010000:00010000:1.0:1788521337.545179:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521337.545181:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434aaa00, rc 0) 00000100:00100000:1.0:1788521337.545286:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+15:11160:x1875400201373952:12345-192.168.203.41@tcp:101:bash.0 Request processed in 7561us (8306us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788521337.545304:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 49 00000100:00100000:2.0:1788521337.555106:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521337.556823:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201374080 00000100:00100000:1.0:1788521337.556837:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201374080 00000100:00100000:1.0:1788521337.556934:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 28 00000100:00100000:1.0:1788521337.556942:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2392:x1875400201374080:12345-192.168.203.41@tcp:8:bash.0 00010000:00080000:1.0:1788521337.556978:0:8436:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from fc75e887-507e-4861-8203-e266d82f5177@192.168.203.41@tcp t0 exp 0000000000000000 cur 387 last 0 00000020:00000080:1.0:1788521337.557009:0:8436:0:(genops.c:1385:class_connect()) connect: client fc75e887-507e-4861-8203-e266d82f5177, cookie 0x411dd0ee4d2d165b 00002000:00100000:1.0:1788521337.557021:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fc75e887-507e-4861-8203-e266d82f5177/ffff8fef7f078800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788521337.557039:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788521337.557112:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788521337.557312:0:8436:0:(import.c:65:import_set_state_nolock()) ffff8fef7f07a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788521337.557392:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+6:2392:x1875400201374080:12345-192.168.203.41@tcp:8:bash.0 Request processed in 448us (2295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521337.557400:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 28 00000100:00100000:2.0:1788521337.560751:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521337.560933:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201374208 00000100:00100000:0.0:1788521337.560949:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201374208 00000100:00100000:2.0:1788521337.561102:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 29 00000100:00100000:2.0:1788521337.561115:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+6:0:x1875400201374208:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:2.0:1788521337.561134:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521337.561168:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5de83ac/0x411dd0ee4d2d1662 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed5ed expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788521337.561193:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788521337.561212:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=387s v=(0 0) 00010000:00010000:2.0:1788521337.561217:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521337.561226:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5de83ac/0x411dd0ee4d2d1662 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5ed expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.561245:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d5de83ac/0x411dd0ee4d2d1662 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5ed expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.561258:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7000, rc 0) 00000100:00100000:2.0:1788521337.561319:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58372a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+7:0:x1875400201374208:12345-192.168.203.41@tcp:101:bash.0 Request processed in 206us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521337.561326:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 29 00000100:00080000:3.0:1788521337.561538:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521337.578418:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521337.580452:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201374336 00000100:00100000:0.0:1788521337.580466:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201374336 00000100:00100000:0.0:1788521337.580528:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 30 00000100:00100000:0.0:1788521337.580539:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+7:11160:x1875400201374336:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:0.0:1788521337.580559:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521337.580580:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002619fa51/0x411dd0ee4d2d1669 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed5f4 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521337.580622:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d5de83ac/0x411dd0ee4d2d1662 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5ed expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521337.580632:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521337.580645:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521337.580651:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002619fa51/0x411dd0ee4d2d1669 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5f4 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521337.580687:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d5de83ac/0x411dd0ee4d2d1662 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5ed expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521337.580811:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d5de83ac/0x411dd0ee4d2d1662 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5ed expref: 8 pid: 8434 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521337.580847:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1875400222445056:192.168.203.41@tcp:104: 00000100:00100000:0.0:1788521337.581023:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef484bb180 going to sleep for 11 seconds 00000100:00100000:0.0:1788521337.594169:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1875400222445056:192.168.203.41@tcp:104: 00010000:00010000:0.0:1788521337.594208:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002619fa51/0x411dd0ee4d2d1669 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5f4 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521337.594231:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42410400, rc 0) 00000100:00100000:0.0:1788521337.594809:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+8:11160:x1875400201374336:12345-192.168.203.41@tcp:101:bash.0 Request processed in 13752us (15881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521337.594820:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 30 00000100:00100000:3.0:1788521337.595657:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521337.595745:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201374464 00000100:00100000:2.0:1788521337.595753:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201374464 00010000:00010000:2.0:1788521337.595788:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d5de83ac/0x411dd0ee4d2d1662 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5ed expref: 8 pid: 8434 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521337.595826:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 52 00000100:00100000:2.0:1788521337.595849:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4e7e1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+8:2396:x1875400201374464:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521337.595862:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521337.595926:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d5de83ac/0x411dd0ee4d2d1662 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5ed expref: 8 pid: 8434 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.595942:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d5de83ac/0x411dd0ee4d2d1662 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5ed expref: 8 pid: 8434 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.595965:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5de83ac/0x411dd0ee4d2d1662 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5ed expref: 8 pid: 8434 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.595980:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521337.595984:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521337.595993:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002619fa51/0x411dd0ee4d2d1669 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5f4 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.596003:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002619fa51/0x411dd0ee4d2d1669 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5f4 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.596036:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002619fa51/0x411dd0ee4d2d1669 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5f4 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521337.596048:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58371c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6506:1875400222445184:192.168.203.41@tcp:105: 00000100:00100000:2.0:1788521337.596129:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef460e69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521337.600777:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58371c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6506:1875400222445184:192.168.203.41@tcp:105: 00010000:00010000:2.0:1788521337.600817:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521337.600873:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4e7e1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+7:2396:x1875400201374464:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 5025us (5217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521337.600982:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 52 00000100:00100000:1.0:1788521337.604215:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521337.605532:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201374720 00000100:00100000:2.0:1788521337.605545:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201374720 00000100:00100000:2.0:1788521337.605603:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 6 00000100:00100000:2.0:1788521337.605614:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+15:11160:x1875400201374720:12345-192.168.203.41@tcp:35:bash.0 00000100:00100000:2.0:1788521337.611487:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+16:11160:x1875400201374720:12345-192.168.203.41@tcp:35:bash.0 Request processed in 5862us (7271us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788521337.611504:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 6 00000100:00100000:1.0:1788521337.745994:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521337.746128:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201374976 00000100:00100000:3.0:1788521337.746138:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201374976 00000100:00100000:3.0:1788521337.746261:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 50 00000100:00100000:3.0:1788521337.746272:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+16:11170:x1875400201374976:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:3.0:1788521337.746296:0:9815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521337.746316:0:9815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1670 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed5fb expref: -99 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521337.746430:0:9815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788521337.746577:0:9815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1670 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5fb expref: 18 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.746876:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef76505500) 00010000:00010000:3.0:1788521337.746880:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788521337.746935:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1670 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5fb expref: 18 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.746963:0:9815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749cb800, rc 0) 00000100:00100000:3.0:1788521337.747125:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+17:11170:x1875400201374976:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 855us (1140us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1788521337.747133:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 50 00000100:00100000:3.0:1788521337.765416:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521337.766177:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201375232 00000100:00100000:2.0:1788521337.766188:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201375232 00000100:00100000:2.0:1788521337.766253:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 7 00000100:00100000:2.0:1788521337.766263:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+17:11170:x1875400201375232:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:2.0:1788521337.766491:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+18:11170:x1875400201375232:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 229us (1082us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788521337.766499:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 7 00000100:00100000:0.0:1788521337.894610:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521337.894727:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201375360 00000100:00100000:3.0:1788521337.894741:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201375360 00000100:00100000:3.0:1788521337.894815:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 51 00000100:00100000:3.0:1788521337.894828:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+18:11176:x1875400201375360:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:3.0:1788521337.894861:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521337.894928:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d167e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed602 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.895028:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1685 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.895048:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1685 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.895062:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1685 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521337.895129:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788521337.895134:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788521337.895165:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1685 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.895196:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d167e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed602 expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.895236:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1685 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed602 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.895246:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:3.0:1788521337.895250:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788521337.895254:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749cbc00, rc 0) 00000100:00100000:3.0:1788521337.895330:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+19:11176:x1875400201375360:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 504us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521337.895338:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 51 00000100:00100000:1.0:1788521337.906343:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521337.906457:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201375616 00000100:00100000:3.0:1788521337.906470:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201375616 00000100:00100000:3.0:1788521337.906543:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 52 00000100:00100000:3.0:1788521337.906554:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+19:11176:x1875400201375616:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:3.0:1788521337.906581:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521337.906606:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d168c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed609 expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.906759:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1693 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.906776:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1693 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.906791:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1693 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521337.906804:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788521337.907008:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d168c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed609 expref: 22 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.907031:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1693 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed609 expref: 21 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.907041:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef51db3c00) 00010000:00010000:3.0:1788521337.907045:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521337.907050:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749ca400, rc 0) 00000100:00100000:3.0:1788521337.907459:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+21:11176:x1875400201375616:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 904us (1127us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788521337.907468:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 52 00000100:00100000:2.0:1788521337.918405:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521337.919122:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201375744 00000100:00100000:0.0:1788521337.919137:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201375744 00000100:00100000:0.0:1788521337.919243:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 3 00000100:00100000:0.0:1788521337.919257:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58371c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+21:2396:x1875400201375744:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521337.919278:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521337.919311:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1693 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed609 expref: 21 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521337.919337:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef51db3c00) 00010000:00010000:0.0:1788521337.919344:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521337.919433:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58371c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+20:2396:x1875400201375744:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 178us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521337.919441:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 3 00000100:00100000:2.0:1788521337.932599:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521337.932738:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201376000 00000100:00100000:3.0:1788521337.932752:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201376000 00000100:00100000:3.0:1788521337.932868:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 53 00000100:00100000:3.0:1788521337.932928:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+20:11176:x1875400201376000:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:3.0:1788521337.932963:0:9815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521337.933001:0:9815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d16a1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed610 expref: -99 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.933861:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d16a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.933917:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d16a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.933935:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d16a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521337.933986:0:9815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788521337.934274:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d16a1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed610 expref: 23 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.934303:0:9815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d16a8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed610 expref: 22 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.934315:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef51db3c00) 00010000:00010000:3.0:1788521337.934318:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788521337.934323:0:9815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749caa00, rc 0) 00000100:00100000:3.0:1788521337.934490:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58371880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+22:11176:x1875400201376000:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 1610us (1904us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788521337.934499:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 53 00000100:00100000:1.0:1788521337.951328:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521337.951447:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201376128 00000100:00100000:2.0:1788521337.951461:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201376128 00000100:00100000:2.0:1788521337.951536:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 31 00000100:00100000:2.0:1788521337.951548:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+7:2395:x1875400201376128:12345-192.168.203.41@tcp:1:lfs.0 00010000:00010000:2.0:1788521337.951603:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d16b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.951644:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002619fa51/0x411dd0ee4d2d1669 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5f4 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.951654:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788521337.951659:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788521337.951665:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d16b6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.953859:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002619fa51/0x411dd0ee4d2d1669 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5f4 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.953906:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002619fa51/0x411dd0ee4d2d1669 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5f4 expref: 7 pid: 8436 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521337.953926:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58370e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8434:1875400222445312:192.168.203.41@tcp:104: 00000100:00100000:2.0:1788521337.954201:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef460e6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521337.962047:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58370e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8434:1875400222445312:192.168.203.41@tcp:104: 00000100:00100000:1.0:1788521337.962431:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:2.0:1788521337.962435:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d16b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521337.962670:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201376256 00000100:00100000:3.0:1788521337.962681:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201376256 00002000:00100000:3.0:1788521337.962953:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8fef7f0e5880 x1875400201376256/t0(0) o4->fc75e887-507e-4861-8203-e266d82f5177@192.168.203.41@tcp:338/0 lens 504/0 e 0 to 0 dl 1788521348 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788521337.962964:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fef7f0e5880 with x1875400201376256 ext(0->12) 00010000:00010000:3.0:1788521337.962973:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002619fa51/0x411dd0ee4d2d1669 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5f4 expref: 8 pid: 8436 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.962990:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002619fa51/0x411dd0ee4d2d1669 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5f4 expref: 8 pid: 8436 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788521337.962998:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8fef7f0e5880 00000100:00100000:3.0:1788521337.963094:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 0 00000100:00100000:3.0:1788521337.963118:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc75e887-507e-4861-8203-e266d82f5177+8:2395:x1875400201376256:12345-192.168.203.41@tcp:4:lfs.0 00000001:00100000:0.0:1788521337.966507:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fc75e887-507e-4861-8203-e266d82f5177 00000100:00100000:3.0:1788521337.969988:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc75e887-507e-4861-8203-e266d82f5177+9:2395:x1875400201376256:12345-192.168.203.41@tcp:4:lfs.0 Request processed in 6862us (7566us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788521337.970003:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 0 00002000:00100000:3.0:1788521337.970016:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8fef7f0e5880 x1875400201376256/t4294967300(0) o4->fc75e887-507e-4861-8203-e266d82f5177@192.168.203.41@tcp:338/0 lens 504/448 e 0 to 0 dl 1788521348 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788521337.970027:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fef7f0e5880 with x1875400201376256 ext(0->12) 00010000:00010000:3.0:1788521337.970039:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002619fa51/0x411dd0ee4d2d1669 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5f4 expref: 9 pid: 8436 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.970059:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002619fa51/0x411dd0ee4d2d1669 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5f4 expref: 9 pid: 8436 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788521337.970066:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8fef7f0e5880 00000100:00100000:0.0:1788521337.972453:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521337.972539:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201376384 00000100:00100000:2.0:1788521337.972549:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201376384 00010000:00010000:2.0:1788521337.972585:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002619fa51/0x411dd0ee4d2d1669 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5f4 expref: 9 pid: 8436 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521337.972681:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 53 00000100:00100000:2.0:1788521337.972690:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+9:2393:x1875400201376384:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521337.972715:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788521337.972734:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788521337.972737:0:6506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788521336 00002000:00010000:2.0:1788521337.972739:0:6506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788521337 00002000:00010000:2.0:1788521337.972741:0:6506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788521336 00002000:00010000:2.0:1788521337.972743:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788521337.972748:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002619fa51/0x411dd0ee4d2d1669 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5f4 expref: 9 pid: 8436 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.972762:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002619fa51/0x411dd0ee4d2d1669 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5f4 expref: 9 pid: 8436 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.972786:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002619fa51/0x411dd0ee4d2d1669 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5f4 expref: 9 pid: 8436 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.972804:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788521337.972808:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788521337.972815:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d16b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.972825:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d16b6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521337.972968:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521337.973016:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+8:2393:x1875400201376384:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 326us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521337.973023:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 53 00010000:00010000:3.0:1788521337.976007:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d16b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.976028:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d16b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.976061:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d16b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.976070:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d16b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.976102:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d16b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.976109:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7800 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:3.0:1788521337.976113:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d16b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.976121:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d16b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.976780:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d16b6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521337.976792:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d16b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521337.983277:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+7:2395:x1875400201376128:12345-192.168.203.41@tcp:1:lfs.0 Request processed in 31720us (31952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521337.983292:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 31 00000040:00080000:2.0:1788521337.998668:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788521337.999319:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521337.999846:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201376640 00000100:00100000:2.0:1788521337.999866:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201376640 00000100:00100000:2.0:1788521337.999939:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 8 00000100:00100000:2.0:1788521337.999950:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6e4bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+22:11176:x1875400201376640:12345-192.168.203.41@tcp:35:lfs.0 00000004:00010000:2.0:1788521338.000011:0:6522:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d16a8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed610 expref: 22 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521338.000476:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1788521338.000525:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788521338.000800:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1788521338.000838:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d16bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.000868:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d164d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5e6 expref: 26 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.000877:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d16bd lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.000935:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d164d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5e6 expref: 26 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.000959:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d164d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5e6 expref: 26 pid: 12956 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521338.000973:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58370e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6522:1875400222445440:192.168.203.41@tcp:104: 00000100:00100000:2.0:1788521338.001673:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521338.013500:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521338.013781:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201376768 00000100:00100000:3.0:1788521338.013803:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201376768 00010000:00010000:3.0:1788521338.013843:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d164d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5e6 expref: 27 pid: 12956 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521338.013917:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 54 00000100:00100000:3.0:1788521338.013927:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58373480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+27:2395:x1875400201376768:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521338.013940:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521338.013947:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d164d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5e6 expref: 27 pid: 12956 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521338.013971:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d164d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5e6 expref: 27 pid: 12956 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521338.013993:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef51db3c00) 00010000:00010000:3.0:1788521338.013998:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d16bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521338.014007:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d16bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521338.014013:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d16bd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521338.014031:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521338.014077:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58373480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+27:2395:x1875400201376768:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 151us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521338.014084:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 54 00010000:00010000:0.0:1788521338.014692:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d164d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5e6 expref: 26 pid: 12956 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521338.014709:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58370e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6522:1875400222445440:192.168.203.41@tcp:104: 00010000:00010000:0.0:1788521338.014729:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d16bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521338.014739:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d16bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521338.014745:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d16bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788521338.014872:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1788521338.015033:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1788521338.015120:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f072a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1875400222445568:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788521338.015399:0:6522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521338.015432:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef74a80b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788521338.015533:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222445568 00000100:00100000:2.0:1788521338.015540:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222445568 00000100:00100000:2.0:1788521338.015598:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788521338.015607:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1875400222445568:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788521338.015695:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1875400222445568:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 89us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521338.015703:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:3.0:1788521338.016102:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521338.016199:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f072a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1875400222445568:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788521338.016598:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1788521338.016686:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58370000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1875400222445696:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788521338.016741:0:6522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521338.016771:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5a240 going to sleep for 11 seconds 00000100:00100000:3.0:1788521338.017003:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222445696 00000100:00100000:3.0:1788521338.017009:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222445696 00000100:00100000:3.0:1788521338.017050:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788521338.017058:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58370a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6522:x1875400222445696:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788521338.017197:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58370a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6522:x1875400222445696:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 138us (455us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788521338.017204:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788521338.017363:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58370000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1875400222445696:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788521338.017417:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1788521338.017451:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d16bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521338.017460:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d16bd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521338.017480:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d16bd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521338.017486:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521338.017490:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d16bd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521338.017498:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d16bd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521338.017512:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef51db3c00) 00010000:00010000:0.0:1788521338.017515:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788521338.017521:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d16bd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521338.017527:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d16bd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788521338.017616:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788521338.017678:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788521338.017689:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 388083804498ns, next at 389083802334ns, rc = 0 00000001:00080000:0.0:1788521338.017695:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1788521338.017716:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef51db3c00) 00010000:00010000:0.0:1788521338.017719:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788521338.017726:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d16a8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed610 expref: 30 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521338.017862:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6e4bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+29:11176:x1875400201376640:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 17913us (18547us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1788521338.017880:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 8 00000020:00080000:0.0:1788521338.017907:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788521338.032907:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521338.033092:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201376896 00000100:00100000:3.0:1788521338.033103:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201376896 00000100:00100000:3.0:1788521338.033156:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 54 00000100:00100000:3.0:1788521338.033180:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58371180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+29:11176:x1875400201376896:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:3.0:1788521338.033205:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521338.033229:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d16c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed617 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521338.033284:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d16c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed617 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521338.033299:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d16c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed617 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521338.033318:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:3.0:1788521338.033320:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788521338.033324:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749cb800, rc 0) 00000100:00100000:3.0:1788521338.033386:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58371180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+30:11176:x1875400201376896:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 199us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521338.033393:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 54 00000100:00100000:1.0:1788521338.039830:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521338.039938:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201377152 00000100:00100000:0.0:1788521338.039948:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201377152 00000100:00100000:0.0:1788521338.040010:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 9 00000100:00100000:0.0:1788521338.040020:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6d4aa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+30:11176:x1875400201377152:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:0.0:1788521338.040248:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6d4aa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+31:11176:x1875400201377152:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 230us (427us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788521338.040255:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 9 00010000:00010000:3.0:1788521338.061330:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521338.165598:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521338.165710:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201377408 00000100:00100000:1.0:1788521338.166153:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201377408 00000100:00100000:1.0:1788521338.166216:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 55 00000100:00100000:1.0:1788521338.166283:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58370e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+31:11187:x1875400201377408:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:1.0:1788521338.166308:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521338.166329:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d16cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed61e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521338.166431:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788521338.166526:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d16cb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed61e expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.166541:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef76505500) 00010000:00010000:1.0:1788521338.166543:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788521338.166549:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d16cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed61e expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.166562:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434aa600, rc 0) 00000100:00100000:1.0:1788521338.166691:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58370e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+32:11187:x1875400201377408:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 411us (1100us total) trans 4294967329 rc 301/301 00000100:00100000:1.0:1788521338.166698:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 55 00000100:00100000:1.0:1788521338.182519:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521338.182765:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201377536 00000100:00100000:3.0:1788521338.182775:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201377536 00000100:00100000:3.0:1788521338.182842:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 56 00000100:00100000:3.0:1788521338.182862:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+32:11187:x1875400201377536:12345-192.168.203.41@tcp:34:lfs.0 00010000:00010000:3.0:1788521338.182965:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d16d9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521338.182983:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d16d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521338.183012:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d16d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521338.183040:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d16e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521338.183048:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d16e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521338.183055:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d16e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521338.183128:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d16e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521338.183638:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d16e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521338.183650:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d16e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788521338.183774:0:9815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d16e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.183799:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d16d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.183806:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d16d9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.183821:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d16d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.183827:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749ca200 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521338.183831:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d16d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.183839:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d16d9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.183859:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:2.0:1788521338.183863:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521338.183867:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d16d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.183874:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d16d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.183909:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d16e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.183917:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d16e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.183922:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d16e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.183927:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cb600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521338.183930:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d16e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.183947:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d16e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.183956:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8fef51db3f00) 00010000:00010000:2.0:1788521338.183958:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521338.183962:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d16e0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.183968:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d16e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.183977:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d16e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.183983:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d16e7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.183989:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d16e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.183994:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cb400 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521338.183996:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d16e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.184001:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d16e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.184008:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:2.0:1788521338.184010:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521338.184028:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d16e7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.184045:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d16e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521338.184124:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+32:11187:x1875400201377536:12345-192.168.203.41@tcp:34:lfs.0 Request processed in 1272us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521338.184132:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 56 00000100:00100000:3.0:1788521338.196447:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521338.197154:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201377792 00000100:00100000:0.0:1788521338.197165:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201377792 00000100:00100000:2.0:1788521338.197365:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 10 00000100:00100000:2.0:1788521338.197388:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+32:11187:x1875400201377792:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:2.0:1788521338.197617:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+33:11187:x1875400201377792:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 242us (1397us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788521338.197624:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 10 00000100:00100000:0.0:1788521338.236592:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521338.236683:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201378048 00000100:00100000:1.0:1788521338.236693:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201378048 00000100:00100000:1.0:1788521338.236763:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 57 00000100:00100000:1.0:1788521338.236774:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+33:11190:x1875400201378048:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:1.0:1788521338.236978:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521338.237000:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d16ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed625 expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.237222:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d16f5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.237236:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d16f5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.237247:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d16f5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.237258:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d16fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.237264:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d16fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.237269:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d16fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.237373:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1703 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.237392:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1703 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.237399:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1703 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521338.237410:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788521338.237487:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d16f5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.237504:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d16f5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.237510:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d16f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.237516:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa000 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521338.237520:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d16f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.237527:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d16f5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.237540:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:1.0:1788521338.237543:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521338.237548:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d16f5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.237555:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d16f5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.237569:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d16fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.237575:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d16fc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.237581:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d16fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.237587:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aaa00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521338.237596:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d16fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.237603:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d16fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.237611:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8fef51db3f00) 00010000:00010000:1.0:1788521338.237614:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521338.237617:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d16fc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.237622:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d16fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.237662:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d16ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed625 expref: 36 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.237675:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1703 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed625 expref: 35 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.237682:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:1.0:1788521338.237685:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521338.237687:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434aa800, rc 0) 00000100:00100000:1.0:1788521338.238296:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+35:11190:x1875400201378048:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 1521us (1712us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788521338.238304:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 57 00000100:00100000:1.0:1788521338.241760:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521338.241910:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201378176 00000100:00100000:2.0:1788521338.241919:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201378176 00000100:00100000:2.0:1788521338.241972:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 58 00000100:00100000:2.0:1788521338.241983:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+35:11190:x1875400201378176:12345-192.168.203.41@tcp:54:lfs.0 00010000:00010000:2.0:1788521338.242060:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1711 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.242076:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1711 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.242087:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1711 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.242120:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1711 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.242127:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1711 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.242159:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1711 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.242164:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6000 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521338.242168:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1711 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.242176:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1711 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.242188:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:2.0:1788521338.242191:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521338.242196:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1711 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.242202:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1711 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521338.242265:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+35:11190:x1875400201378176:12345-192.168.203.41@tcp:54:lfs.0 Request processed in 283us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521338.242272:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 58 00000100:00100000:3.0:1788521338.244293:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521338.244372:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201378432 00000100:00100000:2.0:1788521338.244390:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201378432 00000100:00100000:2.0:1788521338.244450:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 11 00000100:00100000:2.0:1788521338.244459:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+35:11190:x1875400201378432:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:2.0:1788521338.244675:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+36:11190:x1875400201378432:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 217us (388us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788521338.244683:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 11 00000100:00100000:2.0:1788521338.509285:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222445824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521338.509353:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521338.510053:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222445824 00000100:00100000:1.0:1788521338.510062:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222445824 00000100:00100000:1.0:1788521338.510112:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788521338.510130:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58370380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875400222445824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788521338.510159:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521338.510221:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58370380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875400222445824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521338.510227:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788521338.510319:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222445824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521338.510828:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521338.510839:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222445952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788521338.510873:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521338.510987:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222445952 00000100:00100000:2.0:1788521338.510993:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222445952 00000100:00100000:2.0:1788521338.511038:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788521338.511046:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222445952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788521338.511060:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521338.511108:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222445952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521338.511114:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788521338.511238:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222445952:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788521338.511493:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521338.605564:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521338.605657:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201378688 00000100:00100000:2.0:1788521338.605666:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201378688 00000100:00100000:2.0:1788521338.605726:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 59 00000100:00100000:2.0:1788521338.605736:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+36:11221:x1875400201378688:12345-192.168.203.41@tcp:101:cat.0 00010000:00010000:2.0:1788521338.605759:0:9815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521338.605780:0:9815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1718 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed62c expref: -99 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.605920:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d171f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.605935:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d171f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.605947:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d171f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521338.605960:0:9815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788521338.606092:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1718 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed62c expref: 39 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.606123:0:9815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d171f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed62c expref: 38 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.606131:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:2.0:1788521338.606134:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521338.606138:0:9815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7200, rc 0) 00000100:00100000:2.0:1788521338.606196:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+38:11221:x1875400201378688:12345-192.168.203.41@tcp:101:cat.0 Request processed in 461us (640us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788521338.606203:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 59 00000100:00100000:1.0:1788521338.612405:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521338.612448:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521338.612554:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201378944 00000100:00100000:2.0:1788521338.612563:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201378944 00000100:00100000:2.0:1788521338.612623:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 12 00000100:00100000:2.0:1788521338.612634:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+38:11221:x1875400201378944:12345-192.168.203.41@tcp:35:cat.0 00000100:00100000:2.0:1788521338.612915:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+39:11221:x1875400201378944:12345-192.168.203.41@tcp:35:cat.0 Request processed in 282us (518us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1788521338.612922:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 12 00000100:00100000:0.0:1788521338.613057:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201379072 00000100:00100000:0.0:1788521338.613061:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201379072 00000100:00100000:0.0:1788521338.613117:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 4 00000100:00100000:0.0:1788521338.613125:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+39:2393:x1875400201379072:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521338.613843:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521338.613870:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d171f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed62c expref: 39 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521338.613938:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:0.0:1788521338.613943:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521338.613982:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+38:2393:x1875400201379072:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 856us (1532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521338.613989:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 4 00000100:00100000:1.0:1788521338.706542:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521338.706964:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201379328 00000100:00100000:3.0:1788521338.706975:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201379328 00000100:00100000:3.0:1788521338.707042:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 60 00000100:00100000:3.0:1788521338.707053:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+38:11227:x1875400201379328:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:3.0:1788521338.707076:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521338.707079:0:12956:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788521338.707121:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1685 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed602 expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521338.707148:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:3.0:1788521338.707154:0:12956:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788521338.707167:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d172d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed633 expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521338.707629:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d1734 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521338.707644:0:12956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1703 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed625 expref: 38 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521338.707651:0:12956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d1734 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521338.707681:0:12956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1703 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed625 expref: 38 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521338.707795:0:12956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1703 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed625 expref: 38 pid: 12956 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521338.707808:0:12956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58375f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12956:1875400222446080:192.168.203.41@tcp:104: 00000100:00100000:3.0:1788521338.708118:0:12956:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee434c6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788521338.715553:0:12956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58375f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12956:1875400222446080:192.168.203.41@tcp:104: 00010000:00010000:3.0:1788521338.715595:0:12956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d1734 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521338.717866:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521338.718038:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201379456 00000100:00100000:0.0:1788521338.718047:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201379456 00010000:00010000:0.0:1788521338.718088:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1703 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed625 expref: 39 pid: 12956 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521338.718118:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 55 00000100:00100000:0.0:1788521338.718127:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58370700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+39:2396:x1875400201379456:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521338.718141:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521338.718147:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1703 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed625 expref: 39 pid: 12956 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521338.718160:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1703 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed625 expref: 39 pid: 12956 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521338.718182:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1703 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed625 expref: 39 pid: 12956 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521338.718199:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:0.0:1788521338.718204:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d1734 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521338.718241:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d1734 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521338.718248:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d1734 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521338.718281:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521338.718332:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58370700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+38:2396:x1875400201379456:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 205us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521338.718339:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 55 00010000:00010000:3.0:1788521338.718465:0:12956:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d1734 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521338.718474:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d1734 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521338.718493:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788521338.718656:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d172d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed633 expref: 39 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521338.718673:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d1734 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed633 expref: 38 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521338.718680:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:3.0:1788521338.718682:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788521338.718684:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749cb400, rc 0) 00000100:00100000:3.0:1788521338.718723:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+38:11227:x1875400201379328:12345-192.168.203.41@tcp:101:dd.0 Request processed in 11672us (12191us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1788521338.718730:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 60 00000100:00100000:2.0:1788521338.726703:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521338.730527:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201379584 00000100:00100000:1.0:1788521338.730542:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201379584 00000100:00100000:1.0:1788521338.730718:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 61 00000100:00100000:1.0:1788521338.730729:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58371500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+38:11227:x1875400201379584:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1788521338.730755:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521338.730776:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1742 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed63a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.730820:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1749 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.730836:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1749 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.730847:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1749 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.730986:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1742 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed63a expref: 40 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.731004:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1749 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed63a expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521338.731017:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:1.0:1788521338.731020:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788521338.731024:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434aa000, rc 0) 00000100:00100000:1.0:1788521338.731092:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58371500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+39:11227:x1875400201379584:12345-192.168.203.41@tcp:101:dd.0 Request processed in 365us (4398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521338.731098:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 61 00000100:00100000:0.0:1788521338.735556:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521338.739027:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201379840 00000100:00100000:2.0:1788521338.739042:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201379840 00000100:00100000:2.0:1788521338.739107:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 62 00000100:00100000:2.0:1788521338.739117:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+39:11227:x1875400201379840:12345-192.168.203.41@tcp:36:dd.0 00010000:00010000:2.0:1788521338.739491:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1750 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.739526:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1750 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.739537:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1750 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521338.739637:0:9815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1788521338.739658:0:9815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3f20a09 reply state 00000000f35ac917 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1750 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.739669:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1750 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521338.739676:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:2.0:1788521338.739679:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788521338.739681:0:9815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788521338.739992:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+42:11227:x1875400201379840:12345-192.168.203.41@tcp:36:dd.0 Request processed in 875us (4444us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1788521338.740000:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 62 00000020:00080000:2.0:1788521338.740005:0:9815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788521339.085259:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521339.228013:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521339.228786:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201379968 00000100:00100000:1.0:1788521339.228799:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201379968 00000100:00100000:1.0:1788521339.228934:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 63 00000100:00100000:1.0:1788521339.228945:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+42:11241:x1875400201379968:12345-192.168.203.41@tcp:101:stat.0 00010000:00010000:1.0:1788521339.228968:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521339.228989:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1757 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed641 expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.229054:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d175e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.229068:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d175e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.229081:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d175e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.229091:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1765 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.229098:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1765 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.229137:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1765 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.229207:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d176c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.229229:0:12956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d1734 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed633 expref: 43 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.229239:0:12956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d176c lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.229274:0:12956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d1734 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed633 expref: 43 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.229298:0:12956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d1734 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed633 expref: 43 pid: 12956 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521339.229313:0:12956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0e5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12956:1875400222446208:192.168.203.41@tcp:104: 00000100:00100000:1.0:1788521339.229425:0:12956:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef41532f00 going to sleep for 11 seconds 00000100:00080000:3.0:1788521339.229973:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521339.235181:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521339.235274:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201380224 00000100:00100000:2.0:1788521339.235283:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201380224 00000100:00100000:2.0:1788521339.235346:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 13 00000100:00100000:2.0:1788521339.235357:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+44:6167:x1875400201380224:12345-192.168.203.41@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788521339.236104:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+45:6167:x1875400201380224:12345-192.168.203.41@tcp:35:ldlm_bl.0 Request processed in 746us (930us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788521339.236113:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 13 00000100:00100000:1.0:1788521339.236485:0:12956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0e5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12956:1875400222446208:192.168.203.41@tcp:104: 00010000:00010000:1.0:1788521339.236528:0:12956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d176c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521339.243107:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521339.243263:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201380352 00000100:00100000:2.0:1788521339.243284:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201380352 00010000:00010000:2.0:1788521339.243327:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d1734 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed633 expref: 45 pid: 12956 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521339.243377:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 56 00000100:00100000:2.0:1788521339.243388:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f070000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+45:2396:x1875400201380352:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521339.243402:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521339.243409:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d1734 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed633 expref: 45 pid: 12956 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521339.243422:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d1734 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed633 expref: 45 pid: 12956 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521339.243443:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d1734 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed633 expref: 45 pid: 12956 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521339.243459:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:2.0:1788521339.243464:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d176c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521339.243474:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d176c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521339.243483:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d176c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521339.243517:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521339.243571:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f070000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+44:2396:x1875400201380352:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 185us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521339.243587:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 56 00010000:00010000:1.0:1788521339.244038:0:12956:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d176c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.244047:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d176c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521339.244111:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788521339.244127:0:12956:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788521339.244168:0:12956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d176c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.244183:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d176c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.244193:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d175e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.244200:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d175e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.244206:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d175e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.244212:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434abe00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521339.244226:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d175e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.244234:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d175e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.244245:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:1.0:1788521339.244248:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521339.244252:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d175e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.244258:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d175e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.244280:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1765 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.244286:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1765 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.244292:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1765 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.244298:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aba00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521339.244301:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1765 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.244307:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1765 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.244316:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8fef51db3f00) 00010000:00010000:1.0:1788521339.244319:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521339.244322:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1765 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.244328:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1765 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.244359:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1757 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed641 expref: 44 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.244383:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d176c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed641 expref: 43 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.244399:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:1.0:1788521339.244401:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521339.244404:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434aa800, rc 0) 00000100:00100000:1.0:1788521339.244436:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+43:11241:x1875400201379968:12345-192.168.203.41@tcp:101:stat.0 Request processed in 15493us (16438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521339.244443:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 63 00000100:00100000:3.0:1788521339.354858:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521339.355398:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201380608 00000100:00100000:2.0:1788521339.355414:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201380608 00000100:00100000:2.0:1788521339.355648:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 64 00000100:00100000:2.0:1788521339.355661:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+43:11247:x1875400201380608:12345-192.168.203.41@tcp:36:truncate.0 00010000:00010000:2.0:1788521339.355731:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521339.355766:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d176c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed641 expref: 43 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521339.355786:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:2.0:1788521339.355791:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521339.356040:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1773 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521339.356056:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1773 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521339.356067:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1773 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521339.356110:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1788521339.356148:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064f4f2f6 reply state 000000007cfe9593 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1773 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521339.356160:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1773 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521339.356166:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:2.0:1788521339.356168:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788521339.356177:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788521339.356310:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+45:11247:x1875400201380608:12345-192.168.203.41@tcp:36:truncate.0 Request processed in 651us (1466us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788521339.356317:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 64 00000020:00080000:2.0:1788521339.356322:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788521339.578395:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521339.580064:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201380736 00000100:00100000:0.0:1788521339.580078:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201380736 00000100:00100000:0.0:1788521339.580163:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 65 00000100:00100000:0.0:1788521339.580174:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+45:11261:x1875400201380736:12345-192.168.203.41@tcp:101:stat.0 00010000:00010000:0.0:1788521339.580199:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521339.580231:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d177a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed648 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521339.580295:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1781 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521339.580309:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1781 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521339.580357:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1781 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521339.580393:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1788 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521339.580401:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1788 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521339.580408:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1788 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521339.580497:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d178f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521339.580506:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d178f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521339.580512:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d178f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521339.580551:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788521339.580555:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788521339.580577:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d178f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521339.580590:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d178f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521339.580597:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1781 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521339.580604:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1781 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521339.580620:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1781 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521339.580625:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42411800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521339.580630:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1781 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521339.580637:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1781 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521339.580648:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:0.0:1788521339.580651:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521339.580656:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1781 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521339.580662:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1781 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521339.580676:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1788 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521339.580682:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1788 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521339.580688:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1788 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521339.580692:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42411e00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521339.580695:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1788 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521339.580711:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1788 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521339.580718:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8fef51db3f00) 00010000:00010000:0.0:1788521339.580721:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521339.580724:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1788 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521339.580730:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1788 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521339.580756:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d177a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed648 expref: 47 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521339.580770:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d178f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed648 expref: 46 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521339.580777:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:0.0:1788521339.580779:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788521339.580782:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42410000, rc 0) 00000100:00100000:0.0:1788521339.580848:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+46:11261:x1875400201380736:12345-192.168.203.41@tcp:101:stat.0 Request processed in 676us (2467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521339.580855:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 65 00000100:00100000:3.0:1788521339.681808:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521339.682284:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201380992 00000100:00100000:1.0:1788521339.682297:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201380992 00000100:00100000:1.0:1788521339.682382:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 66 00000100:00100000:1.0:1788521339.682396:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+46:11271:x1875400201380992:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:1.0:1788521339.682422:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521339.682451:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1796 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed64f expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521339.682583:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788521339.682819:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1796 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed64f expref: 48 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.682837:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef76505500) 00010000:00010000:1.0:1788521339.682840:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788521339.683409:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1796 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed64f expref: 48 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.683432:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434aaa00, rc 0) 00000100:00100000:1.0:1788521339.683545:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+47:11271:x1875400201380992:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 1151us (1753us total) trans 4294967341 rc 301/301 00000100:00100000:1.0:1788521339.683574:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 66 00000100:00100000:3.0:1788521339.689828:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521339.690043:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201381248 00000100:00100000:0.0:1788521339.690057:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201381248 00000100:00100000:0.0:1788521339.690152:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 14 00000100:00100000:0.0:1788521339.690164:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+47:11271:x1875400201381248:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:0.0:1788521339.690500:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+48:11271:x1875400201381248:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 338us (687us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1788521339.690508:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 14 00000100:00100000:3.0:1788521339.762307:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521339.763410:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201381504 00000100:00100000:2.0:1788521339.763427:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201381504 00000100:00100000:2.0:1788521339.763598:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 67 00000100:00100000:2.0:1788521339.763611:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+48:11277:x1875400201381504:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:2.0:1788521339.763644:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521339.763673:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d17a4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed656 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521339.764501:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d17ab lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521339.764529:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d178f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed648 expref: 49 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521339.764540:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d17ab lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521339.764605:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d178f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed648 expref: 49 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521339.764624:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d178f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed648 expref: 49 pid: 6520 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521339.764642:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58372d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875400222446336:192.168.203.41@tcp:104: 00000100:00100000:2.0:1788521339.765031:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788521339.768475:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521339.768537:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201381632 00000100:00100000:3.0:1788521339.768548:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201381632 00010000:00010000:3.0:1788521339.768607:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d178f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed648 expref: 50 pid: 6520 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521339.768646:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 57 00000100:00100000:3.0:1788521339.768657:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4e7e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+50:2395:x1875400201381632:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521339.768675:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521339.768694:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d178f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed648 expref: 50 pid: 6520 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521339.768710:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d178f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed648 expref: 50 pid: 6520 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521339.768739:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:3.0:1788521339.768744:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d17ab lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521339.768757:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d17ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521339.768767:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d17ab lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521339.768791:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521339.769970:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d178f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed648 expref: 50 pid: 6520 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521339.769997:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58372d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875400222446336:192.168.203.41@tcp:104: 00010000:00010000:2.0:1788521339.770027:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d17ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521339.770038:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d17ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521339.770044:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d17ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521339.770085:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788521339.770271:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d17a4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed656 expref: 51 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521339.770290:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d17ab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed656 expref: 50 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521339.770300:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:2.0:1788521339.770304:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788521339.770307:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b6800, rc 0) 00000100:00100000:3.0:1788521339.773755:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4e7e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+50:2395:x1875400201381632:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 5079us (5275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521339.773776:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 57 00000100:00100000:2.0:1788521339.774384:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+49:11277:x1875400201381504:12345-192.168.203.41@tcp:101:bash.0 Request processed in 10770us (12086us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788521339.774394:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 67 00000100:00100000:3.0:1788521339.786420:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521339.786559:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201381888 00000100:00100000:2.0:1788521339.786578:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201381888 00000100:00100000:2.0:1788521339.786652:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 68 00000100:00100000:2.0:1788521339.786664:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+49:11277:x1875400201381888:12345-192.168.203.41@tcp:36:bash.0 00010000:00010000:2.0:1788521339.787019:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d17b9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521339.787044:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d17b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521339.787059:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d17b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521339.787114:0:9815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1788521339.787780:0:9815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000194cb2d9 reply state 000000002e833402 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d17b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521339.787801:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d17b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521339.787810:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:2.0:1788521339.787813:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788521339.787818:0:9815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788521339.788456:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+52:11277:x1875400201381888:12345-192.168.203.41@tcp:36:bash.0 Request processed in 1787us (2046us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1788521339.788466:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 68 00000020:00080000:2.0:1788521339.788473:0:9815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788521339.807500:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521339.807604:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201382016 00000100:00100000:3.0:1788521339.807618:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201382016 00000100:00100000:3.0:1788521339.807693:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 69 00000100:00100000:3.0:1788521339.807704:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+52:11277:x1875400201382016:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:3.0:1788521339.807736:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521339.807773:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d17c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed65d expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521339.808211:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d17c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521339.808232:0:12956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d17ab lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed656 expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521339.808242:0:12956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d17c7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521339.808286:0:12956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d17ab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed656 expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521339.808302:0:12956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d17ab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed656 expref: 53 pid: 6521 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521339.808320:0:12956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58374000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12956:1875400222446464:192.168.203.41@tcp:104: 00000100:00100000:2.0:1788521339.815262:0:12956:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee434c6600 going to sleep for 11 seconds 00000100:00100000:0.0:1788521339.823538:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521339.823946:0:12956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58374000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12956:1875400222446464:192.168.203.41@tcp:104: 00010000:00010000:2.0:1788521339.823987:0:12956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d17c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521339.824163:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201382144 00000100:00100000:1.0:1788521339.824173:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201382144 00010000:00010000:1.0:1788521339.824223:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d17ab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed656 expref: 54 pid: 6521 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521339.824269:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 58 00000100:00100000:1.0:1788521339.824289:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+54:2396:x1875400201382144:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521339.824308:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521339.824316:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d17ab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed656 expref: 54 pid: 6521 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.824330:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d17ab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed656 expref: 54 pid: 6521 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.824361:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d17ab lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed656 expref: 54 pid: 6521 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.824390:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:1.0:1788521339.824394:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d17c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.824405:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d17c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.824413:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d17c7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521339.824447:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521339.824522:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+53:2396:x1875400201382144:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 234us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521339.824530:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 58 00010000:00010000:3.0:1788521339.826436:0:12956:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d17c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521339.826454:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d17c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521339.826552:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788521339.826558:0:12956:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788521339.826585:0:12956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d17c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521339.826635:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d17c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed65d expref: 53 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521339.826658:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d17c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed65d expref: 52 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521339.826668:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:3.0:1788521339.826671:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521339.826674:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749cb200, rc 0) 00000100:00100000:3.0:1788521339.826775:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+52:11277:x1875400201382016:12345-192.168.203.41@tcp:101:bash.0 Request processed in 19072us (19289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521339.826784:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 69 00000100:00100000:0.0:1788521339.835267:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521339.836739:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201382400 00000100:00100000:1.0:1788521339.836758:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201382400 00000100:00100000:1.0:1788521339.836845:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 15 00000100:00100000:1.0:1788521339.836857:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6d4ab450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+52:11277:x1875400201382400:12345-192.168.203.41@tcp:35:bash.0 00000100:00100000:1.0:1788521339.837209:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6d4ab450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+53:11277:x1875400201382400:12345-192.168.203.41@tcp:35:bash.0 Request processed in 353us (1956us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788521339.837218:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 15 00000100:00100000:2.0:1788521340.010159:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521340.012495:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201382656 00000100:00100000:0.0:1788521340.012515:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201382656 00000100:00100000:0.0:1788521340.012621:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 70 00000100:00100000:0.0:1788521340.012635:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58372d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+53:11287:x1875400201382656:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:0.0:1788521340.012671:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521340.012700:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d17ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed664 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521340.012860:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788521340.013065:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d17ce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed664 expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.013083:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef76505500) 00010000:00010000:0.0:1788521340.013086:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788521340.013093:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d17ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed664 expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.013110:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411800, rc 0) 00000100:00100000:0.0:1788521340.013190:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58372d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+54:11287:x1875400201382656:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 559us (3045us total) trans 4294967347 rc 301/301 00000100:00100000:0.0:1788521340.013198:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 70 00000001:00080000:1.0:1788521340.018278:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967347 is committed 00000004:00080000:1.0:1788521340.018324:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788521340.018345:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8fee41a5a180 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788521340.018350:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fef484ac800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8fee41a5a0c0 00000020:00080000:1.0:1788521340.018353:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fef484acc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8fef7ef4be00 00010000:00010000:0.0:1788521340.018465:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1600 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018476:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1600 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018483:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1600 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018489:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa200 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521340.018493:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1600 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018500:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1600 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018525:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8fef51db3a00) 00010000:00010000:0.0:1788521340.018528:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521340.018533:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1600 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018539:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1600 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018561:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1607 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018566:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1607 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018571:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1607 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018589:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434ab600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521340.018591:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1607 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018597:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1607 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018605:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:0.0:1788521340.018607:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521340.018610:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1607 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018615:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1607 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018629:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1646 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018635:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1646 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018641:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1646 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018646:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aac00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521340.018649:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1646 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018654:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1646 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018671:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8fef51db3f00) 00010000:00010000:0.0:1788521340.018674:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521340.018677:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1646 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018684:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1646 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018700:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1750 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018706:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1750 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018712:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1750 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018717:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6000 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521340.018720:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1750 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018725:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1750 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018732:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:0.0:1788521340.018735:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521340.018738:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1750 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018744:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1750 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018775:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1773 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018781:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1773 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018787:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1773 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018792:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521340.018795:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1773 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018800:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1773 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018807:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:0.0:1788521340.018810:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521340.018812:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1773 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018818:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1773 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018827:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d17b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018832:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d17b9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018837:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d17b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018847:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7200 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521340.018849:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d17b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018855:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d17b9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018864:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:0.0:1788521340.018866:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521340.018869:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d17b9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.018874:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d17b9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521340.019336:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222446592:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788521340.019418:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521340.019516:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222446592 00000100:00100000:3.0:1788521340.019528:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222446592 00000100:00100000:3.0:1788521340.019621:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788521340.019633:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875400222446592:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788521340.019666:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1788521340.019719:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9aab78, atime: 0x6a9aab79, ctime: 0x6a9aab78, blocks: 0x8 00010000:00010000:3.0:1788521340.019729:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b332c35/0x411dd0ee4d2d17dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.019748:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=390s v=(0 0) 00010000:00010000:3.0:1788521340.019766:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521340.019774:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b332c35/0x411dd0ee4d2d17dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.019793:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b332c35/0x411dd0ee4d2d17dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.019803:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b332c35/0x411dd0ee4d2d17dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.019812:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b332c35/0x411dd0ee4d2d17dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.019834:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788521340.019963:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521340.019971:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b332c35/0x411dd0ee4d2d17dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.019982:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cbc00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:0.0:1788521340.019986:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b332c35/0x411dd0ee4d2d17dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.019996:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b332c35/0x411dd0ee4d2d17dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.020019:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b332c35/0x411dd0ee4d2d17dc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.020042:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b332c35/0x411dd0ee4d2d17dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.020065:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521340.020067:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521340.020069:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521340.020455:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3643:x1875400222446592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 822us (1033us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788521340.020465:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788521340.021437:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:2.0:1788521340.021521:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000004:00080000:0.0:1788521340.021691:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fef58374a80/2, rc 0, transno 4294967302 00000100:00100000:0.0:1788521340.021704:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222446592:0@lo:6:osp-syn-0-0.0 00000020:00080000:2.0:1788521340.021938:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788521340.022549:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521340.023052:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201382784 00000100:00100000:1.0:1788521340.023061:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201382784 00000100:00100000:1.0:1788521340.023124:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 71 00000100:00100000:1.0:1788521340.023145:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+12:11287:x1875400201382784:12345-192.168.203.41@tcp:34:lfs.0 00010000:00010000:1.0:1788521340.023217:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d17e3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.023245:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d17e3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.023256:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d17e3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.023275:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d17ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.023282:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d17ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.023288:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d17ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.023709:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d17f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.023720:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d17f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.023726:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d17f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788521340.024240:0:9815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d17f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.024256:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d17e3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.024263:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d17e3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.024285:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d17e3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.024291:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aba00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521340.024295:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d17e3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.024302:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d17e3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.024623:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:1.0:1788521340.024627:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521340.024632:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d17e3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.024640:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d17e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.024655:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d17ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.024662:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d17ea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.024668:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d17ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.024672:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434abe00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521340.024675:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d17ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.024692:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d17ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.024702:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8fef71ec0000) 00010000:00010000:1.0:1788521340.024705:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521340.024708:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d17ea lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.024713:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d17ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.024729:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d17f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.024736:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d17f1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.024741:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d17f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.024746:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521340.024749:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d17f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.024755:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d17f1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.024969:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:1.0:1788521340.024973:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521340.024977:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d17f1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.025049:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d17f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521340.025228:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58371c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+12:11287:x1875400201382784:12345-192.168.203.41@tcp:34:lfs.0 Request processed in 2082us (2679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521340.025238:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 71 00000100:00100000:0.0:1788521340.032486:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521340.033994:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201383040 00000100:00100000:1.0:1788521340.034009:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201383040 00000100:00100000:1.0:1788521340.034064:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 16 00000100:00100000:1.0:1788521340.034074:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+12:11287:x1875400201383040:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:1.0:1788521340.034317:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+13:11287:x1875400201383040:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 243us (1838us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1788521340.034324:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 16 00010000:00010000:1.0:1788521340.109088:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521340.114206:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521340.115838:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201383296 00000100:00100000:3.0:1788521340.115865:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201383296 00000100:00100000:3.0:1788521340.115997:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 72 00000100:00100000:3.0:1788521340.116010:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+13:11290:x1875400201383296:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:3.0:1788521340.116045:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521340.116086:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d17f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed66b expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.116200:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d17ff lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.116241:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d17ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.116255:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d17ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.116272:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d1806 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.116279:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d1806 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.116284:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d1806 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.116439:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d180d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.116449:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d180d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.116457:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d180d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521340.116468:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788521340.116566:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d17ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.116576:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d17ff lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.116583:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d17ff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.116596:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749ca200 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521340.116601:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d17ff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.116611:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d17ff lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.116625:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:3.0:1788521340.116628:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521340.116634:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d17ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.116640:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d17ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.116658:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d1806 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.116664:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d1806 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.116670:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d1806 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.116675:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749caa00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521340.116678:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d1806 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.116698:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d1806 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.116717:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8fef76505e00) 00010000:00010000:3.0:1788521340.116719:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521340.116723:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d1806 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.116729:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d1806 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.116783:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d17f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed66b expref: 16 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.116801:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d180d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed66b expref: 15 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.116809:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:3.0:1788521340.116812:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521340.116815:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749ca400, rc 0) 00000100:00100000:3.0:1788521340.116968:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+15:11290:x1875400201383296:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 959us (2775us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788521340.116977:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 72 00000100:00100000:2.0:1788521340.123487:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521340.123543:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521340.123672:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201383552 00000100:00100000:3.0:1788521340.123695:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201383552 00000100:00100000:3.0:1788521340.123834:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 5 00000100:00100000:3.0:1788521340.123857:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+15:2395:x1875400201383552:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521340.123879:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521340.123939:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d180d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed66b expref: 15 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521340.123988:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:3.0:1788521340.123996:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521340.124061:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+14:2395:x1875400201383552:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 216us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521340.124081:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 5 00000100:00100000:1.0:1788521340.124165:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201383424 00000100:00100000:1.0:1788521340.124171:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201383424 00000100:00100000:1.0:1788521340.124210:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 73 00000100:00100000:1.0:1788521340.124217:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+14:11290:x1875400201383424:12345-192.168.203.41@tcp:54:lfs.0 00010000:00010000:1.0:1788521340.124293:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d181b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.124310:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d181b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.124323:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d181b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.124379:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d181b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.124394:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d181b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.124403:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d181b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.124410:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521340.124415:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d181b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.124424:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d181b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.124434:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:1.0:1788521340.124437:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788521340.124442:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d181b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.124449:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d181b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521340.124487:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+14:11290:x1875400201383424:12345-192.168.203.41@tcp:54:lfs.0 Request processed in 270us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521340.124495:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 73 00000100:00100000:2.0:1788521340.142151:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521340.142266:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201383808 00000100:00100000:3.0:1788521340.142279:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201383808 00000100:00100000:3.0:1788521340.142345:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 17 00000100:00100000:3.0:1788521340.142357:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+14:11290:x1875400201383808:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:3.0:1788521340.142644:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+15:11290:x1875400201383808:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 288us (519us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788521340.142653:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 17 00000100:00100000:2.0:1788521340.460077:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521340.460385:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201384064 00000100:00100000:1.0:1788521340.460398:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201384064 00000100:00100000:1.0:1788521340.460482:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 74 00000100:00100000:1.0:1788521340.460497:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+15:11308:x1875400201384064:12345-192.168.203.41@tcp:101:cat.0 00010000:00010000:1.0:1788521340.460538:0:9815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521340.460583:0:9815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1822 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed672 expref: -99 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.460736:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1829 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.460755:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1829 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.460771:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1829 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521340.460786:0:9815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788521340.461000:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1822 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed672 expref: 18 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.461025:0:9815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1829 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed672 expref: 17 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.461035:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:1.0:1788521340.461039:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788521340.461043:0:9815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434abe00, rc 0) 00000100:00100000:1.0:1788521340.461127:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+17:11308:x1875400201384064:12345-192.168.203.41@tcp:101:cat.0 Request processed in 634us (1076us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1788521340.461135:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 74 00000100:00100000:2.0:1788521340.527357:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521340.527473:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201384192 00000100:00100000:0.0:1788521340.527485:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201384192 00000100:00100000:0.0:1788521340.527562:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 75 00000100:00100000:0.0:1788521340.527574:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+17:11309:x1875400201384192:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:0.0:1788521340.527604:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521340.527629:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1837 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed679 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.527710:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d183e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.527727:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d183e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.527741:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d183e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521340.527798:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788521340.527820:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788521340.527849:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d183e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.527880:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1837 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed679 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.527970:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d183e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed679 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.527981:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:0.0:1788521340.527985:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788521340.527989:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411c00, rc 0) 00000100:00100000:0.0:1788521340.528117:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+18:11309:x1875400201384192:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 544us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521340.528125:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 75 00000100:00100000:2.0:1788521340.547482:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521340.547628:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201384576 00000100:00100000:3.0:1788521340.547641:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201384576 00000100:00100000:3.0:1788521340.547712:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 18 00000100:00100000:3.0:1788521340.547725:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+18:11309:x1875400201384576:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:3.0:1788521340.549655:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+19:11309:x1875400201384576:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 1916us (2172us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788521340.549672:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 18 00000100:00100000:2.0:1788521340.554306:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521340.556213:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201384704 00000100:00100000:0.0:1788521340.556232:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201384704 00000100:00100000:1.0:1788521340.556755:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 6 00000100:00100000:1.0:1788521340.556770:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee437c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+19:11309:x1875400201384704:12345-192.168.203.41@tcp:103:lfs.0 00010000:00010000:1.0:1788521340.556791:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788521340.556823:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d17c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed65d expref: 19 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.556871:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1829 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed672 expref: 18 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.557071:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d16c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed617 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521340.557085:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:1.0:1788521340.557091:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521340.557177:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee437c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+16:11309:x1875400201384704:12345-192.168.203.41@tcp:103:lfs.0 Request processed in 411us (2899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521340.557186:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 6 00000100:00100000:2.0:1788521340.559657:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521340.559806:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201384832 00000100:00100000:0.0:1788521340.559817:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201384832 00000100:00100000:0.0:1788521340.559928:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 76 00000100:00100000:0.0:1788521340.559940:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef50f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+16:11309:x1875400201384832:12345-192.168.203.41@tcp:58:lfs.0 00010000:00010000:0.0:1788521340.560112:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1845 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.560133:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1845 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521340.560146:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1845 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788521340.560487:0:6520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788521340.560863:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1788521340.561005:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1788521340.561122:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef50f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+16:11309:x1875400201384832:12345-192.168.203.41@tcp:58:lfs.0 Request processed in 1180us (1475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521340.561134:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 76 00000100:00100000:3.0:1788521340.577862:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521340.578154:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201384960 00000100:00100000:2.0:1788521340.578168:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201384960 00000100:00100000:2.0:1788521340.578243:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 77 00000100:00100000:2.0:1788521340.578256:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+16:11311:x1875400201384960:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:2.0:1788521340.578296:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521340.578326:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d184c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed680 expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521340.578420:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1853 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521340.578438:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1853 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521340.578452:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1853 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521340.578489:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d185a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521340.578497:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d185a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521340.578504:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d185a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521340.578615:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1861 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521340.578625:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1861 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521340.578632:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1861 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521340.578685:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788521340.578691:0:12956:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788521340.578713:0:12956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1861 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521340.578728:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1861 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521340.578737:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1853 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521340.578744:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1853 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521340.578762:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1853 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521340.578769:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6e00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521340.578774:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1853 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521340.578784:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1853 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521340.578798:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:2.0:1788521340.578802:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521340.578807:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1853 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521340.578814:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1853 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521340.578830:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d185a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521340.578836:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d185a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521340.578840:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d185a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521340.578844:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7000 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521340.578847:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d185a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521340.578862:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d185a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521340.578869:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8fee410f7b00) 00010000:00010000:2.0:1788521340.578871:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521340.578874:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d185a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521340.578880:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d185a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521340.581019:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d184c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed680 expref: 18 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521340.581041:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1861 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed680 expref: 17 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521340.581052:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:2.0:1788521340.581055:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788521340.581059:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7600, rc 0) 00000100:00100000:2.0:1788521340.581234:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+17:11311:x1875400201384960:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 2978us (3385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521340.581244:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 77 00000100:00100000:3.0:1788521341.032259:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521341.032305:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521341.032344:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521341.032382:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201385088 00000100:00100000:3.0:1788521341.032395:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521341.032404:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201385088 00000100:00100000:0.0:1788521341.032411:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201385344 00000100:00100000:0.0:1788521341.032421:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201385344 00000100:00100000:3.0:1788521341.032460:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521341.032499:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 385 00000100:00100000:0.0:1788521341.032500:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201385600 00000100:00100000:3.0:1788521341.032507:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521341.032507:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201385600 00000100:00100000:1.0:1788521341.032517:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2395:x1875400201385088:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521341.032534:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201385216 00000100:00100000:0.0:1788521341.032541:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201385216 00000100:00100000:3.0:1788521341.032542:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201385728 00000100:00100000:3.0:1788521341.032548:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201385728 00000100:00100000:0.0:1788521341.032570:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 302 00000100:00100000:0.0:1788521341.032581:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201385344:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521341.032590:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 303 00000100:00100000:3.0:1788521341.032604:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201385600:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521341.032632:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2395:x1875400201385088:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 120us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521341.032642:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 385 00000100:00100000:3.0:1788521341.032664:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201385600:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 64us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521341.032673:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 303 00000100:00100000:3.0:1788521341.032707:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 304 00000100:00100000:0.0:1788521341.032719:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201385344:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 139us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521341.032720:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+17:2395:x1875400201385216:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521341.032766:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+17:2395:x1875400201385216:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 50us (377us total) trans 0 rc 0/0 00000100:00080000:1.0:1788521341.032790:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788521341.032797:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788521341.033027:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201385472 00000100:00100000:1.0:1788521341.033033:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201385472 00000100:00100000:1.0:1788521341.033078:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 124 00000100:00100000:1.0:1788521341.033088:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+7:2395:x1875400201385472:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521341.033162:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 305 00000100:00100000:0.0:1788521341.033171:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 302 00000100:00100000:2.0:1788521341.033178:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201385728:12345-192.168.203.41@tcp:400:kworker.0 00000100:00080000:0.0:1788521341.033211:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521341.033232:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201385728:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 60us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521341.033279:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 304 00000100:00100000:1.0:1788521341.033308:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+7:2395:x1875400201385472:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 220us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521341.033325:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 124 00000100:00100000:2.0:1788521341.035704:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 305 00000100:00100000:0.0:1788521341.069223:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222446720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521341.069319:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521341.069433:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222446720 00000100:00100000:0.0:1788521341.069444:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222446720 00000100:00100000:0.0:1788521341.069513:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788521341.069524:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef8149aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222446720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788521341.069562:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521341.069613:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef8149aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222446720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521341.069640:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:0.0:1788521341.069666:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788521341.069725:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222446720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521341.070845:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788521341.070864:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222446848:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788521341.070945:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521341.070992:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222446848 00000100:00100000:0.0:1788521341.071000:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222446848 00000100:00100000:0.0:1788521341.071044:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788521341.071052:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6e4bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222446848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788521341.071088:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788521341.071269:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6e4bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222446848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 216us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521341.071276:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788521341.071365:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f070000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222446848:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788521341.077018:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788521341.077029:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788521341.077084:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788521341.077097:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788521341.077296:0:13799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1875400222446976:192.168.203.41@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788521341.077415:0:13799:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef50feaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788521341.078755:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222447232:0@lo:400:kworker.0 00000100:00100000:3.0:1788521341.078830:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521341.078867:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee436cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222447744:0@lo:400:kworker.0 00000100:00100000:3.0:1788521341.078916:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521341.078934:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee436cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875400222448256:0@lo:400:kworker.0 00000100:00100000:3.0:1788521341.078956:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521341.078983:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788521341.078989:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875400222447360:0@lo:400:kworker.0 00000100:00100000:3.0:1788521341.079022:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521341.079041:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee436cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222447872:0@lo:400:kworker.0 00000100:00100000:3.0:1788521341.079083:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521341.079105:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee436cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222448384:0@lo:400:kworker.0 00000100:00100000:3.0:1788521341.079412:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521341.079454:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222447232 00000100:00100000:3.0:1788521341.079464:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222447232 00000100:00100000:3.0:1788521341.079521:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222447744 00000100:00100000:3.0:1788521341.079524:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222447744 00000100:00100000:3.0:1788521341.079548:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222448256 00000100:00100000:3.0:1788521341.079550:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222448256 00000100:00100000:3.0:1788521341.079563:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222447360 00000100:00100000:3.0:1788521341.079565:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222447360 00000100:00100000:3.0:1788521341.079579:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788521341.079587:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222447232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521341.079651:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222447232:12345-0@lo:400:kworker.0 Request processed in 63us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521341.079659:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788521341.082431:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788521341.082455:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222447744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521341.082563:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222447744:12345-0@lo:400:kworker.0 Request processed in 117us (3645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521341.082571:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788521341.082591:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788521341.082599:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875400222448256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521341.082632:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875400222448256:12345-0@lo:400:kworker.0 Request processed in 34us (3674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521341.082638:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788521341.082651:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00080000:0.0:1788521341.082823:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788521341.082970:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521341.082998:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222447104:0@lo:400:kworker.0 00000100:00100000:0.0:1788521341.083045:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521341.083087:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875400222447616:0@lo:400:kworker.0 00000100:00100000:0.0:1788521341.083130:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521341.083144:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee436cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875400222448128:0@lo:400:kworker.0 00000100:00100000:0.0:1788521341.083167:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521341.083187:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788521341.083195:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222447488:0@lo:400:kworker.0 00000100:00100000:0.0:1788521341.083220:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521341.083242:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee436cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222448000:0@lo:400:kworker.0 00000100:00100000:0.0:1788521341.083265:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521341.083297:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222447104 00000100:00100000:0.0:1788521341.083306:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222447104 00000100:00100000:0.0:1788521341.083374:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1788521341.083382:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3646:x1875400222447104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521341.083421:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3646:x1875400222447104:12345-0@lo:400:kworker.0 Request processed in 40us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521341.083428:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1788521341.083461:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222447488 00000100:00100000:0.0:1788521341.083465:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222447488 00000100:00100000:0.0:1788521341.083489:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788521341.083495:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222447488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521341.083527:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222447488:12345-0@lo:400:kworker.0 Request processed in 33us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521341.083534:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788521341.083552:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222447872 00000100:00100000:0.0:1788521341.083557:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222447872 00000100:00100000:0.0:1788521341.083592:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222448384 00000100:00100000:0.0:1788521341.083596:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222448384 00000100:00100000:0.0:1788521341.083612:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222448000 00000100:00100000:0.0:1788521341.083622:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222448000 00000100:00100000:0.0:1788521341.083641:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788521341.083648:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222447872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521341.083697:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222447872:12345-0@lo:400:kworker.0 Request processed in 49us (4614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521341.083704:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788521341.083717:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788521341.083724:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222448384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521341.083753:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222448384:12345-0@lo:400:kworker.0 Request processed in 30us (4341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521341.083758:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788521341.083768:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788521341.083775:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3646:x1875400222448000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521341.083800:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3646:x1875400222448000:12345-0@lo:400:kworker.0 Request processed in 26us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521341.083805:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:0.0:1788521341.083827:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521341.083831:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521341.083871:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222447488:0@lo:400:kworker.0 00000100:00100000:0.0:1788521341.083910:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee436cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222448000:0@lo:400:kworker.0 00000100:00100000:0.0:1788521341.083920:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222447104:0@lo:400:kworker.0 00000100:00100000:0.0:1788521341.083961:0:13799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1875400222446976:192.168.203.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788521341.084625:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875400222447360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521341.084746:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875400222447360:12345-0@lo:400:kworker.0 Request processed in 132us (5732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521341.084754:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788521341.084777:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201385856 00000100:00100000:3.0:1788521341.084783:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201385856 00000100:00100000:3.0:1788521341.084808:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 78 00000100:00100000:3.0:1788521341.084813:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+17:11322:x1875400201385856:12345-192.168.203.41@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788521341.084839:0:6521:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788521341.084980:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+17:11322:x1875400201385856:12345-192.168.203.41@tcp:53:lhsmtool_posix.0 Request processed in 165us (2012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521341.084987:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 78 00000100:00100000:3.0:1788521341.084998:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222447616 00000100:00100000:3.0:1788521341.085002:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222447616 00000100:00100000:3.0:1788521341.085033:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222448128 00000100:00100000:3.0:1788521341.085036:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222448128 00000100:00100000:3.0:1788521341.085050:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788521341.085055:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875400222447616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521341.085092:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875400222447616:12345-0@lo:400:kworker.0 Request processed in 36us (1962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521341.085099:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788521341.085109:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788521341.085116:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875400222448128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521341.085644:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875400222448128:12345-0@lo:400:kworker.0 Request processed in 527us (2474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521341.085652:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00080000:3.0:1788521341.088789:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521341.088870:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875400222447360:0@lo:400:kworker.0 00000100:00100000:3.0:1788521341.088923:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee436cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222447872:0@lo:400:kworker.0 00000100:00100000:3.0:1788521341.088938:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee436cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222448384:0@lo:400:kworker.0 00000100:00100000:3.0:1788521341.088952:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222447232:0@lo:400:kworker.0 00010000:00080000:3.0:1788521341.088970:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee436cea00 x1875400222447744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521341.088983:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee436cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222447744:0@lo:400:kworker.0 00010000:00080000:3.0:1788521341.088997:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee436cf480 x1875400222448256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521341.089005:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee436cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875400222448256:0@lo:400:kworker.0 00000100:00100000:3.0:1788521341.089090:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875400222447616:0@lo:400:kworker.0 00000100:00100000:3.0:1788521341.089104:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee436cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875400222448128:0@lo:400:kworker.0 00000100:00100000:0.0:1788521341.093422:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521341.093672:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201385984 00000100:00100000:3.0:1788521341.093685:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201385984 00000100:00100000:3.0:1788521341.093766:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 79 00000100:00100000:3.0:1788521341.093779:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+17:11322:x1875400201385984:12345-192.168.203.41@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788521341.093906:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1868 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.093929:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1868 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.093945:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1868 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.094117:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d186f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.094142:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d186f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.094155:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d186f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.094191:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d1876 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.094200:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d1876 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.094206:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d1876 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521341.094258:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788521341.094262:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788521341.094281:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d1876 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.094295:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1868 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.094301:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1868 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.094308:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1868 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.094324:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749ca400 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521341.094328:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1868 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.094336:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1868 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.094362:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fee410f5900) 00010000:00010000:3.0:1788521341.094366:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521341.094371:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1868 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.094377:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1868 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.094391:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d186f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.094397:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d186f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.094404:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d186f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.094409:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cb600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521341.094412:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d186f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.094418:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d186f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.094436:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8fef76505e00) 00010000:00010000:3.0:1788521341.094438:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521341.094441:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d186f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.094447:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d186f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.094464:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d1876 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.094472:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d1876 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.094479:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d1876 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.094485:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749caa00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521341.094488:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d1876 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.094494:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d1876 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.094502:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:3.0:1788521341.094505:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521341.094508:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d1876 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.094514:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d1876 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521341.094620:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+17:11322:x1875400201385984:12345-192.168.203.41@tcp:34:lhsmtool_posix.0 Request processed in 838us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521341.094631:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 79 00000100:00100000:0.0:1788521341.104839:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521341.105280:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201386240 00000100:00100000:3.0:1788521341.105294:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201386240 00000100:00100000:3.0:1788521341.105381:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 80 00000100:00100000:3.0:1788521341.105395:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+17:11322:x1875400201386240:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521341.105423:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521341.105449:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d187d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed687 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.105592:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1884 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.105611:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1884 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.105625:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1884 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521341.105639:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788521341.105750:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1884 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.105758:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1884 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.105765:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1884 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.105794:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cb600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521341.105799:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1884 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.105808:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1884 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.105822:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:3.0:1788521341.105825:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788521341.105831:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1884 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.105838:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1884 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.105913:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d187d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed687 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.105925:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fee410f5900) 00010000:00010000:3.0:1788521341.105928:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788521341.105932:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d187d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed687 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.105944:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749caa00, rc 0) 00000100:00100000:3.0:1788521341.106017:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+18:11322:x1875400201386240:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 625us (1193us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1788521341.106024:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 80 00000100:00100000:0.0:1788521341.111845:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521341.112261:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201386368 00000100:00100000:2.0:1788521341.112275:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201386368 00000100:00100000:1.0:1788521341.112492:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 81 00000100:00100000:1.0:1788521341.112504:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+18:11322:x1875400201386368:12345-192.168.203.41@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788521341.112554:0:12956:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788521341.112919:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+18:11322:x1875400201386368:12345-192.168.203.41@tcp:53:lhsmtool_posix.0 Request processed in 380us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521341.112928:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 81 00000100:00100000:1.0:1788521341.126269:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521341.126350:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201386624 00000100:00100000:3.0:1788521341.126380:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201386624 00000100:00100000:3.0:1788521341.126496:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 82 00000100:00100000:3.0:1788521341.126507:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+18:11322:x1875400201386624:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521341.126530:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521341.126543:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788521341.126571:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d183e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed679 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.126589:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:3.0:1788521341.126595:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788521341.126609:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d1892 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed68e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788521341.127004:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788521341.127136:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1899 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.127151:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1899 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.127162:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1899 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.127208:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d1892 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed68e expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.127224:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1899 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed68e expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.127244:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8fef76505e00) 00010000:00010000:3.0:1788521341.127247:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521341.127250:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749cb600, rc 0) 00000100:00100000:3.0:1788521341.127327:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+19:11322:x1875400201386624:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 821us (1073us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788521341.127335:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 82 00010000:00010000:2.0:1788521341.133454:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521341.138163:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521341.138451:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201386880 00000100:00100000:2.0:1788521341.138460:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201386880 00000100:00100000:2.0:1788521341.138512:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 83 00000100:00100000:2.0:1788521341.138521:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+19:11322:x1875400201386880:12345-192.168.203.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788521341.138580:0:9815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521341.138604:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1899 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed68e expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.138622:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8fef76505e00) 00010000:00010000:2.0:1788521341.138632:0:9815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521341.138652:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d18a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.138666:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d18a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.138676:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d18a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.138718:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d18ae lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xefc5fd59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.138727:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d18ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xefc5fd59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.138734:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d18ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xefc5fd59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.138785:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d18a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.138793:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d18a7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.138800:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d18a7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.138806:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521341.138811:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d18a7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.138818:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d18a7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.138827:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:2.0:1788521341.138830:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521341.138833:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d18a7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.138839:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d18a7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.138848:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d18ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xefc5fd59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.138854:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d18ae lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xefc5fd59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.138860:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d18ae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xefc5fd59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.138870:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7200 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521341.138873:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d18ae lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xefc5fd59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.138879:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d18ae lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xefc5fd59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.138904:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xefc5fd59 (ffff8fee410f7b00) 00010000:00010000:2.0:1788521341.138907:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521341.138909:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d18ae lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xefc5fd59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.138915:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d18ae lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xefc5fd59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521341.138995:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+18:11322:x1875400201386880:12345-192.168.203.41@tcp:36:lhsmtool_posix.0 Request processed in 474us (842us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788521341.139002:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 83 00000100:00100000:0.0:1788521341.147550:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521341.147790:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201387008 00000100:00100000:3.0:1788521341.147801:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201387008 00000100:00100000:3.0:1788521341.147871:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 84 00000100:00100000:3.0:1788521341.147903:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+18:11322:x1875400201387008:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521341.147923:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521341.147947:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d18b5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed695 expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.147985:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d18bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.147999:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d18bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.148013:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d18bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.148120:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d18b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed695 expref: 20 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.148137:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d18bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed695 expref: 19 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.148153:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8fef76505100) 00010000:00010000:3.0:1788521341.148156:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788521341.148161:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749ca400, rc 0) 00000100:00100000:3.0:1788521341.148218:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+19:11322:x1875400201387008:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 338us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521341.148234:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 84 00000100:00100000:0.0:1788521341.164804:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521341.164906:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201387264 00000100:00100000:1.0:1788521341.164916:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201387264 00000100:00100000:1.0:1788521341.164976:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 85 00000100:00100000:1.0:1788521341.164986:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+19:11322:x1875400201387264:12345-192.168.203.41@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788521341.165066:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d18c3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.165083:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d18c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.165094:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d18c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788521341.165260:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1788521341.165270:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 391231385366ns, next at 392231382665ns, rc = 0 00000004:00010000:1.0:1788521341.165310:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008492986e reply state 0000000067c02a95 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d18c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.165333:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d18c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.165340:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8fef76505100) 00010000:00010000:1.0:1788521341.165343:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788521341.165346:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788521341.165500:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+21:11322:x1875400201387264:12345-192.168.203.41@tcp:36:lhsmtool_posix.0 Request processed in 514us (705us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788521341.165508:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 85 00000100:00100000:0.0:1788521341.179753:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521341.186142:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201387392 00000100:00100000:2.0:1788521341.186157:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201387392 00000100:00100000:2.0:1788521341.186232:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 86 00000100:00100000:2.0:1788521341.186243:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+21:11322:x1875400201387392:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521341.186266:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521341.186288:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d18ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed69c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.186348:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d18ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed69c expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.186393:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d18ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed69c expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.186413:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8fef76505100) 00010000:00010000:2.0:1788521341.186417:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788521341.186421:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7200, rc 0) 00000100:00100000:2.0:1788521341.186482:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+22:11322:x1875400201387392:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 241us (6738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521341.186490:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 86 00000100:00100000:0.0:1788521341.194712:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521341.194817:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201387520 00000100:00100000:3.0:1788521341.194826:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201387520 00000100:00100000:3.0:1788521341.194903:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 33 00000100:00100000:3.0:1788521341.194913:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1875400201387520:12345-192.168.203.41@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788521341.194950:0:8434:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from fc75e887-507e-4861-8203-e266d82f5177@192.168.203.41@tcp t0 exp 0000000000000000 cur 391 last 0 00000020:00000080:3.0:1788521341.194990:0:8434:0:(genops.c:1385:class_connect()) connect: client fc75e887-507e-4861-8203-e266d82f5177, cookie 0x411dd0ee4d2d18d1 00002000:00100000:3.0:1788521341.195002:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fc75e887-507e-4861-8203-e266d82f5177/ffff8fef48511800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788521341.195013:0:8434:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788521341.195088:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788521341.195115:0:8434:0:(import.c:65:import_set_state_nolock()) ffff8fef48517800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788521341.195175:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+6:2392:x1875400201387520:12345-192.168.203.41@tcp:8:lhsmtool_posix.0 Request processed in 262us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521341.195182:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 33 00000100:00100000:2.0:1788521341.199759:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521341.200712:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201387648 00000100:00100000:3.0:1788521341.200724:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201387648 00000100:00100000:3.0:1788521341.200840:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 34 00000100:00100000:3.0:1788521341.201798:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef50f4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+6:0:x1875400201387648:12345-192.168.203.41@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788521341.206034:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1788521341.235027:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:2.0:1788521341.235042:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fc75e887-507e-4861-8203-e266d82f5177 00000100:00100000:0.0:1788521341.235367:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef50f4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+5:0:x1875400201387648:12345-192.168.203.41@tcp:2:lhsmtool_posix.0 Request processed in 34498us (35598us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788521341.235379:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 34 00000100:00100000:0.0:1788521341.243759:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521341.244102:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201387904 00000100:00100000:2.0:1788521341.244113:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201387904 00000100:00100000:2.0:1788521341.244179:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 19 00000100:00100000:2.0:1788521341.244188:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+22:11322:x1875400201387904:12345-192.168.203.41@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788521341.244448:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+23:11322:x1875400201387904:12345-192.168.203.41@tcp:35:lhsmtool_posix.0 Request processed in 259us (694us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1788521341.244456:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 19 00000100:00100000:2.0:1788521341.253488:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521341.253556:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201388160 00000100:00100000:3.0:1788521341.253571:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201388160 00000100:00100000:3.0:1788521341.253631:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 87 00000100:00100000:3.0:1788521341.253641:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef50f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+23:11322:x1875400201388160:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788521341.253752:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef50f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+23:11322:x1875400201388160:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 Request processed in 112us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521341.253760:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 87 00000100:00100000:0.0:1788521341.261461:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521341.261539:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201388288 00000100:00100000:3.0:1788521341.261548:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201388288 00000100:00100000:3.0:1788521341.261605:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 88 00000100:00100000:3.0:1788521341.261616:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+23:11322:x1875400201388288:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521341.261635:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521341.261655:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d18d8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed6a3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.261722:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d18df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.261736:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d18df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.261748:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d18df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521341.261789:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788521341.261806:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d18df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.261831:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d18d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6a3 expref: 25 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.261864:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d18df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6a3 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.261872:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8fef76505100) 00010000:00010000:3.0:1788521341.261876:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788521341.261879:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749ca200, rc 0) 00000100:00100000:3.0:1788521341.262364:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+24:11322:x1875400201388288:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 740us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521341.262372:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 88 00000100:00100000:1.0:1788521341.270423:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521341.270591:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201388416 00000100:00100000:3.0:1788521341.270601:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201388416 00000100:00100000:3.0:1788521341.270657:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 35 00000100:00100000:3.0:1788521341.270668:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201388416:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521341.270686:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521341.270709:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9105271/0x411dd0ee4d2d18e6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed6aa expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788521341.270734:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9aab7c, blocks: 0x0 00010000:00010000:3.0:1788521341.270752:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=391s v=(0 0) 00010000:00010000:3.0:1788521341.270757:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521341.270766:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9105271/0x411dd0ee4d2d18e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6aa expref: 6 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.270786:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c9105271/0x411dd0ee4d2d18e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6aa expref: 6 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.270813:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749caa00, rc 0) 00000100:00100000:3.0:1788521341.270872:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+6:2395:x1875400201388416:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 206us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521341.270879:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 35 00000100:00100000:0.0:1788521341.274338:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521341.279016:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201388672 00000100:00100000:1.0:1788521341.279030:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201388672 00000100:00100000:1.0:1788521341.279107:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 89 00000100:00100000:1.0:1788521341.279118:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+24:11322:x1875400201388672:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788521341.279254:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+24:11322:x1875400201388672:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 Request processed in 138us (4923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521341.279263:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 89 00000100:00100000:2.0:1788521341.292489:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521341.292595:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201388800 00000100:00100000:0.0:1788521341.292610:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201388800 00000100:00100000:0.0:1788521341.292688:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 36 00000100:00100000:0.0:1788521341.292698:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef50f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc75e887-507e-4861-8203-e266d82f5177+6:11322:x1875400201388800:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788521341.292716:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521341.292735:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019b9cc59/0x411dd0ee4d2d18ed lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed6b1 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.292771:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9105271/0x411dd0ee4d2d18e6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6aa expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.292782:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521341.292786:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521341.292792:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019b9cc59/0x411dd0ee4d2d18ed lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6b1 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.292849:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c9105271/0x411dd0ee4d2d18e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6aa expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.292863:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c9105271/0x411dd0ee4d2d18e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6aa expref: 7 pid: 8434 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521341.292877:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1875400222448512:192.168.203.41@tcp:104: 00000100:00100000:0.0:1788521341.293021:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef554793c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521341.296667:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521341.297810:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1875400222448512:192.168.203.41@tcp:104: 00010000:00010000:2.0:1788521341.297948:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000019b9cc59/0x411dd0ee4d2d18ed lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6b1 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.298004:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411e00, rc 0) 00000100:00100000:3.0:1788521341.299819:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef50f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc75e887-507e-4861-8203-e266d82f5177+7:11322:x1875400201388800:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 7111us (7336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521341.299833:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 36 00000100:00100000:0.0:1788521341.301196:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201388928 00000100:00100000:0.0:1788521341.301783:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201388928 00010000:00010000:1.0:1788521341.301928:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c9105271/0x411dd0ee4d2d18e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6aa expref: 7 pid: 8434 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521341.301978:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 59 00000100:00100000:1.0:1788521341.301989:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+7:2396:x1875400201388928:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521341.302006:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521341.302027:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c9105271/0x411dd0ee4d2d18e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6aa expref: 7 pid: 8434 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.302062:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c9105271/0x411dd0ee4d2d18e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6aa expref: 7 pid: 8434 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.302086:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9105271/0x411dd0ee4d2d18e6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6aa expref: 7 pid: 8434 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.302103:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521341.302108:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521341.302129:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000019b9cc59/0x411dd0ee4d2d18ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6b1 expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.302141:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019b9cc59/0x411dd0ee4d2d18ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6b1 expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.302181:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000019b9cc59/0x411dd0ee4d2d18ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6b1 expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521341.302196:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f08a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6504:1875400222448640:192.168.203.41@tcp:105: 00000100:00100000:1.0:1788521341.302275:0:6504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef71dd4180 going to sleep for 11 seconds 00000100:00100000:3.0:1788521341.317206:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521341.317212:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f08a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6504:1875400222448640:192.168.203.41@tcp:105: 00010000:00010000:1.0:1788521341.317240:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521341.317301:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+6:2396:x1875400201388928:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 15313us (20642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521341.317311:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 59 00000100:00100000:0.0:1788521341.317710:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201389056 00000100:00100000:0.0:1788521341.317717:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201389056 00002000:00100000:0.0:1788521341.317759:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8fee436cf480 x1875400201389056/t0(0) o4->fc75e887-507e-4861-8203-e266d82f5177@192.168.203.41@tcp:342/0 lens 504/0 e 0 to 0 dl 1788521352 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788521341.317770:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fee436cf480 with x1875400201389056 ext(0->8) 00002000:00010000:0.0:1788521341.317775:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fee436cf480 00000100:00100000:0.0:1788521341.317804:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 0 00000100:00100000:0.0:1788521341.317813:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc75e887-507e-4861-8203-e266d82f5177+6:2396:x1875400201389056:12345-192.168.203.41@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788521341.321567:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc75e887-507e-4861-8203-e266d82f5177+8:2396:x1875400201389056:12345-192.168.203.41@tcp:4:lhsmtool_posix.0 Request processed in 3744us (4362us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788521341.321584:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 0 00002000:00100000:1.0:1788521341.321596:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8fee436cf480 x1875400201389056/t4294967303(0) o4->fc75e887-507e-4861-8203-e266d82f5177@192.168.203.41@tcp:342/0 lens 504/448 e 0 to 0 dl 1788521352 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788521341.321608:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fee436cf480 with x1875400201389056 ext(0->8) 00002000:00010000:1.0:1788521341.321613:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fee436cf480 00000100:00100000:0.0:1788521341.325080:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521341.325260:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201389184 00000100:00100000:2.0:1788521341.325271:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201389184 00000100:00100000:2.0:1788521341.325340:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 90 00000100:00100000:2.0:1788521341.325352:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+24:11322:x1875400201389184:12345-192.168.203.41@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788521341.330292:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:1.0:1788521341.330309:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788521341.330346:0:6498:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:3.0:1788521341.330557:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788521341.330576:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee436cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222448768:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788521341.330637:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788521341.330729:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d18c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.330740:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d18c3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.330747:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d18c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.330753:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aba00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521341.330757:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d18c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.330766:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d18c3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.330782:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8fef76505100) 00010000:00010000:2.0:1788521341.330785:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788521341.330791:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d18c3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.330798:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d18c3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788521341.330831:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1788521341.330841:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788521341.330971:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+14:11322:x1875400201389184:12345-192.168.203.41@tcp:44:lhsmtool_posix.0 Request processed in 5619us (5895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521341.330981:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 90 00000100:00100000:1.0:1788521341.331543:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222448768 00000100:00100000:1.0:1788521341.331552:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222448768 00000100:00100000:1.0:1788521341.331595:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788521341.331605:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222448768:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788521341.331759:0:8875:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788521341.331763:0:8875:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788521340 00002000:00010000:1.0:1788521341.331766:0:8875:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788521341.331768:0:8875:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788521340 -> 1788521340 00002000:00010000:1.0:1788521341.331770:0:8875:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788521341.331816:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1875400222448768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 213us (1179us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788521341.331822:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:2.0:1788521341.332323:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fee436cea00/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788521341.332331:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee436cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222448768:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788521341.333663:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521341.334324:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201389312 00000100:00100000:1.0:1788521341.334332:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201389312 00000100:00100000:1.0:1788521341.334388:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 38 00000100:00100000:1.0:1788521341.334398:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+8:2395:x1875400201389312:12345-192.168.203.41@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788521341.341453:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1788521341.341465:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:3.0:1788521341.345014:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+6:2395:x1875400201389312:12345-192.168.203.41@tcp:16:lhsmtool_posix.0 Request processed in 10608us (11346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521341.345026:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 38 00000100:00100000:2.0:1788521341.363306:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521341.363411:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201389568 00000100:00100000:3.0:1788521341.363421:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201389568 00000100:00100000:3.0:1788521341.363518:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 91 00000100:00100000:3.0:1788521341.363529:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef50f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+14:11322:x1875400201389568:12345-192.168.203.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788521341.363583:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521341.363613:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d18df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6a3 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.363642:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8fef76505100) 00010000:00010000:3.0:1788521341.363648:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788521341.363745:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d18f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.363759:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d18f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.363769:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d18f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788521341.363937:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006316bce3 reply state 0000000098f57d8a transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d18f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.364303:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d18f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.364310:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8fef76505100) 00010000:00010000:3.0:1788521341.364313:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788521341.364315:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788521341.364422:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef50f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+15:11322:x1875400201389568:12345-192.168.203.41@tcp:36:lhsmtool_posix.0 Request processed in 894us (1124us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1788521341.364429:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 91 00000100:00100000:0.0:1788521341.366736:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521341.367393:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201389696 00000100:00100000:2.0:1788521341.367403:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201389696 00000100:00100000:2.0:1788521341.367486:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 39 00000100:00100000:2.0:1788521341.367496:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+6:2395:x1875400201389696:12345-192.168.203.41@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788521341.367647:0:8875:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788521341.367650:0:8875:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788521340 -> 1788521339 00002000:00010000:2.0:1788521341.367653:0:8875:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788521337 00002000:00010000:2.0:1788521341.367656:0:8875:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788521340 -> 1788521339 00002000:00010000:2.0:1788521341.367658:0:8875:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788521341.367731:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+7:2395:x1875400201389696:12345-192.168.203.41@tcp:2:lhsmtool_posix.0 Request processed in 236us (1000us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788521341.367740:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 39 00000100:00100000:2.0:1788521341.371869:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521341.372029:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201389952 00000100:00100000:3.0:1788521341.372038:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201389952 00000100:00100000:3.0:1788521341.372100:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 92 00000100:00100000:3.0:1788521341.372111:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef50f4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+15:11322:x1875400201389952:12345-192.168.203.41@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788521341.372187:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d18fb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.372219:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d18bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed695 expref: 15 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.372230:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d18fb lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.372263:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d18bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed695 expref: 15 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.372277:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d18bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed695 expref: 15 pid: 12956 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521341.372291:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee436ce300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875400222448896:192.168.203.41@tcp:104: 00000100:00100000:3.0:1788521341.372378:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee434c6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521341.382583:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521341.382648:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee436ce300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875400222448896:192.168.203.41@tcp:104: 00010000:00010000:3.0:1788521341.382675:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d18fb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521341.383025:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201390080 00000100:00100000:0.0:1788521341.383032:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201390080 00010000:00010000:0.0:1788521341.383073:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d18bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed695 expref: 16 pid: 12956 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521341.383108:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 60 00000100:00100000:0.0:1788521341.383117:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f08a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+16:2395:x1875400201390080:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521341.383133:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521341.383140:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d18bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed695 expref: 16 pid: 12956 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.383153:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d18bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed695 expref: 16 pid: 12956 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.383176:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d18bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed695 expref: 16 pid: 12956 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.383190:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8fef76505100) 00010000:00010000:0.0:1788521341.383253:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d18fb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.383266:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d18fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.383274:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d18fb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.383303:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521341.383366:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f08a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+15:2395:x1875400201390080:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 237us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521341.383374:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 60 00010000:00010000:3.0:1788521341.383438:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d18fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.383445:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d18fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.383493:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d18fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.383501:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d18fb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.383514:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d18fb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.383520:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749ca200 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521341.383524:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d18fb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.383536:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d18fb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.383546:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8fef76505100) 00010000:00010000:3.0:1788521341.383548:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788521341.383552:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d18fb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.383558:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d18fb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521341.383600:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef50f4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+14:11322:x1875400201389952:12345-192.168.203.41@tcp:55:lhsmtool_posix.0 Request processed in 11491us (11740us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788521341.383609:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 92 00000100:00100000:1.0:1788521341.392608:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521341.392797:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201390208 00000100:00100000:0.0:1788521341.392807:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201390208 00000100:00100000:1.0:1788521341.393020:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 40 00000100:00100000:1.0:1788521341.393034:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f08ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+7:2396:x1875400201390208:12345-192.168.203.41@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788521341.393079:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000101ea398/0x411dd0ee4d2d1902 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.393101:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000019b9cc59/0x411dd0ee4d2d18ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6b1 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.393110:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521341.393115:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788521341.393121:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000101ea398/0x411dd0ee4d2d1902 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.393154:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000019b9cc59/0x411dd0ee4d2d18ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6b1 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.393170:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000019b9cc59/0x411dd0ee4d2d18ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6b1 expref: 7 pid: 8437 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521341.393187:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f088700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1875400222449024:192.168.203.41@tcp:104: 00000100:00100000:1.0:1788521341.393276:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef71dd4180 going to sleep for 11 seconds 00000100:00100000:2.0:1788521341.395811:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f088700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1875400222449024:192.168.203.41@tcp:104: 00010000:00010000:2.0:1788521341.395838:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000101ea398/0x411dd0ee4d2d1902 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521341.396276:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521341.396338:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201390336 00000100:00100000:3.0:1788521341.396345:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201390336 00010000:00010000:3.0:1788521341.396389:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019b9cc59/0x411dd0ee4d2d18ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6b1 expref: 8 pid: 8437 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521341.396463:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 61 00000100:00100000:3.0:1788521341.396474:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f08bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+8:2396:x1875400201390336:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521341.396496:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521341.396517:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019b9cc59/0x411dd0ee4d2d18ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6b1 expref: 8 pid: 8437 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.396530:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019b9cc59/0x411dd0ee4d2d18ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6b1 expref: 8 pid: 8437 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.396598:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019b9cc59/0x411dd0ee4d2d18ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6b1 expref: 8 pid: 8437 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.396612:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521341.396616:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521341.396632:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000101ea398/0x411dd0ee4d2d1902 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.396645:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000101ea398/0x411dd0ee4d2d1902 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.396682:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521341.396739:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f08bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+7:2396:x1875400201390336:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 266us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521341.396747:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 61 00010000:00010000:0.0:1788521341.396813:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000101ea398/0x411dd0ee4d2d1902 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.396824:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000101ea398/0x411dd0ee4d2d1902 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.396845:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000101ea398/0x411dd0ee4d2d1902 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.396854:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000101ea398/0x411dd0ee4d2d1902 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.396863:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000101ea398/0x411dd0ee4d2d1902 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.396871:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa200 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:0.0:1788521341.396876:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000101ea398/0x411dd0ee4d2d1902 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.396908:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000101ea398/0x411dd0ee4d2d1902 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.396923:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000101ea398/0x411dd0ee4d2d1902 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.396943:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000101ea398/0x411dd0ee4d2d1902 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521341.396997:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f08ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+6:2396:x1875400201390208:12345-192.168.203.41@tcp:1:lhsmtool_posix.0 Request processed in 3967us (4397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521341.397004:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 40 00000100:00100000:1.0:1788521341.400052:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521341.400701:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201390592 00000100:00100000:2.0:1788521341.400710:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201390592 00000100:00100000:2.0:1788521341.400769:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 93 00000100:00100000:2.0:1788521341.400780:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+14:11322:x1875400201390592:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788521341.400857:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1909 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.400874:0:9815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1749 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed63a expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.400906:0:9815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1909 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.400941:0:9815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1749 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed63a expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.400956:0:9815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1749 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed63a expref: 14 pid: 6519 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521341.400971:0:9815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef50f4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9815:1875400222449152:192.168.203.41@tcp:104: 00000100:00100000:2.0:1788521341.401365:0:9815:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef46193180 going to sleep for 11 seconds 00000100:00100000:1.0:1788521341.405439:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521341.405584:0:9815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef50f4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9815:1875400222449152:192.168.203.41@tcp:104: 00000100:00100000:3.0:1788521341.405611:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201390720 00010000:00010000:2.0:1788521341.405615:0:9815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1909 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521341.405619:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201390720 00010000:00010000:3.0:1788521341.405656:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1749 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed63a expref: 15 pid: 6519 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521341.405718:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 62 00000100:00100000:3.0:1788521341.405727:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4e7e2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+15:2396:x1875400201390720:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521341.405741:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521341.405757:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1749 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed63a expref: 15 pid: 6519 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.405767:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1749 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed63a expref: 15 pid: 6519 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.405785:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1749 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed63a expref: 15 pid: 6519 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.405798:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:3.0:1788521341.405803:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1909 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.405824:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1909 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.405833:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1909 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.405858:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521341.405924:0:9815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1909 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.405940:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1909 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.406100:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1910 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.406113:0:9815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d18ca lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed69c expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.406123:0:9815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1910 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.406149:0:9815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d18ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed69c expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.406163:0:9815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d18ca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed69c expref: 15 pid: 6519 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521341.406177:0:9815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef50f4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9815:1875400222449280:192.168.203.41@tcp:104: 00000100:00100000:2.0:1788521341.406232:0:9815:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef46193300 going to sleep for 11 seconds 00000100:00100000:3.0:1788521341.406293:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4e7e2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+15:2396:x1875400201390720:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 194us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521341.406302:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 62 00000100:00100000:1.0:1788521341.408956:0:9815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef50f4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9815:1875400222449280:192.168.203.41@tcp:104: 00010000:00010000:1.0:1788521341.408984:0:9815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1910 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521341.413120:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521341.413297:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201390848 00000100:00100000:0.0:1788521341.413305:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201390848 00010000:00010000:0.0:1788521341.413341:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d18ca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed69c expref: 15 pid: 6519 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521341.413390:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 63 00000100:00100000:0.0:1788521341.413401:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+15:2395:x1875400201390848:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521341.413415:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521341.413422:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d18ca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed69c expref: 15 pid: 6519 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.413436:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d18ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed69c expref: 15 pid: 6519 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.413458:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d18ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed69c expref: 15 pid: 6519 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.413473:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8fef76505100) 00010000:00010000:0.0:1788521341.413479:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1910 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.413494:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1910 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.413501:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1910 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.414183:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521341.414307:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+14:2395:x1875400201390848:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 905us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521341.414316:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 63 00010000:00010000:1.0:1788521341.414494:0:9815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1910 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.414504:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1910 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788521341.414607:0:9815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1788521341.414714:0:9815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:1.0:1788521341.414747:0:9815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:1.0:1788521341.414820:0:9815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f08b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9815:1875400222449408:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788521341.414866:0:9815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521341.414935:0:9815:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef71dd4480 going to sleep for 11 seconds 00000100:00100000:0.0:1788521341.415131:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222449408 00000100:00100000:0.0:1788521341.415137:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222449408 00000100:00100000:0.0:1788521341.415281:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788521341.415291:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f08a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:9815:x1875400222449408:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788521341.415415:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f08a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:9815:x1875400222449408:12345-0@lo:1000:mdt00_003.0 Request processed in 126us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521341.415422:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788521341.419327:0:9815:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788521341.419339:0:9815:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fee436cea00, transno 4294967304 00000100:00100000:2.0:1788521341.419406:0:9815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f08b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9815:1875400222449408:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788521341.419591:0:9815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1788521341.419666:0:9815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef50f4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9815:1875400222449536:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788521341.419727:0:9815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521341.419757:0:9815:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788521341.419787:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222449536 00000100:00100000:2.0:1788521341.419793:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222449536 00000100:00100000:2.0:1788521341.419835:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788521341.419844:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef50f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9815:x1875400222449536:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788521341.419982:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef50f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9815:x1875400222449536:12345-0@lo:1000:mdt00_003.0 Request processed in 138us (254us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788521341.419990:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788521341.420029:0:9815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef50f4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9815:1875400222449536:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788521341.420065:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1910 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.420077:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1910 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.420085:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1910 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.420091:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521341.420096:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1910 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.420104:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1910 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.420121:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8fef76505100) 00010000:00010000:2.0:1788521341.420125:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788521341.420130:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1910 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.420137:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1910 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.420178:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1845 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.420185:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1845 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.420191:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1845 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.420197:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42411800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521341.420200:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1845 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.420218:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1845 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.420226:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:2.0:1788521341.420229:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788521341.420232:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1845 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.420238:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1845 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.420261:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1917 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.420276:0:9815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1861 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed680 expref: 17 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.420286:0:9815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1917 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.420315:0:9815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1861 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed680 expref: 17 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.420331:0:9815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1861 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed680 expref: 17 pid: 12956 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521341.420342:0:9815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef50f4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9815:1875400222449664:192.168.203.41@tcp:104: 00000100:00100000:2.0:1788521341.420414:0:9815:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788521341.426370:0:9815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef50f4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9815:1875400222449664:192.168.203.41@tcp:104: 00010000:00010000:0.0:1788521341.426399:0:9815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1917 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521341.431541:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521341.431655:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201390976 00000100:00100000:1.0:1788521341.431664:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201390976 00010000:00010000:1.0:1788521341.431700:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1861 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed680 expref: 18 pid: 12956 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521341.431741:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 64 00000100:00100000:1.0:1788521341.431751:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+18:2396:x1875400201390976:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521341.431765:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521341.431773:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1861 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed680 expref: 18 pid: 12956 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.431787:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1861 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed680 expref: 18 pid: 12956 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.431816:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1861 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed680 expref: 18 pid: 12956 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.431830:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:1.0:1788521341.431835:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1917 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.431846:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1917 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.431853:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1917 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.431880:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521341.431958:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+17:2396:x1875400201390976:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 207us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521341.431965:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 64 00010000:00010000:1.0:1788521341.431990:0:9815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1917 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.431998:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1917 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.432010:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1917 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.432017:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1917 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.432024:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1917 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.432036:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7000 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521341.432040:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1917 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.432048:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1917 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.432058:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:1.0:1788521341.432060:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521341.432064:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1917 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.432069:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1917 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.432079:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1909 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.432085:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1909 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.432091:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1909 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.432096:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6000 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521341.432099:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1909 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.432105:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1909 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.436814:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef76505f00) 00010000:00010000:1.0:1788521341.436818:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788521341.436826:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1909 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.436836:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1909 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521341.437588:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+16:11322:x1875400201390592:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 Request processed in 36802us (37538us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788521341.437600:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 93 00000020:00080000:1.0:1788521341.437606:0:9815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788521341.438325:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788521341.438331:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788521341.438350:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788521341.438366:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788521341.442623:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521341.443712:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201391232 00000100:00100000:0.0:1788521341.443723:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201391232 00000100:00100000:0.0:1788521341.443777:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 20 00000100:00100000:0.0:1788521341.443788:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+16:11322:x1875400201391232:12345-192.168.203.41@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788521341.444066:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788521341.444101:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:0.0:1788521341.444142:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d191e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.444157:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d191e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.444169:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d191e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.444178:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d191e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.444185:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d191e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.444191:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d191e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.444465:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788521341.444556:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+18:11322:x1875400201391232:12345-192.168.203.41@tcp:35:lhsmtool_posix.0 Request processed in 770us (1942us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1788521341.444565:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 20 00000020:00080000:0.0:1788521341.444570:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788521341.444845:0:13735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521341.444853:0:13735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d191e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.444862:0:13735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410400 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:2.0:1788521341.444867:0:13735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d191e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.444875:0:13735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d191e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.444916:0:13735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8fef76505100) 00010000:00010000:2.0:1788521341.444920:0:13735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788521341.444925:0:13735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d191e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.444932:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d191e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.444955:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521341.444957:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521341.444959:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788521341.481339:0:14214:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788521341.481348:0:14214:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788521341.481401:0:14214:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788521341.481409:0:14214:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788521341.582212:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788521341.582239:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef50f4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222449792:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788521341.582316:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521341.582396:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222449792 00000100:00100000:2.0:1788521341.582405:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222449792 00000100:00100000:2.0:1788521341.582454:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788521341.582465:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef50f4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222449792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788521341.582503:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788521341.582568:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef50f4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222449792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521341.582575:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788521341.582636:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef50f4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222449792:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788521341.589518:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee436ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222449920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788521341.589601:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521341.589790:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222449920 00000100:00100000:1.0:1788521341.589799:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222449920 00000100:00100000:1.0:1788521341.589856:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788521341.589865:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef50f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222449920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788521341.589909:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:1.0:1788521341.591344:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef50f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222449920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1474us (1737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521341.591367:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788521341.591485:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee436ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222449920:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788521341.597594:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521341.597711:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201391488 00000100:00100000:3.0:1788521341.597722:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201391488 00000100:00100000:3.0:1788521341.597781:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 94 00000100:00100000:3.0:1788521341.597792:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f08b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+18:11332:x1875400201391488:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:3.0:1788521341.597818:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521341.597839:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1925 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed6b8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.597981:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d192c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.597996:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d192c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.598007:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d192c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521341.598019:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788521341.598135:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1925 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6b8 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.598153:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d192c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6b8 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.598162:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:3.0:1788521341.598165:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788521341.598169:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749ca200, rc 0) 00000100:00100000:3.0:1788521341.598224:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f08b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+20:11332:x1875400201391488:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 434us (638us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788521341.598238:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 94 00000100:00100000:3.0:1788521341.601729:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521341.601814:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201391616 00000100:00100000:1.0:1788521341.601824:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201391616 00000100:00100000:1.0:1788521341.601911:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 95 00000100:00100000:1.0:1788521341.601922:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+20:11332:x1875400201391616:12345-192.168.203.41@tcp:34:lfs.0 00010000:00010000:1.0:1788521341.602000:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d193a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.602030:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d193a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.602043:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d193a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.602060:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1941 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.602067:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1941 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.602073:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1941 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.602155:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1948 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.602163:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1948 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.602170:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1948 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788521341.602217:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1948 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.602230:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d193a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.602236:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d193a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.602253:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d193a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.602258:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aaa00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521341.602262:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d193a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.602270:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d193a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.602282:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:1.0:1788521341.602285:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521341.602291:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d193a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.602297:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d193a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.602309:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1941 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.602314:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1941 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.602320:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1941 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.602324:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434ab600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521341.602328:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1941 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.602343:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1941 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.602360:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8fef71ec0000) 00010000:00010000:1.0:1788521341.602363:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521341.602366:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1941 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.602372:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1941 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.602389:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1948 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.602395:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1948 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.602401:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1948 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.602407:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aac00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521341.602409:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1948 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.602415:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1948 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.602422:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fef71ec0b00) 00010000:00010000:1.0:1788521341.602424:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521341.602427:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1948 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.602443:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1948 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521341.602518:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+20:11332:x1875400201391616:12345-192.168.203.41@tcp:34:lfs.0 Request processed in 597us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521341.602526:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 95 00000100:00100000:1.0:1788521341.680985:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521341.681028:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201391872 00000100:00100000:0.0:1788521341.681038:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201391872 00000100:00100000:0.0:1788521341.681141:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 96 00000100:00100000:0.0:1788521341.681152:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f08a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+20:11335:x1875400201391872:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:0.0:1788521341.681187:0:9815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521341.681209:0:9815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d194f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed6bf expref: -99 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.681281:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1956 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.681297:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1956 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.681308:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1956 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.681322:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d195d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.681330:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d195d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.681336:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d195d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.681450:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1964 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.681459:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1964 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.681467:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1964 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521341.681476:0:9815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788521341.681564:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1956 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.681572:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1956 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.681579:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1956 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.681585:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410a00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521341.681589:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1956 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.681596:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1956 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.681607:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:0.0:1788521341.681610:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521341.681615:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1956 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.681621:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1956 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.681633:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d195d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.681639:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d195d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.681645:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d195d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.681650:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410400 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521341.681659:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d195d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.681665:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d195d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.681672:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8fee42476900) 00010000:00010000:0.0:1788521341.681674:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521341.681677:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d195d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.681696:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d195d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.681736:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d194f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6bf expref: 23 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.681750:0:9815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1964 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6bf expref: 22 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.681758:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fee42476700) 00010000:00010000:0.0:1788521341.681760:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788521341.681762:0:9815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411800, rc 0) 00000100:00100000:0.0:1788521341.681827:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f08a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+22:11335:x1875400201391872:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 676us (851us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788521341.681833:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 96 00000100:00100000:1.0:1788521341.696235:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521341.696410:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201392000 00000100:00100000:2.0:1788521341.696421:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201392000 00000100:00100000:2.0:1788521341.696484:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 97 00000100:00100000:2.0:1788521341.696494:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f08bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+22:11335:x1875400201392000:12345-192.168.203.41@tcp:54:lfs.0 00010000:00010000:2.0:1788521341.696725:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1972 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.696760:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1972 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.696773:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1972 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.696812:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1972 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.697477:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1972 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.697486:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1972 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.697492:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521341.697498:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1972 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.697507:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1972 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.697521:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fee42476700) 00010000:00010000:2.0:1788521341.697695:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521341.697702:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1972 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.697709:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1972 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521341.697836:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f08bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+22:11335:x1875400201392000:12345-192.168.203.41@tcp:54:lfs.0 Request processed in 1341us (1607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521341.697855:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 97 00000100:00100000:1.0:1788521341.701447:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521341.702297:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201392256 00000100:00100000:0.0:1788521341.702307:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201392256 00000100:00100000:2.0:1788521341.702516:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 21 00000100:00100000:2.0:1788521341.702536:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6d4a8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+22:11335:x1875400201392256:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:2.0:1788521341.702777:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6d4a8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+23:11335:x1875400201392256:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 251us (1338us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1788521341.702784:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 21 00000100:00100000:1.0:1788521341.766538:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521341.766640:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201392512 00000100:00100000:3.0:1788521341.766650:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201392512 00000100:00100000:3.0:1788521341.766713:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 98 00000100:00100000:3.0:1788521341.766724:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f088700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+23:10862:x1875400201392512:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:3.0:1788521341.766748:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521341.766768:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1979 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed6c6 expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.766933:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1980 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.766948:0:12956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1964 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6bf expref: 24 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.766956:0:12956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1980 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.766988:0:12956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1964 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6bf expref: 24 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.767001:0:12956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1964 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6bf expref: 24 pid: 9815 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521341.767015:0:12956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee436cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12956:1875400222450048:192.168.203.41@tcp:104: 00000100:00100000:3.0:1788521341.767117:0:12956:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee434c6480 going to sleep for 11 seconds 00000100:00100000:3.0:1788521341.770385:0:12956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee436cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12956:1875400222450048:192.168.203.41@tcp:104: 00010000:00010000:3.0:1788521341.770425:0:12956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1980 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521341.771406:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521341.771505:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201392640 00000100:00100000:0.0:1788521341.771521:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201392640 00010000:00010000:0.0:1788521341.771588:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1964 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6bf expref: 25 pid: 9815 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521341.771704:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 65 00000100:00100000:0.0:1788521341.771716:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fcad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+25:2396:x1875400201392640:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521341.771730:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521341.771738:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1964 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6bf expref: 25 pid: 9815 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.771751:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1964 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6bf expref: 25 pid: 9815 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.771775:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1964 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6bf expref: 25 pid: 9815 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.771792:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fee42476700) 00010000:00010000:0.0:1788521341.771798:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1980 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.771817:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1980 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.771825:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1980 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.771851:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521341.771958:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fcad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+24:2396:x1875400201392640:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 243us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521341.771971:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 65 00010000:00010000:3.0:1788521341.772541:0:12956:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1980 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.772555:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1980 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521341.772584:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788521341.772809:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1979 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6c6 expref: 25 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.772830:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1980 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6c6 expref: 24 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.772839:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fee42476700) 00010000:00010000:3.0:1788521341.772842:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788521341.772846:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749cb200, rc 0) 00000100:00100000:3.0:1788521341.773205:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f088700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+24:10862:x1875400201392512:12345-192.168.203.41@tcp:101:bash.0 Request processed in 6340us (6533us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1788521341.773215:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 98 00000100:00100000:3.0:1788521341.777557:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521341.777692:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201392768 00000100:00100000:2.0:1788521341.777705:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201392768 00000100:00100000:2.0:1788521341.777787:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 99 00000100:00100000:2.0:1788521341.777799:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+24:10862:x1875400201392768:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:2.0:1788521341.777829:0:9815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521341.777860:0:9815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d198e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed6cd expref: -99 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.777937:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1995 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.777955:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1995 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.777971:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1995 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.778267:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d198e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6cd expref: 26 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.778291:0:9815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1995 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6cd expref: 25 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.778310:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fee42476700) 00010000:00010000:2.0:1788521341.778313:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788521341.778319:0:9815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7800, rc 0) 00000100:00100000:2.0:1788521341.778450:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+25:10862:x1875400201392768:12345-192.168.203.41@tcp:101:bash.0 Request processed in 653us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521341.778457:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 99 00000100:00100000:2.0:1788521341.782589:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521341.783824:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201393024 00000100:00100000:0.0:1788521341.783840:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201393024 00000100:00100000:0.0:1788521341.784064:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 100 00000100:00100000:0.0:1788521341.784079:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef50f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+25:10862:x1875400201393024:12345-192.168.203.41@tcp:36:bash.0 00010000:00010000:2.0:1788521341.784478:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d199c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.784510:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d199c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.784525:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d199c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521341.784590:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:2.0:1788521341.784615:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002442c552 reply state 000000001ed7817b transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d199c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.784629:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d199c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.784638:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fee42476700) 00010000:00010000:2.0:1788521341.784641:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788521341.784646:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788521341.784683:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:2.0:1788521341.784824:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef50f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+29:10862:x1875400201393024:12345-192.168.203.41@tcp:36:bash.0 Request processed in 747us (2250us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788521341.784857:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 100 00000020:00080000:2.0:1788521341.784875:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788521341.791249:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521341.792287:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201393152 00000100:00100000:0.0:1788521341.792303:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201393152 00000100:00100000:0.0:1788521341.792409:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 101 00000100:00100000:0.0:1788521341.792421:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+29:10862:x1875400201393152:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:0.0:1788521341.792454:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521341.792483:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d19a3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed6d4 expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.792568:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d19a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6d4 expref: 30 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.792592:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d19a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6d4 expref: 30 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.792614:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fee42476700) 00010000:00010000:0.0:1788521341.792618:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788521341.792623:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411800, rc 0) 00000100:00100000:0.0:1788521341.792709:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+30:10862:x1875400201393152:12345-192.168.203.41@tcp:101:bash.0 Request processed in 290us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521341.792717:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 101 00000100:00100000:3.0:1788521341.796999:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521341.797122:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201393280 00000100:00100000:0.0:1788521341.797136:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201393280 00000100:00100000:0.0:1788521341.797210:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 41 00000100:00100000:0.0:1788521341.797222:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+6:10862:x1875400201393280:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:0.0:1788521341.797259:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521341.797284:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002619fa51/0x411dd0ee4d2d19aa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed6db expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788521341.797316:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9aab7b, atime: 0x6a9aab79, ctime: 0x6a9aab7b, blocks: 0x8 00010000:00010000:0.0:1788521341.797343:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=391s v=(0 0) 00010000:00010000:0.0:1788521341.797348:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521341.797554:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002619fa51/0x411dd0ee4d2d19aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6db expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.797575:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002619fa51/0x411dd0ee4d2d19aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6db expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.797591:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42410400, rc 0) 00000100:00100000:0.0:1788521341.797672:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+7:10862:x1875400201393280:12345-192.168.203.41@tcp:101:bash.0 Request processed in 452us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521341.797679:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 41 00000100:00100000:2.0:1788521341.802552:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521341.802849:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201393408 00000100:00100000:1.0:1788521341.802866:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201393408 00002000:00010000:1.0:1788521341.803094:0:8440:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:1.0:1788521341.803100:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fef50f4ed80 with x1875400201393408 ext(0->18446744073709551615) 00002000:00010000:1.0:1788521341.803115:0:8440:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fef50f4ed80. 00000100:00100000:1.0:1788521341.803163:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 1 00000100:00100000:1.0:1788521341.803174:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef50f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc75e887-507e-4861-8203-e266d82f5177+7:2396:x1875400201393408:12345-192.168.203.41@tcp:10:bash.0 00002000:00010000:1.0:1788521341.803457:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788521341.803461:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788521339 -> 1788521341 00002000:00010000:1.0:1788521341.803463:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1788521337 -> 1788521337 00002000:00010000:1.0:1788521341.803465:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788521339 -> 1788521341 00002000:00010000:1.0:1788521341.803467:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1788521341.803542:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef50f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fc75e887-507e-4861-8203-e266d82f5177+8:2396:x1875400201393408:12345-192.168.203.41@tcp:10:bash.0 Request processed in 369us (1002us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788521341.803550:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 1 00002000:00010000:1.0:1788521341.803564:0:8440:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:1.0:1788521341.803567:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fef50f4ed80 with x1875400201393408 ext(0->18446744073709551615) 00002000:00010000:1.0:1788521341.803572:0:8440:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fef50f4ed80. 00000100:00100000:3.0:1788521341.902589:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521341.902728:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201393536 00000100:00100000:2.0:1788521341.902741:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201393536 00000100:00100000:2.0:1788521341.902827:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 102 00000100:00100000:2.0:1788521341.902838:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+30:11349:x1875400201393536:12345-192.168.203.41@tcp:34:lfs.0 00010000:00010000:2.0:1788521341.902965:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d19b1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.902987:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d19b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.903010:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d19b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.903027:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d19b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.903035:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d19b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.903043:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d19b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.903476:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d19bf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.903489:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d19bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.903518:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d19bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788521341.903576:0:9815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d19bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.903589:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d19b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.903596:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d19b1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.903604:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d19b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.903610:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7000 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521341.903616:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d19b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.903624:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d19b1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.903638:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:2.0:1788521341.903642:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521341.903647:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d19b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.903654:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d19b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.903669:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d19b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.903683:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d19b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.903688:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d19b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.903693:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521341.903696:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d19b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.903704:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d19b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.903712:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8fee410f7d00) 00010000:00010000:2.0:1788521341.903715:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521341.903718:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d19b8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.903725:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d19b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.903742:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d19bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.903748:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d19bf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.903754:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d19bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.903759:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7200 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521341.903767:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d19bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.904403:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d19bf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.904415:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fee42476700) 00010000:00010000:2.0:1788521341.904419:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521341.904422:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d19bf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521341.904430:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d19bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521341.904628:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+30:11349:x1875400201393536:12345-192.168.203.41@tcp:34:lfs.0 Request processed in 1786us (2047us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521341.904639:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 102 00000100:00100000:3.0:1788521341.939546:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521341.940473:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201393792 00000100:00100000:1.0:1788521341.940488:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201393792 00000100:00100000:1.0:1788521341.940576:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 103 00000100:00100000:1.0:1788521341.940587:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+30:11352:x1875400201393792:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:1.0:1788521341.940614:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521341.940641:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d19c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed6e2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.940746:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d19cd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.940764:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d19cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.940782:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d19cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.940802:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d19d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.940809:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d19d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.940825:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d19d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.941637:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d19db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.941748:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d19db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.941760:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d19db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521341.941774:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788521341.942103:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d19cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.942208:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d19cd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.942217:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d19cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.942223:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521341.942228:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d19cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.942237:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d19cd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.942251:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:1.0:1788521341.942254:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521341.942259:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d19cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.942267:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d19cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.942283:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d19d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.942296:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d19d4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.942302:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d19d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.942307:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aaa00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521341.942310:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d19d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.942316:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d19d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.942323:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8fef71ec0b00) 00010000:00010000:1.0:1788521341.942325:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521341.942328:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d19d4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.942333:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d19d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.942402:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d19c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6e2 expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.942416:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d19db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6e2 expref: 32 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521341.942424:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fee42476700) 00010000:00010000:1.0:1788521341.942427:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788521341.942435:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434ab600, rc 0) 00000100:00100000:1.0:1788521341.942522:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+32:11352:x1875400201393792:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 1935us (2991us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1788521341.942531:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 103 00000100:00100000:1.0:1788521341.951278:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521341.951382:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201393920 00000100:00100000:0.0:1788521341.951396:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201393920 00000100:00100000:0.0:1788521341.951478:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 104 00000100:00100000:0.0:1788521341.951490:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+32:11352:x1875400201393920:12345-192.168.203.41@tcp:54:lfs.0 00010000:00010000:0.0:1788521341.951577:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d19e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.951597:0:12956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1980 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6c6 expref: 32 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.951632:0:12956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d19e9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.951685:0:12956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1980 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6c6 expref: 32 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.951701:0:12956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1980 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6c6 expref: 32 pid: 12956 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521341.951717:0:12956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12956:1875400222450176:192.168.203.41@tcp:104: 00000100:00100000:0.0:1788521341.952293:0:12956:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef55479c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788521341.957003:0:12956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12956:1875400222450176:192.168.203.41@tcp:104: 00010000:00010000:0.0:1788521341.957060:0:12956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d19e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521341.961006:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521341.961438:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201394176 00000100:00100000:3.0:1788521341.961470:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201394176 00000100:00100000:3.0:1788521341.961544:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 22 00000100:00100000:3.0:1788521341.961556:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+33:6166:x1875400201394176:12345-192.168.203.41@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788521341.962024:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+34:6166:x1875400201394176:12345-192.168.203.41@tcp:35:ldlm_bl.0 Request processed in 468us (1031us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788521341.962033:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 22 00000100:00100000:2.0:1788521341.965438:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521341.965530:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201394304 00000100:00100000:3.0:1788521341.965546:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201394304 00010000:00010000:3.0:1788521341.965602:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1980 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6c6 expref: 34 pid: 12956 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521341.965756:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 66 00000100:00100000:3.0:1788521341.965768:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef50f4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+34:2393:x1875400201394304:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521341.965787:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521341.965796:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1980 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6c6 expref: 34 pid: 12956 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.965811:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1980 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6c6 expref: 34 pid: 12956 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.965839:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1980 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6c6 expref: 34 pid: 12956 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.965858:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fee42476700) 00010000:00010000:3.0:1788521341.965864:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d19e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.965948:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d19e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.965957:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d19e9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521341.965984:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521341.966047:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef50f4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+33:2393:x1875400201394304:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 281us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521341.966055:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 66 00010000:00010000:0.0:1788521341.966137:0:12956:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d19e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.966146:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d19e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.966195:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d19e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.966204:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d19e9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.966211:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d19e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.966225:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410a00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521341.966230:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d19e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.966239:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d19e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.966250:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fee42476700) 00010000:00010000:0.0:1788521341.966253:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788521341.966257:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d19e9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521341.966264:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d19e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521341.966308:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+32:11352:x1875400201393920:12345-192.168.203.41@tcp:54:lfs.0 Request processed in 14821us (15046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521341.966316:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 104 00000100:00100000:0.0:1788521341.970907:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521341.970973:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201394560 00000100:00100000:3.0:1788521341.970987:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201394560 00000100:00100000:3.0:1788521341.971059:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 23 00000100:00100000:3.0:1788521341.971073:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+32:11352:x1875400201394560:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:3.0:1788521341.971389:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+33:11352:x1875400201394560:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 318us (514us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788521341.971399:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 23 00000100:00100000:2.0:1788521342.083018:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521342.083297:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201394816 00000100:00100000:0.0:1788521342.083310:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201394816 00000100:00100000:0.0:1788521342.083690:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 105 00000100:00100000:0.0:1788521342.083731:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef50f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+33:11363:x1875400201394816:12345-192.168.203.41@tcp:101:cat.0 00010000:00010000:0.0:1788521342.083754:0:9815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521342.083775:0:9815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d19f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed6e9 expref: -99 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.083846:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d19f7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.083962:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d19f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.083975:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d19f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.083992:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d19fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.083999:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d19fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.084005:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d19fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.084112:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1a05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.084122:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1a05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.084129:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1a05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521342.084139:0:9815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788521342.084231:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d19f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.084237:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d19f7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.084244:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d19f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.084256:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42411e00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521342.084260:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d19f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.084268:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d19f7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.084282:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:0.0:1788521342.084285:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521342.084296:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d19f7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.084304:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d19f7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.084319:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d19fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.084326:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d19fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.084332:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d19fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.084337:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410000 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521342.084340:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d19fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.084345:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d19fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.084373:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8fee42476500) 00010000:00010000:0.0:1788521342.084376:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521342.084379:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d19fe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.084386:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d19fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.084432:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d19f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6e9 expref: 36 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.084446:0:9815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1a05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6e9 expref: 35 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.084453:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fee42476700) 00010000:00010000:0.0:1788521342.084460:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788521342.084463:0:9815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411c00, rc 0) 00000100:00100000:0.0:1788521342.084709:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef50f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+35:11363:x1875400201394816:12345-192.168.203.41@tcp:101:cat.0 Request processed in 1006us (1703us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788521342.084716:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 105 00000100:00100000:2.0:1788521342.093867:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521342.094284:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201395072 00000100:00100000:0.0:1788521342.094294:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201395072 00000100:00100000:0.0:1788521342.094372:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 24 00000100:00100000:0.0:1788521342.094382:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef50f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+35:11363:x1875400201395072:12345-192.168.203.41@tcp:35:cat.0 00000100:00100000:0.0:1788521342.095416:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef50f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+36:11363:x1875400201395072:12345-192.168.203.41@tcp:35:cat.0 Request processed in 1031us (1555us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788521342.095426:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 24 00000100:00100000:2.0:1788521342.129779:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521342.133538:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201395328 00000100:00100000:1.0:1788521342.133552:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201395328 00000100:00100000:1.0:1788521342.133795:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 106 00000100:00100000:1.0:1788521342.133808:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef50f4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+36:11364:x1875400201395328:12345-192.168.203.41@tcp:36:rm.0 00010000:00010000:1.0:1788521342.133865:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1788521342.133929:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d19a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6d4 expref: 36 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.133952:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1a05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6e9 expref: 35 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.133964:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d19db lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6e2 expref: 34 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.133976:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1995 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6cd expref: 33 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.133986:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fee42476700) 00010000:00010000:1.0:1788521342.133991:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788521342.134013:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1a13 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.134044:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1a13 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.134054:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1a13 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.134068:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1a1a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.134075:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1a1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.134082:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1a1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.134157:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1a21 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.134165:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1a21 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.134172:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1a21 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788521342.134406:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00010000:00010000:1.0:1788521342.134448:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1a28 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.134457:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1a28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.134465:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1a28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.134479:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1a28 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.134486:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1a28 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.134492:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1a28 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.134521:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788521342.134538:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1a21 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.134545:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1a21 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.134551:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1a21 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.134556:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521342.134560:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1a21 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.134567:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1a21 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.134576:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fee42476700) 00010000:00010000:1.0:1788521342.134579:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788521342.134582:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1a21 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.134598:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1a21 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.134614:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1a13 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.134631:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1a13 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.134637:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1a13 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.134642:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aba00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521342.134646:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1a13 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.134659:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1a13 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.134668:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:1.0:1788521342.134670:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521342.134673:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1a13 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.134679:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1a13 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788521342.134688:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a1e13112 reply state 0000000073dd7557 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1a1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.134699:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1a1a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.134712:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8fef71ec0b00) 00010000:00010000:1.0:1788521342.134714:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788521342.134717:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788521342.134787:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef50f4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+34:11364:x1875400201395328:12345-192.168.203.41@tcp:36:rm.0 Request processed in 981us (5016us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1788521342.134794:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 106 00010000:00010000:3.0:1788521342.136686:0:13734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521342.136697:0:13734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1a28 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521342.136706:0:13734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aac00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:3.0:1788521342.136710:0:13734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1a28 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521342.136719:0:13734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1a28 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521342.136750:0:13734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fee42476700) 00010000:00010000:3.0:1788521342.136752:0:13734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788521342.136756:0:13734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1a28 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521342.136762:0:13734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1a28 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521342.136775:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521342.136777:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521342.136779:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521342.159270:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521342.207142:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521342.207290:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201395584 00000100:00100000:0.0:1788521342.207299:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201395584 00000100:00100000:0.0:1788521342.207368:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 107 00000100:00100000:0.0:1788521342.207378:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef50f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+34:11369:x1875400201395584:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:0.0:1788521342.207403:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521342.207423:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1a2f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed6f0 expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.207537:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1a36 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.208023:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1a36 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.208038:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1a36 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.208052:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1a3d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.208059:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1a3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.208066:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1a3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788521342.208449:0:12956:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788521342.209025:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1a44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.209038:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1a44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.209059:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1a44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.209093:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1a36 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.209100:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1a36 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.209107:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1a36 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.214248:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42411e00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521342.214256:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1a36 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.214267:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1a36 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.214287:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:0.0:1788521342.214290:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521342.214296:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1a36 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.214303:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1a36 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788521342.214324:0:12956:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8e6291c reply state 0000000060ef8245 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1a3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.214338:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1a3d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.214372:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8fef71ec0b00) 00010000:00010000:0.0:1788521342.214374:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788521342.214378:0:12956:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788521342.214433:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1a2f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6f0 expref: 37 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.214451:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1a44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6f0 expref: 36 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.214459:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee42476500) 00010000:00010000:0.0:1788521342.214461:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788521342.214464:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42410a00, rc 0) 00000100:00100000:0.0:1788521342.214545:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef50f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+37:11369:x1875400201395584:12345-192.168.203.41@tcp:101:bash.0 Request processed in 7168us (7411us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1788521342.216263:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 107 00000100:00100000:0.0:1788521342.218242:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521342.218379:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201395712 00000100:00100000:3.0:1788521342.218389:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201395712 00000100:00100000:3.0:1788521342.218442:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 42 00000100:00100000:3.0:1788521342.218453:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58375880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc75e887-507e-4861-8203-e266d82f5177+7:2396:x1875400201395712:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:3.0:1788521342.218472:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521342.218493:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea1ca7e4/0x411dd0ee4d2d1a52 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed6f7 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788521342.218521:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788521342.218543:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=392s v=(0 0) 00010000:00010000:3.0:1788521342.218547:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521342.218627:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea1ca7e4/0x411dd0ee4d2d1a52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6f7 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521342.218649:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ea1ca7e4/0x411dd0ee4d2d1a52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6f7 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521342.218694:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749cb200, rc 0) 00000100:00100000:3.0:1788521342.218755:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58375880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc75e887-507e-4861-8203-e266d82f5177+8:2396:x1875400201395712:12345-192.168.203.41@tcp:101:bash.0 Request processed in 304us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521342.218763:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 42 00000100:00100000:2.0:1788521342.231412:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521342.231491:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201395840 00000100:00100000:1.0:1788521342.231502:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201395840 00000100:00100000:1.0:1788521342.231569:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 43 00000100:00100000:1.0:1788521342.231581:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef50f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+8:11369:x1875400201395840:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:1.0:1788521342.231602:0:8875:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521342.231624:0:8875:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000620e55af/0x411dd0ee4d2d1a59 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed6fe expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.231656:0:8875:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea1ca7e4/0x411dd0ee4d2d1a52 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6f7 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.231667:0:8875:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521342.231671:0:8875:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521342.231676:0:8875:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000620e55af/0x411dd0ee4d2d1a59 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6fe expref: 9 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.231710:0:8875:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ea1ca7e4/0x411dd0ee4d2d1a52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6f7 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.231726:0:8875:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ea1ca7e4/0x411dd0ee4d2d1a52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6f7 expref: 9 pid: 8437 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521342.231755:0:8875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef44fc8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8875:1875400222450304:192.168.203.41@tcp:104: 00000100:00100000:1.0:1788521342.231864:0:8875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef71dd4180 going to sleep for 11 seconds 00000100:00100000:1.0:1788521342.236320:0:8875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef44fc8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8875:1875400222450304:192.168.203.41@tcp:104: 00010000:00010000:1.0:1788521342.236370:0:8875:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000620e55af/0x411dd0ee4d2d1a59 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6fe expref: 9 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.236391:0:8875:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434aba00, rc 0) 00000100:00100000:1.0:1788521342.236517:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef50f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+9:11369:x1875400201395840:12345-192.168.203.41@tcp:101:bash.0 Request processed in 4937us (5114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521342.236526:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 43 00000100:00100000:2.0:1788521342.257389:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521342.258024:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201395968 00000100:00100000:3.0:1788521342.258035:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201395968 00010000:00010000:3.0:1788521342.258077:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ea1ca7e4/0x411dd0ee4d2d1a52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6f7 expref: 9 pid: 8437 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521342.258110:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 67 00000100:00100000:3.0:1788521342.258127:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f077800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+9:2395:x1875400201395968:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521342.258141:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521342.258160:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ea1ca7e4/0x411dd0ee4d2d1a52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6f7 expref: 9 pid: 8437 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521342.258176:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ea1ca7e4/0x411dd0ee4d2d1a52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6f7 expref: 9 pid: 8437 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521342.258200:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea1ca7e4/0x411dd0ee4d2d1a52 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6f7 expref: 9 pid: 8437 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521342.258218:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521342.258222:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521342.258231:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000620e55af/0x411dd0ee4d2d1a59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6fe expref: 8 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521342.258253:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000620e55af/0x411dd0ee4d2d1a59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6fe expref: 8 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521342.258291:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000620e55af/0x411dd0ee4d2d1a59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6fe expref: 8 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521342.258306:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee436cd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6504:1875400222450432:192.168.203.41@tcp:105: 00000100:00100000:3.0:1788521342.258394:0:6504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee434c6840 going to sleep for 11 seconds 00000100:00100000:3.0:1788521342.277089:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee436cd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6504:1875400222450432:192.168.203.41@tcp:105: 00010000:00010000:3.0:1788521342.277116:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521342.277233:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f077800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+8:2395:x1875400201395968:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 19105us (19852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521342.277244:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 67 00000100:00100000:2.0:1788521342.292550:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521342.292675:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201396224 00000100:00100000:3.0:1788521342.292685:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201396224 00000100:00100000:3.0:1788521342.292743:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 25 00000100:00100000:3.0:1788521342.292753:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+37:11369:x1875400201396224:12345-192.168.203.41@tcp:35:bash.0 00000100:00100000:3.0:1788521342.293047:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+38:11369:x1875400201396224:12345-192.168.203.41@tcp:35:bash.0 Request processed in 295us (506us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1788521342.293054:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 25 00000100:00100000:2.0:1788521342.550929:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521342.551039:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201396352 00000100:00100000:0.0:1788521342.551049:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201396352 00000100:00100000:0.0:1788521342.551110:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 108 00000100:00100000:0.0:1788521342.551121:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+38:11386:x1875400201396352:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:0.0:1788521342.551142:0:9815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521342.551163:0:9815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1a60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed705 expref: -99 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.551226:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1a67 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.551253:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1a67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.551264:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1a67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521342.551304:0:9815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788521342.551308:0:9815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788521342.551327:0:9815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1a67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.551359:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1a60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed705 expref: 40 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.551379:0:9815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1a67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed705 expref: 39 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.551389:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:0.0:1788521342.551392:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788521342.551394:0:9815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411c00, rc 0) 00000100:00100000:0.0:1788521342.551460:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+39:11386:x1875400201396352:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 342us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521342.551475:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 108 00000100:00100000:2.0:1788521342.559257:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521342.559370:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201396608 00000100:00100000:1.0:1788521342.559387:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201396608 00000100:00100000:1.0:1788521342.559479:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 109 00000100:00100000:1.0:1788521342.559491:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+39:11386:x1875400201396608:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:1.0:1788521342.559643:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521342.559667:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1a6e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed70c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.559783:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1a75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.559798:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1a75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.559809:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1a75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521342.559836:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788521342.560003:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1a6e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed70c expref: 42 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.560023:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1a75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed70c expref: 41 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.560032:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee42476500) 00010000:00010000:1.0:1788521342.560034:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521342.560038:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434ab600, rc 0) 00000100:00100000:1.0:1788521342.560104:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+41:11386:x1875400201396608:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 615us (863us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1788521342.560112:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 109 00000100:00100000:3.0:1788521342.564308:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521342.564377:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521342.564439:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201396864 00000100:00100000:0.0:1788521342.564452:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201396864 00000100:00100000:0.0:1788521342.564526:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 110 00000100:00100000:0.0:1788521342.564537:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+41:11386:x1875400201396864:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:0.0:1788521342.564565:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521342.564606:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1a83 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed713 expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521342.564622:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201396992 00000100:00100000:1.0:1788521342.564637:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201396992 00000100:00100000:1.0:1788521342.564710:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 7 00000100:00100000:1.0:1788521342.564721:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f070700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+43:2393:x1875400201396992:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521342.564737:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521342.564757:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1a8a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.564769:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1a75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed70c expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.564779:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1a8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.564794:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee42476500) 00010000:00010000:0.0:1788521342.564798:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1a8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.564803:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:0.0:1788521342.564816:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00000100:00100000:1.0:1788521342.564866:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f070700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+42:2393:x1875400201396992:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 145us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521342.564875:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 7 00010000:00010000:0.0:1788521342.564982:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1a83 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed713 expref: 43 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.565002:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1a8a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed713 expref: 42 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.565011:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee42476500) 00010000:00010000:0.0:1788521342.565014:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788521342.565017:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411800, rc 0) 00000100:00100000:0.0:1788521342.565062:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+42:11386:x1875400201396864:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 527us (769us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1788521342.565069:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 110 00000100:00100000:2.0:1788521342.578326:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521342.578556:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201397120 00000100:00100000:3.0:1788521342.578569:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201397120 00000100:00100000:3.0:1788521342.578662:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 44 00000100:00100000:3.0:1788521342.578674:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc75e887-507e-4861-8203-e266d82f5177+8:2395:x1875400201397120:12345-192.168.203.41@tcp:1:lfs.0 00010000:00010000:3.0:1788521342.578733:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea1ca7e4/0x411dd0ee4d2d1a98 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521342.578770:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000620e55af/0x411dd0ee4d2d1a59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6fe expref: 8 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521342.578779:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521342.578784:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521342.578789:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea1ca7e4/0x411dd0ee4d2d1a98 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521342.578834:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000620e55af/0x411dd0ee4d2d1a59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6fe expref: 8 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521342.578850:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000620e55af/0x411dd0ee4d2d1a59 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6fe expref: 8 pid: 8875 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521342.578866:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f071500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1875400222450560:192.168.203.41@tcp:104: 00000100:00100000:3.0:1788521342.579026:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee434c6600 going to sleep for 11 seconds 00000100:00100000:3.0:1788521342.581800:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f071500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1875400222450560:192.168.203.41@tcp:104: 00010000:00010000:3.0:1788521342.581840:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ea1ca7e4/0x411dd0ee4d2d1a98 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521342.583769:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521342.584547:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201397248 00000100:00100000:1.0:1788521342.584561:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201397248 00002000:00100000:1.0:1788521342.584635:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8fee43d20380 x1875400201397248/t0(0) o4->fc75e887-507e-4861-8203-e266d82f5177@192.168.203.41@tcp:343/0 lens 504/0 e 0 to 0 dl 1788521353 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788521342.584648:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fee43d20380 with x1875400201397248 ext(0->8) 00010000:00010000:1.0:1788521342.584658:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000620e55af/0x411dd0ee4d2d1a59 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6fe expref: 9 pid: 8875 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.584734:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000620e55af/0x411dd0ee4d2d1a59 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6fe expref: 9 pid: 8875 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788521342.584743:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8fee43d20380 00000100:00100000:1.0:1788521342.584979:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 1 00000100:00100000:1.0:1788521342.584992:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc75e887-507e-4861-8203-e266d82f5177+9:2395:x1875400201397248:12345-192.168.203.41@tcp:4:lfs.0 00000100:00100000:1.0:1788521342.586847:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc75e887-507e-4861-8203-e266d82f5177+11:2395:x1875400201397248:12345-192.168.203.41@tcp:4:lfs.0 Request processed in 1846us (3081us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788521342.586862:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 1 00002000:00100000:1.0:1788521342.586874:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8fee43d20380 x1875400201397248/t4294967303(0) o4->fc75e887-507e-4861-8203-e266d82f5177@192.168.203.41@tcp:343/0 lens 504/448 e 0 to 0 dl 1788521353 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788521342.586912:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fee43d20380 with x1875400201397248 ext(0->8) 00010000:00010000:1.0:1788521342.586923:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000620e55af/0x411dd0ee4d2d1a59 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6fe expref: 11 pid: 8875 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.586943:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000620e55af/0x411dd0ee4d2d1a59 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6fe expref: 11 pid: 8875 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788521342.586971:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8fee43d20380 00000100:00100000:2.0:1788521342.591139:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521342.591313:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201397376 00000100:00100000:3.0:1788521342.591405:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201397376 00010000:00010000:3.0:1788521342.591447:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000620e55af/0x411dd0ee4d2d1a59 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6fe expref: 11 pid: 8875 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521342.591584:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 68 00000100:00100000:3.0:1788521342.591595:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4e7e3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+11:2396:x1875400201397376:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521342.591611:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788521342.591638:0:6504:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788521342.591642:0:6504:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788521341 00002000:00010000:3.0:1788521342.591644:0:6504:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788521341 00002000:00010000:3.0:1788521342.591647:0:6504:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788521341 00002000:00010000:3.0:1788521342.591649:0:6504:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788521342.591655:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000620e55af/0x411dd0ee4d2d1a59 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6fe expref: 11 pid: 8875 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521342.591679:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000620e55af/0x411dd0ee4d2d1a59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6fe expref: 11 pid: 8875 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521342.591702:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000620e55af/0x411dd0ee4d2d1a59 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6fe expref: 11 pid: 8875 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521342.591720:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521342.591725:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521342.591731:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea1ca7e4/0x411dd0ee4d2d1a98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521342.591740:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea1ca7e4/0x411dd0ee4d2d1a98 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521342.591788:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521342.591841:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4e7e3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+10:2396:x1875400201397376:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 248us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521342.591849:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 68 00010000:00010000:0.0:1788521342.594552:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ea1ca7e4/0x411dd0ee4d2d1a98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.594574:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea1ca7e4/0x411dd0ee4d2d1a98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.594640:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea1ca7e4/0x411dd0ee4d2d1a98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.594650:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea1ca7e4/0x411dd0ee4d2d1a98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.594660:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea1ca7e4/0x411dd0ee4d2d1a98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.594677:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cb200 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:0.0:1788521342.594682:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea1ca7e4/0x411dd0ee4d2d1a98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.594691:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea1ca7e4/0x411dd0ee4d2d1a98 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.594709:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea1ca7e4/0x411dd0ee4d2d1a98 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521342.594716:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea1ca7e4/0x411dd0ee4d2d1a98 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521342.594826:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc75e887-507e-4861-8203-e266d82f5177+9:2395:x1875400201397120:12345-192.168.203.41@tcp:1:lfs.0 Request processed in 16152us (16512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521342.594833:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 44 00000100:00100000:2.0:1788521342.607152:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521342.607609:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201397632 00000100:00100000:3.0:1788521342.607629:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201397632 00000100:00100000:3.0:1788521342.607695:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 26 00000100:00100000:3.0:1788521342.607706:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6d4ab050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+42:11386:x1875400201397632:12345-192.168.203.41@tcp:35:lfs.0 00000004:00010000:3.0:1788521342.607771:0:6522:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1a8a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed713 expref: 42 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521342.608479:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1788521342.608522:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788521342.608950:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1788521342.608996:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1a9f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.609017:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1a44 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6f0 expref: 46 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.609027:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1a9f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.609086:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1a44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6f0 expref: 46 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.609105:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1a44 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6f0 expref: 46 pid: 12956 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521342.609131:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d22300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6522:1875400222450688:192.168.203.41@tcp:104: 00000100:00100000:2.0:1788521342.609794:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5a180 going to sleep for 11 seconds 00000100:00100000:1.0:1788521342.621634:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d22300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6522:1875400222450688:192.168.203.41@tcp:104: 00010000:00010000:1.0:1788521342.621664:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1a9f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521342.622081:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521342.622330:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201397760 00000100:00100000:1.0:1788521342.622337:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201397760 00010000:00010000:1.0:1788521342.622384:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1a44 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6f0 expref: 47 pid: 12956 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521342.622421:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 69 00000100:00100000:1.0:1788521342.622430:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+47:2396:x1875400201397760:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521342.622456:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521342.622463:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1a44 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6f0 expref: 47 pid: 12956 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.622476:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1a44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6f0 expref: 47 pid: 12956 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.622498:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1a44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6f0 expref: 47 pid: 12956 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.622512:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee42476500) 00010000:00010000:1.0:1788521342.622517:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1a9f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.622545:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1a9f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.622552:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1a9f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.622582:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521342.622635:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+46:2396:x1875400201397760:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 205us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521342.622641:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 69 00010000:00010000:2.0:1788521342.622925:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1a9f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.622934:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1a9f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521342.623054:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:2.0:1788521342.623186:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1788521342.623281:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d22680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1875400222450816:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788521342.623355:0:6522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521342.623397:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5a540 going to sleep for 11 seconds 00000100:00100000:1.0:1788521342.624678:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222450816 00000100:00100000:1.0:1788521342.624687:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222450816 00000100:00100000:1.0:1788521342.624741:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788521342.624749:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6522:x1875400222450816:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788521342.624842:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6522:x1875400222450816:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 93us (1496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521342.624848:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:1.0:1788521342.624869:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521342.624989:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d22680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1875400222450816:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788521342.625134:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1788521342.625190:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d22680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1875400222450944:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788521342.625225:0:6522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521342.625253:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5a240 going to sleep for 11 seconds 00000100:00100000:1.0:1788521342.625578:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222450944 00000100:00100000:1.0:1788521342.625584:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222450944 00000100:00100000:1.0:1788521342.625618:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788521342.625626:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6522:x1875400222450944:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788521342.625735:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6522:x1875400222450944:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 110us (509us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788521342.625742:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788521342.627132:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d22680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1875400222450944:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788521342.627202:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1788521342.627252:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1a9f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.627263:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1a9f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.627271:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1a9f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.627277:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7000 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521342.627282:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1a9f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.627291:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1a9f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.627319:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee42476500) 00010000:00010000:2.0:1788521342.627323:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788521342.627329:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1a9f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.627360:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1a9f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788521342.627467:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788521342.627529:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1788521342.627541:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 392693656824ns, next at 393693654605ns, rc = 0 00000001:00080000:2.0:1788521342.627548:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1788521342.627571:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee42476500) 00010000:00010000:2.0:1788521342.627574:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788521342.627581:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1a8a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed713 expref: 50 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521342.627826:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6d4ab050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+49:11386:x1875400201397632:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 20120us (20681us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788521342.627835:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 26 00000020:00080000:2.0:1788521342.627840:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788521342.635650:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521342.637824:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201397888 00000100:00100000:2.0:1788521342.637838:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201397888 00000100:00100000:2.0:1788521342.638023:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 111 00000100:00100000:2.0:1788521342.638035:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+49:11386:x1875400201397888:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:2.0:1788521342.638062:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521342.638085:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1aa6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed71a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.638274:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1aa6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed71a expref: 50 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.638414:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1aa6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed71a expref: 50 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.638434:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:2.0:1788521342.638437:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788521342.638441:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7600, rc 0) 00000100:00100000:2.0:1788521342.638549:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+50:11386:x1875400201397888:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 516us (2909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521342.638557:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 111 00000100:00100000:0.0:1788521342.645424:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521342.650526:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201398144 00000100:00100000:2.0:1788521342.650541:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201398144 00000100:00100000:2.0:1788521342.650626:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 27 00000100:00100000:2.0:1788521342.650636:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+50:11386:x1875400201398144:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:2.0:1788521342.651956:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+51:11386:x1875400201398144:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 1314us (6534us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788521342.651967:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 27 00000100:00100000:2.0:1788521342.766160:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521342.766267:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201398272 00000100:00100000:1.0:1788521342.766277:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201398272 00000100:00100000:1.0:1788521342.766361:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 112 00000100:00100000:1.0:1788521342.766371:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+51:11396:x1875400201398272:12345-192.168.203.41@tcp:34:lfs.0 00010000:00010000:1.0:1788521342.766446:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1aad lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.766463:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1aad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.766475:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1aad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.766486:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1ab4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.766494:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.766500:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.766584:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1abb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.766593:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1abb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.766600:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1abb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788521342.766649:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1abb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.766664:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1aad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.766677:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1aad lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.766684:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1aad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.766690:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434ab600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521342.766695:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1aad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.766703:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1aad lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.766727:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:1.0:1788521342.766730:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521342.766735:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1aad lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.766741:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1aad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.766754:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.766761:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1ab4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.766767:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1ab4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.766772:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521342.766781:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1ab4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.766788:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1ab4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.766796:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8fef71ec0b00) 00010000:00010000:1.0:1788521342.766808:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521342.766811:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1ab4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.766817:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1ab4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.766826:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1abb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.766831:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1abb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.766837:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1abb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.766842:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434abe00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521342.766845:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1abb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.766850:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1abb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.766858:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:1.0:1788521342.766860:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521342.766868:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1abb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521342.766874:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1abb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521342.766991:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+51:11396:x1875400201398272:12345-192.168.203.41@tcp:34:lfs.0 Request processed in 620us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521342.766999:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 112 00000100:00100000:0.0:1788521342.842830:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521342.843275:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201398528 00000100:00100000:2.0:1788521342.843285:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201398528 00000100:00100000:2.0:1788521342.843355:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 113 00000100:00100000:2.0:1788521342.843366:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+51:11399:x1875400201398528:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:2.0:1788521342.843385:0:9815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521342.843404:0:9815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1ac2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed721 expref: -99 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.843489:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1ac9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.843503:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1ac9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.843514:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1ac9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.843525:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1ad0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.843532:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.843538:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.843634:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1ad7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.843642:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.843649:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521342.843659:0:9815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788521342.843738:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1ac9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.843747:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1ac9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.843760:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1ac9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.843766:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7200 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521342.843771:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1ac9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.843779:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1ac9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.843792:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:2.0:1788521342.844296:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521342.844304:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1ac9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.844313:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1ac9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.844328:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.844335:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1ad0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.844351:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1ad0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.844357:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521342.844361:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1ad0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.844380:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1ad0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.844391:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8fef71ec0b00) 00010000:00010000:2.0:1788521342.844394:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521342.844397:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1ad0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.844403:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1ad0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.844444:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1ac2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed721 expref: 54 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.844459:0:9815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed721 expref: 53 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521342.844468:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:2.0:1788521342.844470:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521342.844473:0:9815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7800, rc 0) 00000100:00100000:2.0:1788521342.844540:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+53:11399:x1875400201398528:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 1176us (1718us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788521342.845609:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 113 00000100:00100000:0.0:1788521342.851465:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521342.852431:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201398656 00000100:00100000:3.0:1788521342.852442:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201398656 00000100:00100000:3.0:1788521342.852517:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 114 00000100:00100000:3.0:1788521342.852528:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+53:11399:x1875400201398656:12345-192.168.203.41@tcp:54:lfs.0 00010000:00010000:3.0:1788521342.852600:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1ae5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521342.852622:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521342.852635:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521342.853176:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521342.853205:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1ae5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521342.853212:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521342.853218:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cbc00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521342.853223:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521342.853230:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1ae5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521342.853242:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:3.0:1788521342.853245:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788521342.853250:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1ae5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521342.853256:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1ae5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521342.853621:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+53:11399:x1875400201398656:12345-192.168.203.41@tcp:54:lfs.0 Request processed in 1093us (2163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521342.853630:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 114 00000100:00100000:0.0:1788521342.859452:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521342.859548:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201398912 00000100:00100000:2.0:1788521342.859558:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201398912 00000100:00100000:2.0:1788521342.859626:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 28 00000100:00100000:2.0:1788521342.859636:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+53:11399:x1875400201398912:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:2.0:1788521342.860170:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+54:11399:x1875400201398912:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 535us (880us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1788521342.860178:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 28 00000100:00100000:0.0:1788521343.013074:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521343.013512:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201399168 00000100:00100000:3.0:1788521343.013524:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201399168 00000100:00100000:3.0:1788521343.013600:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 115 00000100:00100000:3.0:1788521343.013612:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+54:11409:x1875400201399168:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:3.0:1788521343.013644:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521343.013660:0:12956:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788521343.013687:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1a67 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed705 expref: 54 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.013708:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:3.0:1788521343.013713:0:12956:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788521343.013727:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1aec lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed728 expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.013833:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1af3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.013846:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1af3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.013856:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1af3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521343.013867:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788521343.014036:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1aec lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed728 expref: 56 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.014050:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1af3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed728 expref: 55 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.014058:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:3.0:1788521343.014061:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521343.014063:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749cb800, rc 0) 00000100:00100000:3.0:1788521343.014121:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+55:11409:x1875400201399168:12345-192.168.203.41@tcp:101:bash.0 Request processed in 512us (1067us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1788521343.014138:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 115 00000100:00080000:1.0:1788521343.014459:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521343.022189:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521343.022237:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521343.022376:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201399424 00000100:00100000:3.0:1788521343.022386:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201399424 00000100:00100000:3.0:1788521343.022452:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 8 00000100:00100000:3.0:1788521343.022463:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+55:2393:x1875400201399424:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521343.022478:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521343.022503:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1af3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed728 expref: 55 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.022523:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:3.0:1788521343.022528:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521343.022582:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+54:2393:x1875400201399424:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 121us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521343.022590:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 8 00000100:00100000:2.0:1788521343.022658:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201399296 00000100:00100000:2.0:1788521343.022662:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201399296 00000100:00100000:2.0:1788521343.022713:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 116 00000100:00100000:2.0:1788521343.022720:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+54:11409:x1875400201399296:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:2.0:1788521343.022738:0:9815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521343.022765:0:9815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1b01 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed72f expref: -99 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.022793:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1b08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.022806:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1b08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.022817:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1b08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.022957:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1b01 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed72f expref: 56 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.022971:0:9815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1b08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed72f expref: 55 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.022979:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:2.0:1788521343.022982:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788521343.022991:0:9815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b6800, rc 0) 00000100:00100000:2.0:1788521343.023021:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+55:11409:x1875400201399296:12345-192.168.203.41@tcp:101:bash.0 Request processed in 302us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521343.023028:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 116 00000100:00100000:0.0:1788521343.027713:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521343.027858:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201399680 00000100:00100000:3.0:1788521343.027868:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201399680 00000100:00100000:3.0:1788521343.027956:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 117 00000100:00100000:3.0:1788521343.027967:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+55:11409:x1875400201399680:12345-192.168.203.41@tcp:36:bash.0 00010000:00010000:3.0:1788521343.028023:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521343.028049:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1ad7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed721 expref: 55 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.028069:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:3.0:1788521343.028074:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788521343.028256:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1b0f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.028288:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1b0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.028298:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1b0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788521343.028340:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:3.0:1788521343.028372:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0e9282a reply state 00000000f9494274 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1b0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.028385:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1b0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.028392:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:3.0:1788521343.028395:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788521343.028397:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788521343.028606:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+57:11409:x1875400201399680:12345-192.168.203.41@tcp:36:bash.0 Request processed in 639us (901us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1788521343.028614:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 117 00000020:00080000:3.0:1788521343.028619:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788521343.033375:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521343.033451:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201399808 00000100:00100000:2.0:1788521343.033461:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201399808 00000100:00100000:2.0:1788521343.033519:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 118 00000100:00100000:2.0:1788521343.033530:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef41327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+57:11409:x1875400201399808:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:2.0:1788521343.033553:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521343.033572:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1b16 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed736 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.033682:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.033696:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.033707:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521343.033735:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788521343.033750:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788521343.033770:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.033797:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1b16 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed736 expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.033815:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed736 expref: 58 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.033832:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:2.0:1788521343.033835:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521343.033839:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b6e00, rc 0) 00000100:00100000:2.0:1788521343.033937:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef41327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+58:11409:x1875400201399808:12345-192.168.203.41@tcp:101:bash.0 Request processed in 408us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521343.033944:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 118 00000100:00100000:1.0:1788521343.038539:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521343.038764:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201400064 00000100:00100000:3.0:1788521343.038776:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201400064 00000100:00100000:3.0:1788521343.038863:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 29 00000100:00100000:3.0:1788521343.038874:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+58:11409:x1875400201400064:12345-192.168.203.41@tcp:35:bash.0 00000100:00100000:3.0:1788521343.039132:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+59:11409:x1875400201400064:12345-192.168.203.41@tcp:35:bash.0 Request processed in 260us (602us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1788521343.039139:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 29 00000100:00100000:3.0:1788521343.140704:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521343.140908:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201400192 00000100:00100000:1.0:1788521343.140918:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201400192 00000100:00100000:1.0:1788521343.140981:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 119 00000100:00100000:1.0:1788521343.140997:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+59:11416:x1875400201400192:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:1.0:1788521343.141021:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521343.141040:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1b24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed73d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521343.141123:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1b2b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521343.141137:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1b2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521343.141150:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1b2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521343.141189:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788521343.141193:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788521343.141211:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1b2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521343.141244:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1b24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed73d expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521343.141265:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1b2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed73d expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521343.141274:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:1.0:1788521343.141277:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788521343.141280:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434ab600, rc 0) 00000100:00100000:1.0:1788521343.141348:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+60:11416:x1875400201400192:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 351us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521343.141355:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 119 00000100:00100000:0.0:1788521343.146694:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521343.146830:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201400320 00000100:00100000:3.0:1788521343.146841:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201400320 00000100:00100000:3.0:1788521343.146927:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 120 00000100:00100000:3.0:1788521343.146938:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef41324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+60:11416:x1875400201400320:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:3.0:1788521343.146957:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521343.147329:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d1b32 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed744 expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.147399:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1b39 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.147413:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1b39 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.147425:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1b39 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.147436:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1b40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.147444:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1b40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.147451:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1b40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.147520:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1b47 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.147528:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1b47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.147553:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1b47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521343.147596:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788521343.147601:0:12956:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788521343.147618:0:12956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1b47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.147642:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1b47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.147649:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1b39 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.147655:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1b39 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.147669:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1b39 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.147675:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cb800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521343.147679:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1b39 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.147686:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1b39 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.147697:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:3.0:1788521343.147700:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521343.147705:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1b39 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.147721:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1b39 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.147734:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1b40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.147740:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1b40 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.147746:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1b40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.147751:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cb200 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521343.147754:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1b40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.147760:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1b40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.147768:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8fef71ec0b00) 00010000:00010000:3.0:1788521343.147771:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521343.147774:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1b40 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.147779:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1b40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.147815:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d1b32 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed744 expref: 62 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.147841:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1b47 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed744 expref: 61 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.147849:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:3.0:1788521343.147851:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521343.147854:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749ca400, rc 0) 00000100:00100000:3.0:1788521343.148414:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef41324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+61:11416:x1875400201400320:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 1475us (1727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521343.148423:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 120 00000100:00100000:0.0:1788521343.161978:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521343.162020:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521343.162182:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201400704 00000100:00100000:3.0:1788521343.162200:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201400704 00000100:00100000:3.0:1788521343.162259:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 9 00000100:00100000:3.0:1788521343.162270:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+61:2395:x1875400201400704:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521343.162286:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521343.162309:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1b47 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed744 expref: 61 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.162328:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:3.0:1788521343.162334:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521343.162395:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+60:2395:x1875400201400704:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 128us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521343.162401:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 9 00000100:00100000:2.0:1788521343.163335:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201400576 00000100:00100000:2.0:1788521343.163352:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201400576 00000100:00100000:2.0:1788521343.163399:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 121 00000100:00100000:2.0:1788521343.163407:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+60:11416:x1875400201400576:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:2.0:1788521343.163423:0:9815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521343.163438:0:9815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1b4e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed74b expref: -99 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.163539:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1b55 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.163553:0:9815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b1d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed736 expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.163561:0:9815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1b55 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.163593:0:9815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed736 expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.163607:0:9815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed736 expref: 61 pid: 6519 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521343.163632:0:9815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d22a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9815:1875400222451072:192.168.203.41@tcp:104: 00000100:00100000:2.0:1788521343.163702:0:9815:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef8147fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521343.166956:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521343.167282:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201400832 00000100:00100000:1.0:1788521343.167292:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201400832 00010000:00010000:1.0:1788521343.167329:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b1d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed736 expref: 62 pid: 6519 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521343.167372:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 70 00000100:00100000:1.0:1788521343.167382:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4325a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+62:2396:x1875400201400832:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521343.167395:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521343.167401:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b1d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed736 expref: 62 pid: 6519 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521343.167415:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed736 expref: 62 pid: 6519 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521343.167445:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:1.0:1788521343.167449:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1b55 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521343.167456:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1b55 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521343.167461:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1b55 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521343.167475:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521343.167520:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4325a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+62:2396:x1875400201400832:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 139us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521343.167527:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 70 00010000:00010000:2.0:1788521343.168047:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed736 expref: 61 pid: 6519 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521343.168706:0:9815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d22a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9815:1875400222451072:192.168.203.41@tcp:104: 00010000:00010000:2.0:1788521343.168732:0:9815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1b55 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.168744:0:9815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1b55 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.168749:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1b55 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521343.168769:0:9815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788521343.168960:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1b4e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed74b expref: 62 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.168977:0:9815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1b55 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed74b expref: 61 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.168986:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:2.0:1788521343.169403:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788521343.169406:0:9815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7000, rc 0) 00000100:00100000:2.0:1788521343.169461:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+61:11416:x1875400201400576:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 6054us (7502us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788521343.169484:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 121 00000100:00100000:1.0:1788521343.173773:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521343.178823:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201401088 00000100:00100000:3.0:1788521343.178838:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201401088 00000100:00100000:3.0:1788521343.178940:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 10 00000100:00100000:3.0:1788521343.178965:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+61:11416:x1875400201401088:12345-192.168.203.41@tcp:103:lfs.0 00010000:00010000:3.0:1788521343.178982:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521343.179016:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1aa6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed71a expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.179036:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:3.0:1788521343.179041:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521343.179098:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+60:11416:x1875400201401088:12345-192.168.203.41@tcp:103:lfs.0 Request processed in 137us (5335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521343.179115:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 10 00010000:00010000:2.0:1788521343.181173:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521343.183059:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521343.183146:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201401216 00000100:00100000:3.0:1788521343.183155:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201401216 00000100:00100000:3.0:1788521343.183223:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 122 00000100:00100000:3.0:1788521343.183232:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+60:11416:x1875400201401216:12345-192.168.203.41@tcp:58:lfs.0 00010000:00010000:3.0:1788521343.183364:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1b63 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.183381:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1b63 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.183393:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1b63 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788521343.183485:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1788521343.183564:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+60:11416:x1875400201401216:12345-192.168.203.41@tcp:58:lfs.0 Request processed in 332us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521343.183572:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 122 00000100:00100000:0.0:1788521343.187146:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521343.187430:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201401344 00000100:00100000:3.0:1788521343.187455:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201401344 00000100:00100000:3.0:1788521343.187579:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 123 00000100:00100000:3.0:1788521343.187590:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+60:11416:x1875400201401344:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:3.0:1788521343.187610:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521343.187631:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d1b6a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed752 expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.187790:0:12956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1b63 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.187966:0:12956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d1b6a lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed752 expref: 61 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.187986:0:12956:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1b63 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.188313:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d1b6a lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed752 expref: 61 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.188327:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:3.0:1788521343.188330:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788521343.188333:0:12956:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d1b6a lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed752 expref: 61 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.188352:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749cb400, rc 0) 00000100:00100000:2.0:1788521343.188501:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+61:11416:x1875400201401344:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 911us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521343.188517:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 123 00000040:00080000:2.0:1788521343.501293:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788521343.501302:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788521343.501365:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788521343.501375:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788521343.501508:0:13799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d22a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1875400222451200:192.168.203.41@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788521343.501620:0:13799:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef6d7f99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521343.504592:0:13799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d22a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1875400222451200:192.168.203.41@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788521343.522248:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521343.525430:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201401472 00000100:00100000:2.0:1788521343.525446:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201401472 00000100:00100000:2.0:1788521343.525541:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 124 00000100:00100000:2.0:1788521343.525552:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+61:11417:x1875400201401472:12345-192.168.203.41@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788521343.525585:0:9815:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788521343.525719:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+61:11417:x1875400201401472:12345-192.168.203.41@tcp:53:lhsmtool_posix.0 Request processed in 168us (3480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521343.525728:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 124 00000100:00100000:0.0:1788521343.535818:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521343.535958:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201401600 00000100:00100000:2.0:1788521343.535968:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201401600 00000100:00100000:2.0:1788521343.536039:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 125 00000100:00100000:2.0:1788521343.536049:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+61:11417:x1875400201401600:12345-192.168.203.41@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788521343.536118:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1b71 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.536146:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1b71 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.536158:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1b71 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.536174:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b78 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.536181:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b78 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.536199:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b78 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.536223:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1b7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.536232:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1b7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.536238:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1b7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521343.536284:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788521343.536289:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788521343.536302:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1b7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.536313:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1b71 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.536329:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1b71 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.536336:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1b71 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.536351:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7200 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521343.536355:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1b71 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.536369:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1b71 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.536380:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fee410f5900) 00010000:00010000:2.0:1788521343.536383:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521343.536388:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1b71 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.536394:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1b71 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.536407:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b78 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.536413:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b78 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.536419:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b78 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.536425:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6e00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521343.536434:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b78 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.536441:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b78 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.536449:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8fee410f7a00) 00010000:00010000:2.0:1788521343.536451:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521343.536454:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b78 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.536460:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b78 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.536475:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1b7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.536481:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1b7f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.536487:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1b7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.536503:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521343.536506:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1b7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.536512:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1b7f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.536519:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:2.0:1788521343.536521:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521343.536531:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1b7f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.536536:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1b7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521343.536606:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+61:11417:x1875400201401600:12345-192.168.203.41@tcp:34:lhsmtool_posix.0 Request processed in 558us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521343.536623:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 125 00000100:00100000:1.0:1788521343.566706:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521343.567158:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201401856 00000100:00100000:2.0:1788521343.567167:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201401856 00000100:00100000:2.0:1788521343.567233:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 126 00000100:00100000:2.0:1788521343.567243:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+61:11417:x1875400201401856:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521343.567262:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521343.567281:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1b86 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed759 expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.567406:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b8d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.567422:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.567433:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521343.567444:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788521343.567529:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.567537:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b8d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.567557:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.567563:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6e00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521343.567567:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.567576:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b8d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.567588:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:2.0:1788521343.567591:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788521343.567597:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b8d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.567604:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1b8d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.567654:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1b86 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed759 expref: 63 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.567665:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fee410f5900) 00010000:00010000:2.0:1788521343.567668:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521343.567672:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1b86 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed759 expref: 63 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.567681:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7600, rc 0) 00000100:00100000:2.0:1788521343.567746:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+62:11417:x1875400201401856:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 504us (1049us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1788521343.567763:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 126 00000100:00100000:0.0:1788521343.570836:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521343.570961:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201401984 00000100:00100000:3.0:1788521343.570971:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201401984 00000100:00100000:3.0:1788521343.571032:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 127 00000100:00100000:3.0:1788521343.571043:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7ef8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+62:11417:x1875400201401984:12345-192.168.203.41@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788521343.571092:0:6521:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788521343.571205:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7ef8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+62:11417:x1875400201401984:12345-192.168.203.41@tcp:53:lhsmtool_posix.0 Request processed in 164us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521343.571213:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 127 00000100:00100000:1.0:1788521343.574631:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521343.578938:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201402240 00000100:00100000:3.0:1788521343.578955:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201402240 00000100:00100000:3.0:1788521343.579030:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 128 00000100:00100000:3.0:1788521343.579041:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+62:11417:x1875400201402240:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521343.579062:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521343.579065:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788521343.579091:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1b2b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed73d expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.579281:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:3.0:1788521343.579287:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788521343.579301:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1b9b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed760 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788521343.579679:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1788521343.579817:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1ba2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.579831:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.579841:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.580710:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1b9b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed760 expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.580727:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed760 expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.580735:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8fef76505d00) 00010000:00010000:3.0:1788521343.580738:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521343.580740:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749cb800, rc 0) 00000100:00100000:3.0:1788521343.580796:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+63:11417:x1875400201402240:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 1757us (6185us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1788521343.580805:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 128 00000100:00100000:1.0:1788521343.588553:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521343.588653:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201402496 00000100:00100000:0.0:1788521343.588663:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201402496 00000100:00100000:0.0:1788521343.588724:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 129 00000100:00100000:0.0:1788521343.588734:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+63:11417:x1875400201402496:12345-192.168.203.41@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788521343.588813:0:9815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521343.588838:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1ba2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed760 expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.588855:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8fef76505d00) 00010000:00010000:0.0:1788521343.588874:0:9815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521343.588930:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1bb0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.588945:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1bb0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.588955:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1bb0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.588969:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1bb7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xe99710d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.588977:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1bb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe99710d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.588983:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1bb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe99710d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.589022:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1bb0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.589031:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1bb0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.589038:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1bb0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.589045:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42411c00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521343.589050:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1bb0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.589058:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1bb0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.589074:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:0.0:1788521343.589077:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521343.589082:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1bb0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.589088:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1bb0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.589099:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1bb7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe99710d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.589221:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1bb7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe99710d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.589228:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1bb7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe99710d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.589234:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410000 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521343.589238:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1bb7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe99710d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.589245:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1bb7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe99710d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.589254:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xe99710d7 (ffff8fee42476200) 00010000:00010000:0.0:1788521343.589257:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521343.589260:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1bb7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xe99710d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.589334:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1bb7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xe99710d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521343.589633:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+62:11417:x1875400201402496:12345-192.168.203.41@tcp:36:lhsmtool_posix.0 Request processed in 899us (1088us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788521343.589641:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 129 00000100:00100000:0.0:1788521343.602041:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521343.602193:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201402624 00000100:00100000:2.0:1788521343.602202:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201402624 00000100:00100000:2.0:1788521343.602261:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 130 00000100:00100000:2.0:1788521343.602279:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+62:11417:x1875400201402624:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521343.602298:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521343.602320:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1bbe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed767 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.602364:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1bc5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.602378:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.602390:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.602495:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1bbe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed767 expref: 64 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.602513:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed767 expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.602522:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8fee410f7a00) 00010000:00010000:2.0:1788521343.602525:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788521343.602528:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b6e00, rc 0) 00000100:00100000:2.0:1788521343.602591:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+63:11417:x1875400201402624:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 313us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521343.602605:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 130 00000100:00100000:1.0:1788521343.612202:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521343.614578:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201402880 00000100:00100000:3.0:1788521343.614592:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201402880 00000100:00100000:3.0:1788521343.614664:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 131 00000100:00100000:3.0:1788521343.614674:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+63:11417:x1875400201402880:12345-192.168.203.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788521343.614779:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1bcc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.615158:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1bcc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.615176:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1bcc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788521343.615605:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:3.0:1788521343.615615:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 393681730673ns, next at 394681728365ns, rc = 0 00000004:00010000:3.0:1788521343.615674:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005cbe3875 reply state 00000000a8baca76 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1bcc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.615688:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1bcc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.615696:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8fee410f7a00) 00010000:00010000:3.0:1788521343.615699:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788521343.615702:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788521343.616129:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+65:11417:x1875400201402880:12345-192.168.203.41@tcp:36:lhsmtool_posix.0 Request processed in 1453us (3933us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1788521343.616138:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 131 00000100:00100000:1.0:1788521343.622473:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521343.622584:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201403008 00000100:00100000:0.0:1788521343.622593:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201403008 00000100:00100000:0.0:1788521343.622795:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 132 00000100:00100000:0.0:1788521343.622806:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+65:11417:x1875400201403008:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788521343.622828:0:9815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521343.623033:0:9815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1bd3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed76e expref: -99 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.623098:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1bd3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed76e expref: 66 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.623179:0:9815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1bd3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed76e expref: 66 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.623198:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8fee410f7a00) 00010000:00010000:0.0:1788521343.623201:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788521343.623205:0:9815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411c00, rc 0) 00000100:00100000:0.0:1788521343.623359:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+66:11417:x1875400201403008:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 555us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521343.623367:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 132 00000100:00100000:0.0:1788521343.629521:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521343.630530:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521343.630551:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222451328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788521343.630626:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521343.630910:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222451328 00000100:00100000:0.0:1788521343.630930:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222451328 00000100:00100000:0.0:1788521343.630983:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788521343.630994:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222451328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788521343.631016:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521343.631061:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222451328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521343.631069:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:0.0:1788521343.631088:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521343.631541:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222451328:0@lo:13:osp-pre-0-1.0 00000004:00080000:3.0:1788521343.631844:0:8874:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 393697959006ns, next at 394697956194ns, rc = 0 00000100:00100000:3.0:1788521343.631873:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788521343.631907:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222451456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521343.631945:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521343.631987:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222451456 00000100:00100000:3.0:1788521343.631992:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222451456 00000100:00100000:3.0:1788521343.632024:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788521343.632031:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3646:x1875400222451456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788521343.632045:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788521343.632083:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3646:x1875400222451456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521343.632089:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788521343.632125:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222451456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788521343.632373:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201403136 00000100:00100000:1.0:1788521343.632379:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201403136 00000100:00100000:1.0:1788521343.632426:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 45 00000100:00100000:1.0:1788521343.632433:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+8:2395:x1875400201403136:12345-192.168.203.41@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788521343.632604:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+9:2395:x1875400201403136:12345-192.168.203.41@tcp:2:lhsmtool_posix.0 Request processed in 171us (3093us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788521343.632622:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 45 00000100:00080000:3.0:1788521343.634710:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1788521343.636473:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1788521343.636487:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1788521343.641243:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521343.641450:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201403392 00000100:00100000:2.0:1788521343.641461:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201403392 00000100:00100000:2.0:1788521343.641521:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 30 00000100:00100000:2.0:1788521343.641531:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+66:11417:x1875400201403392:12345-192.168.203.41@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788521343.641743:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+67:11417:x1875400201403392:12345-192.168.203.41@tcp:35:lhsmtool_posix.0 Request processed in 212us (508us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1788521343.641751:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 30 00000100:00100000:1.0:1788521343.646082:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521343.646556:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201403648 00000100:00100000:0.0:1788521343.646566:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201403648 00000100:00100000:0.0:1788521343.646636:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 133 00000100:00100000:0.0:1788521343.646646:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+67:11417:x1875400201403648:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788521343.647431:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+67:11417:x1875400201403648:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 Request processed in 784us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521343.647441:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 133 00000100:00100000:0.0:1788521343.651600:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521343.651741:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201403776 00000100:00100000:3.0:1788521343.651750:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201403776 00000100:00100000:3.0:1788521343.651873:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 134 00000100:00100000:3.0:1788521343.651903:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee435ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+67:11417:x1875400201403776:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521343.651925:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521343.651948:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d1bda lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed775 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.652018:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1be1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.652032:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1be1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.652044:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1be1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521343.652106:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788521343.652126:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1be1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.652172:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d1bda lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed775 expref: 69 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.652190:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1be1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed775 expref: 68 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.652198:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8fee410f7a00) 00010000:00010000:3.0:1788521343.652202:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788521343.652206:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749cb800, rc 0) 00000100:00100000:3.0:1788521343.652408:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee435ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+68:11417:x1875400201403776:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 385us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521343.652425:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 134 00000100:00100000:3.0:1788521343.656479:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521343.656625:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201403904 00000100:00100000:0.0:1788521343.656635:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201403904 00000100:00100000:0.0:1788521343.656698:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 46 00000100:00100000:0.0:1788521343.656709:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+9:2396:x1875400201403904:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788521343.656726:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521343.656746:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019b9cc59/0x411dd0ee4d2d1be8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed77c expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788521343.656770:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9aab7e, blocks: 0x0 00010000:00010000:0.0:1788521343.656807:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=393s v=(0 0) 00010000:00010000:0.0:1788521343.656812:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521343.656821:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019b9cc59/0x411dd0ee4d2d1be8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed77c expref: 10 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.656839:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000019b9cc59/0x411dd0ee4d2d1be8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed77c expref: 10 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.656862:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411e00, rc 0) 00000100:00100000:0.0:1788521343.656944:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+10:2396:x1875400201403904:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 237us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521343.656951:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 46 00000100:00100000:1.0:1788521343.660652:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521343.661053:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201404160 00000100:00100000:0.0:1788521343.661063:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201404160 00000100:00100000:0.0:1788521343.661129:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 135 00000100:00100000:0.0:1788521343.661139:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+68:11417:x1875400201404160:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788521343.661246:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+68:11417:x1875400201404160:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 Request processed in 108us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521343.661255:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 135 00000100:00100000:1.0:1788521343.664935:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521343.665238:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201404288 00000100:00100000:0.0:1788521343.665249:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201404288 00000100:00100000:0.0:1788521343.665316:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 47 00000100:00100000:0.0:1788521343.665327:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+10:11417:x1875400201404288:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788521343.665354:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521343.665374:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d1bef lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed783 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.665425:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000019b9cc59/0x411dd0ee4d2d1be8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed77c expref: 11 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.665435:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521343.665440:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521343.665445:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d1bef lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed783 expref: 11 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.665482:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000019b9cc59/0x411dd0ee4d2d1be8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed77c expref: 11 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.665496:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000019b9cc59/0x411dd0ee4d2d1be8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed77c expref: 11 pid: 8436 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521343.665511:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee435ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8434:1875400222451584:192.168.203.41@tcp:104: 00000100:00100000:0.0:1788521343.665641:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef554793c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521343.672563:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee435ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8434:1875400222451584:192.168.203.41@tcp:104: 00010000:00010000:0.0:1788521343.672599:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d1bef lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed783 expref: 11 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.672622:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411800, rc 0) 00000100:00100000:0.0:1788521343.672691:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+11:11417:x1875400201404288:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 7365us (7808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521343.672700:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 47 00000100:00100000:2.0:1788521343.675315:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521343.675456:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201404416 00000100:00100000:3.0:1788521343.675466:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201404416 00010000:00010000:3.0:1788521343.675514:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019b9cc59/0x411dd0ee4d2d1be8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed77c expref: 11 pid: 8436 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521343.675561:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 71 00000100:00100000:3.0:1788521343.675571:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+11:2396:x1875400201404416:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521343.675587:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521343.675610:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019b9cc59/0x411dd0ee4d2d1be8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed77c expref: 11 pid: 8436 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.675625:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019b9cc59/0x411dd0ee4d2d1be8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed77c expref: 11 pid: 8436 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.675647:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019b9cc59/0x411dd0ee4d2d1be8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed77c expref: 11 pid: 8436 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.675674:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521343.675680:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521343.675689:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d1bef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed783 expref: 10 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.675700:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d1bef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed783 expref: 10 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.675754:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d1bef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed783 expref: 10 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521343.675769:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee436ced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6506:1875400222451712:192.168.203.41@tcp:105: 00000100:00100000:3.0:1788521343.676150:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee434c60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521343.680175:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee436ced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6506:1875400222451712:192.168.203.41@tcp:105: 00010000:00010000:3.0:1788521343.680204:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521343.680269:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+10:2396:x1875400201404416:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 4689us (4952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521343.680280:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 71 00000100:00100000:2.0:1788521343.685381:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521343.685540:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201404544 00000100:00100000:1.0:1788521343.685549:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201404544 00002000:00100000:1.0:1788521343.685594:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8fee43d20e00 x1875400201404544/t0(0) o4->fc75e887-507e-4861-8203-e266d82f5177@192.168.203.41@tcp:344/0 lens 504/0 e 0 to 0 dl 1788521354 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788521343.685605:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fee43d20e00 with x1875400201404544 ext(0->12) 00002000:00010000:1.0:1788521343.685610:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fee43d20e00 00000100:00100000:1.0:1788521343.685640:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 2 00000100:00100000:1.0:1788521343.685648:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc75e887-507e-4861-8203-e266d82f5177+10:2394:x1875400201404544:12345-192.168.203.41@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788521343.687710:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc75e887-507e-4861-8203-e266d82f5177+12:2394:x1875400201404544:12345-192.168.203.41@tcp:4:lhsmtool_posix.0 Request processed in 2053us (2329us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788521343.687730:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 2 00002000:00100000:2.0:1788521343.687742:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8fee43d20e00 x1875400201404544/t4294967309(0) o4->fc75e887-507e-4861-8203-e266d82f5177@192.168.203.41@tcp:344/0 lens 504/448 e 0 to 0 dl 1788521354 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788521343.687752:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fee43d20e00 with x1875400201404544 ext(0->12) 00002000:00010000:2.0:1788521343.687757:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fee43d20e00 00000100:00100000:2.0:1788521343.690991:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521343.691271:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201404672 00000100:00100000:1.0:1788521343.691281:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201404672 00000100:00100000:1.0:1788521343.691335:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 136 00000100:00100000:1.0:1788521343.691353:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+68:11417:x1875400201404672:12345-192.168.203.41@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788521343.693844:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:1.0:1788521343.693865:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:1.0:1788521343.693908:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:1.0:1788521343.693930:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1788521343.693938:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8fee41a5a540 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1788521343.693943:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fef4e704800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8fee41a5ab40 00000020:00080000:1.0:1788521343.693946:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fef4e704300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8fef48177400 00000020:00080000:1.0:1788521343.693989:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8fef46193180 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788521343.693992:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fef484ac200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8fef46193000 00000020:00080000:1.0:1788521343.694006:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fef484ac500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8fef42fdea00 00000020:00080000:1.0:1788521343.694138:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788521343.694192:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788521343.694332:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+22:11417:x1875400201404672:12345-192.168.203.41@tcp:44:lhsmtool_posix.0 Request processed in 2975us (3343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521343.694354:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 136 00010000:00010000:0.0:1788521343.695136:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d18f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695149:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d18f4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695158:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d18f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695163:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cb600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521343.695168:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d18f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695176:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d18f4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695190:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8fef76505100) 00010000:00010000:0.0:1788521343.695193:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521343.695198:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d18f4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695204:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d18f4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695228:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d199c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695235:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d199c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695241:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d199c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695260:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6000 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521343.695275:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d199c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695282:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d199c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695290:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8fee42476700) 00010000:00010000:0.0:1788521343.695293:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521343.695296:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d199c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695302:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d199c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695320:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1a1a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695326:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1a1a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695332:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1a1a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695355:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aaa00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521343.695358:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1a1a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695365:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1a1a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695384:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8fef71ec0b00) 00010000:00010000:0.0:1788521343.695387:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521343.695390:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1a1a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695396:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1a1a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695407:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1a3d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695413:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1a3d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695419:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1a3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695424:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521343.695426:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1a3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695432:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1a3d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695438:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8fef71ec0b00) 00010000:00010000:0.0:1788521343.695441:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521343.695443:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1a3d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695448:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1a3d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695471:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1b0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695489:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1b0f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695494:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1b0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695499:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cbc00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521343.695503:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1b0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695510:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1b0f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695518:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:0.0:1788521343.695521:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521343.695524:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1b0f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695529:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1b0f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695538:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1bcc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695544:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1bcc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695549:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1bcc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695560:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cb200 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521343.695563:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1bcc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695570:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1bcc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695578:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8fee410f7a00) 00010000:00010000:0.0:1788521343.695580:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788521343.695583:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1bcc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.695589:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1bcc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521343.695612:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521343.695630:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef44fc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222451840:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788521343.695698:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521343.695749:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222452096:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788521343.695774:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521343.695797:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788521343.695803:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef44fc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222451968:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788521343.695822:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521343.696131:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222451840 00000100:00100000:2.0:1788521343.696139:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222451840 00000100:00100000:2.0:1788521343.696194:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222452096 00000100:00100000:2.0:1788521343.696198:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222452096 00000100:00100000:2.0:1788521343.696208:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222451968 00000100:00100000:2.0:1788521343.696211:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222451968 00000100:00100000:2.0:1788521343.696224:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788521343.696232:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee435ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3645:x1875400222451840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788521343.696257:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:2.0:1788521343.696295:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0d6740f/0x411dd0ee4d2d1bf6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.696314:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002619fa51/0x411dd0ee4d2d19aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6db expref: 11 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.696323:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788521343.696327:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788521343.696332:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0d6740f/0x411dd0ee4d2d1bf6 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.696372:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002619fa51/0x411dd0ee4d2d19aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6db expref: 11 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.696386:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002619fa51/0x411dd0ee4d2d19aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6db expref: 11 pid: 8434 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521343.696398:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d20a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1875400222452224:192.168.203.41@tcp:104: 00000100:00100000:2.0:1788521343.696452:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef6d7f9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788521343.696471:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788521343.696485:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee435ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222452096:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788521343.696499:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:2.0:1788521343.696522:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9aab7d, atime: 0x6a9aab7d, ctime: 0x6a9aab7d, blocks: 0x8 00010000:00010000:2.0:1788521343.696528:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d1bfd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.696536:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788521343.696540:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521343.696545:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d1bfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.696559:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d1bfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.696568:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d1bfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.696576:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d1bfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.696596:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788521343.697201:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee435ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875400222452096:12345-0@lo:6:osp-syn-0-0.0 Request processed in 716us (1425us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788521343.697211:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788521343.697239:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788521343.697248:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43505f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3644:x1875400222451968:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788521343.697410:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788521343.697414:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788521343 00002000:00010000:2.0:1788521343.697417:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788521343.697419:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788521342 -> 1788521343 00002000:00010000:2.0:1788521343.697421:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788521343.697447:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43505f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3644:x1875400222451968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 201us (1623us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788521343.697453:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1788521343.697472:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521343.697479:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d1bfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.697488:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7800 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:2.0:1788521343.697493:0:7461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d1bfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.697502:0:7461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d1bfd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.697518:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d1bfd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.697525:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d1bfd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.697543:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521343.697545:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521343.697551:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788521343.697618:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fef44fc9180/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788521343.697625:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef44fc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222451968:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788521343.697637:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788521343.697642:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967304 00000004:00080000:0.0:1788521343.697829:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fef58374a80, transno 4294967302 00000004:00080000:0.0:1788521343.697843:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967304 00000100:00100000:0.0:1788521343.697951:0:3644:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8fee43d20000 x1875400222452096/t4294967305(4294967305) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788521359 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788521343.697961:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fee43d20000/2, rc 0, transno 4294967305 00000100:00100000:0.0:1788521343.697965:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222452096:0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1788521343.698539:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788521343.703348:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d20a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1875400222452224:192.168.203.41@tcp:104: 00010000:00010000:0.0:1788521343.703383:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d0d6740f/0x411dd0ee4d2d1bf6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521343.704605:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521343.704804:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201404800 00000100:00100000:1.0:1788521343.704811:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201404800 00010000:00010000:1.0:1788521343.704851:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002619fa51/0x411dd0ee4d2d19aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6db expref: 12 pid: 8434 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521343.704931:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 72 00000100:00100000:1.0:1788521343.704942:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4e7e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+12:2395:x1875400201404800:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521343.704958:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521343.704963:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002619fa51/0x411dd0ee4d2d19aa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6db expref: 12 pid: 8434 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521343.704976:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002619fa51/0x411dd0ee4d2d19aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6db expref: 12 pid: 8434 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521343.704997:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002619fa51/0x411dd0ee4d2d19aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6db expref: 12 pid: 8434 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521343.705015:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788521343.705019:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788521343.705039:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0d6740f/0x411dd0ee4d2d1bf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521343.705049:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0d6740f/0x411dd0ee4d2d1bf6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521343.705496:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521343.705556:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4e7e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+11:2395:x1875400201404800:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 615us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521343.705565:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 72 00010000:00010000:0.0:1788521343.705861:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d0d6740f/0x411dd0ee4d2d1bf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.705873:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0d6740f/0x411dd0ee4d2d1bf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.705911:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0d6740f/0x411dd0ee4d2d1bf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.705921:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0d6740f/0x411dd0ee4d2d1bf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.705938:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521343.706237:0:13735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521343.706244:0:13735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0d6740f/0x411dd0ee4d2d1bf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.706252:0:13735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7200 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:2.0:1788521343.706257:0:13735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0d6740f/0x411dd0ee4d2d1bf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.706277:0:13735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0d6740f/0x411dd0ee4d2d1bf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.706295:0:13735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0d6740f/0x411dd0ee4d2d1bf6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.706302:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0d6740f/0x411dd0ee4d2d1bf6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.706321:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521343.706323:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521343.706324:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521343.706433:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee435ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3645:x1875400222451840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10199us (10732us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788521343.706443:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000004:00080000:1.0:1788521343.707303:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fef44fc8a80/2, rc 0, transno 4294967311 00000100:00100000:1.0:1788521343.707314:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef44fc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222451840:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788521343.709798:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521343.709987:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201404928 00000100:00100000:0.0:1788521343.709997:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201404928 00000100:00100000:0.0:1788521343.710049:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 51 00000100:00100000:0.0:1788521343.710059:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+11:2393:x1875400201404928:12345-192.168.203.41@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788521343.712574:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1788521343.712590:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:0.0:1788521343.712754:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+6:2393:x1875400201404928:12345-192.168.203.41@tcp:16:lhsmtool_posix.0 Request processed in 2690us (2958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521343.712765:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 51 00000100:00100000:2.0:1788521343.718279:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521343.718588:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201405184 00000100:00100000:3.0:1788521343.718601:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201405184 00000100:00100000:3.0:1788521343.718674:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 137 00000100:00100000:3.0:1788521343.718684:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+16:11417:x1875400201405184:12345-192.168.203.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788521343.718751:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521343.718778:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1be1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed775 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.718799:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8fee410f7a00) 00010000:00010000:3.0:1788521343.718805:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788521343.718839:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d1c04 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.718865:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d1c04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.718952:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d1c04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788521343.719081:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2ab2ac1 reply state 00000000ef6fa6e6 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d1c04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.719094:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d1c04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.719487:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8fee410f7a00) 00010000:00010000:3.0:1788521343.719492:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788521343.719496:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788521343.719610:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+17:11417:x1875400201405184:12345-192.168.203.41@tcp:36:lhsmtool_posix.0 Request processed in 925us (1349us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1788521343.719619:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 137 00000100:00100000:2.0:1788521343.725949:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521343.726093:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201405312 00000100:00100000:1.0:1788521343.726110:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201405312 00000100:00100000:1.0:1788521343.726170:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 52 00000100:00100000:1.0:1788521343.726181:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc75e887-507e-4861-8203-e266d82f5177+6:2393:x1875400201405312:12345-192.168.203.41@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788521343.726357:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788521343.726361:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1788521343 -> 1788521342 00002000:00010000:1.0:1788521343.726364:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788521341 00002000:00010000:1.0:1788521343.726366:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788521343 -> 1788521342 00002000:00010000:1.0:1788521343.726368:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788521343.726472:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc75e887-507e-4861-8203-e266d82f5177+7:2393:x1875400201405312:12345-192.168.203.41@tcp:2:lhsmtool_posix.0 Request processed in 293us (532us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788521343.726481:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 52 00000100:00100000:3.0:1788521343.730278:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521343.730355:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201405568 00000100:00100000:2.0:1788521343.730380:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201405568 00000100:00100000:2.0:1788521343.730438:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 138 00000100:00100000:2.0:1788521343.730448:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+17:11417:x1875400201405568:12345-192.168.203.41@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788521343.730512:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c0b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.730529:0:12956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1bc5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed767 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.730539:0:12956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c0b lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.730571:0:12956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed767 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.730585:0:12956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1bc5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed767 expref: 17 pid: 6519 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521343.730598:0:12956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d21880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12956:1875400222452352:192.168.203.41@tcp:104: 00000100:00100000:2.0:1788521343.730869:0:12956:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef6d7f9540 going to sleep for 11 seconds 00000100:00100000:2.0:1788521343.734024:0:12956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d21880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12956:1875400222452352:192.168.203.41@tcp:104: 00010000:00010000:2.0:1788521343.734052:0:12956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c0b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521343.735702:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521343.736016:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201405696 00000100:00100000:3.0:1788521343.736027:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201405696 00010000:00010000:3.0:1788521343.736090:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1bc5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed767 expref: 18 pid: 6519 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521343.736138:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 73 00000100:00100000:3.0:1788521343.736148:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43505c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+18:2395:x1875400201405696:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521343.736165:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521343.736173:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1bc5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed767 expref: 18 pid: 6519 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.736185:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed767 expref: 18 pid: 6519 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.736223:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1bc5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed767 expref: 18 pid: 6519 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.736240:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8fee410f7a00) 00010000:00010000:3.0:1788521343.736244:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c0b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.736254:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.736499:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c0b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.736535:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521343.736665:0:12956:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.736674:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.736726:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.736733:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c0b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.736738:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c0b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.736744:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7200 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521343.736747:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c0b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.736755:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c0b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.736764:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8fee410f7a00) 00010000:00010000:2.0:1788521343.736767:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788521343.736771:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c0b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.736776:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c0b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521343.736836:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43505c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+17:2395:x1875400201405696:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 689us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521343.736844:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 73 00000100:00100000:2.0:1788521343.737833:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+16:11417:x1875400201405568:12345-192.168.203.41@tcp:55:lhsmtool_posix.0 Request processed in 7381us (7569us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788521343.737844:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 138 00000100:00100000:2.0:1788521343.741514:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521343.741608:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201405824 00000100:00100000:1.0:1788521343.741619:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201405824 00000100:00100000:1.0:1788521343.741799:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 53 00000100:00100000:1.0:1788521343.741810:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+7:2394:x1875400201405824:12345-192.168.203.41@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788521343.741866:0:8875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000024ccfe76/0x411dd0ee4d2d1c12 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521343.741924:0:8875:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d1bef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed783 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521343.741935:0:8875:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521343.741940:0:8875:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788521343.741945:0:8875:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024ccfe76/0x411dd0ee4d2d1c12 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521343.741980:0:8875:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d1bef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed783 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521343.741995:0:8875:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d1bef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed783 expref: 7 pid: 8434 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521343.742011:0:8875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef44fca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8875:1875400222452480:192.168.203.41@tcp:104: 00000100:00100000:1.0:1788521343.742114:0:8875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef71dd49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521343.746334:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521343.746511:0:8875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef44fca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8875:1875400222452480:192.168.203.41@tcp:104: 00010000:00010000:2.0:1788521343.746549:0:8875:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000024ccfe76/0x411dd0ee4d2d1c12 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521343.746614:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201405952 00000100:00100000:3.0:1788521343.746622:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201405952 00010000:00010000:3.0:1788521343.746656:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d1bef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed783 expref: 8 pid: 8434 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521343.746703:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 74 00000100:00100000:3.0:1788521343.746713:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fcb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+8:2396:x1875400201405952:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521343.746730:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521343.746752:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d1bef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed783 expref: 8 pid: 8434 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.746777:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d1bef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed783 expref: 8 pid: 8434 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.746802:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d1bef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed783 expref: 8 pid: 8434 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.746819:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521343.746824:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521343.746831:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000024ccfe76/0x411dd0ee4d2d1c12 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.746842:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024ccfe76/0x411dd0ee4d2d1c12 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.746870:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521343.746951:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fcb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+7:2396:x1875400201405952:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 238us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521343.746958:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 74 00010000:00010000:2.0:1788521343.747034:0:8875:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000024ccfe76/0x411dd0ee4d2d1c12 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.747044:0:8875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024ccfe76/0x411dd0ee4d2d1c12 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.747067:0:8875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000024ccfe76/0x411dd0ee4d2d1c12 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.747076:0:8875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024ccfe76/0x411dd0ee4d2d1c12 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.747085:0:8875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024ccfe76/0x411dd0ee4d2d1c12 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.747093:0:8875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa000 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:2.0:1788521343.747098:0:8875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024ccfe76/0x411dd0ee4d2d1c12 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.747107:0:8875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024ccfe76/0x411dd0ee4d2d1c12 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.747119:0:8875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024ccfe76/0x411dd0ee4d2d1c12 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.747133:0:8875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024ccfe76/0x411dd0ee4d2d1c12 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521343.747178:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+6:2394:x1875400201405824:12345-192.168.203.41@tcp:1:lhsmtool_posix.0 Request processed in 5370us (5675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521343.747186:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 53 00000100:00100000:2.0:1788521343.751647:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521343.751789:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201406208 00000100:00100000:1.0:1788521343.751800:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201406208 00000100:00100000:1.0:1788521343.751861:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 139 00000100:00100000:1.0:1788521343.751872:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+16:11417:x1875400201406208:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788521343.752009:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1c19 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521343.752027:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1b08 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed72f expref: 16 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521343.752037:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1c19 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521343.752071:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1b08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed72f expref: 16 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521343.752086:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1b08 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed72f expref: 16 pid: 9815 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521343.752111:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef44fc9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875400222452608:192.168.203.41@tcp:104: 00000100:00100000:1.0:1788521343.752192:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef71dd49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521343.755677:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef44fc9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875400222452608:192.168.203.41@tcp:104: 00010000:00010000:2.0:1788521343.755707:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1c19 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521343.756497:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521343.756772:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201406336 00000100:00100000:3.0:1788521343.756781:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201406336 00010000:00010000:3.0:1788521343.756818:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1b08 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed72f expref: 17 pid: 9815 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521343.756860:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 75 00000100:00100000:3.0:1788521343.756871:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+17:2395:x1875400201406336:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521343.756934:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521343.756942:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1b08 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed72f expref: 17 pid: 9815 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.756956:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1b08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed72f expref: 17 pid: 9815 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.756978:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d1b08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed72f expref: 17 pid: 9815 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.756994:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:3.0:1788521343.757000:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d1b6a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed752 expref: 16 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.757011:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1c19 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.757019:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1c19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.757029:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1c19 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.757096:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521343.757154:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+16:2395:x1875400201406336:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 284us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521343.757162:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 75 00010000:00010000:2.0:1788521343.759359:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1c19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.759377:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1c19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.759623:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c20 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.759641:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1bd3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed76e expref: 16 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.759651:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c20 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.759768:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1bd3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed76e expref: 16 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.759794:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1bd3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed76e expref: 16 pid: 9815 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521343.759812:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d22a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875400222452736:192.168.203.41@tcp:104: 00000100:00100000:2.0:1788521343.760112:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef6d7f9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521343.764440:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d22a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875400222452736:192.168.203.41@tcp:104: 00010000:00010000:1.0:1788521343.764470:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c20 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521343.765194:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521343.765663:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201406464 00000100:00100000:3.0:1788521343.765672:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201406464 00010000:00010000:3.0:1788521343.765724:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1bd3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed76e expref: 17 pid: 9815 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521343.765767:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 76 00000100:00100000:3.0:1788521343.765777:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+17:2396:x1875400201406464:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521343.765791:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521343.765797:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1bd3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed76e expref: 17 pid: 9815 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.765810:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1bd3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed76e expref: 17 pid: 9815 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.765831:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1bd3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed76e expref: 17 pid: 9815 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.765858:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8fee410f7a00) 00010000:00010000:3.0:1788521343.765864:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c20 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.765874:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c20 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.765914:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c20 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.765984:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521343.766034:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+16:2396:x1875400201406464:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 258us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521343.766041:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 76 00010000:00010000:2.0:1788521343.767533:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c20 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.767548:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c20 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521343.767676:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1788521343.767795:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1788521343.767827:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1788521343.768361:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d22300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6521:1875400222452864:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788521343.768431:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521343.768471:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef51dce480 going to sleep for 11 seconds 00000100:00100000:0.0:1788521343.768535:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222452864 00000100:00100000:0.0:1788521343.768542:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222452864 00000100:00100000:0.0:1788521343.768644:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788521343.768664:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6521:x1875400222452864:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788521343.768752:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6521:x1875400222452864:12345-0@lo:1000:mdt00_002.0 Request processed in 99us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521343.768759:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788521343.768817:0:6521:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1788521343.768823:0:6521:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:2.0:1788521343.768841:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fef44fc9180, transno 4294967310 00000004:00080000:2.0:1788521343.768867:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fef44fc8a80, transno 4294967311 00000100:00100000:2.0:1788521343.768874:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d22300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6521:1875400222452864:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788521343.769014:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1788521343.769078:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d22300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6521:1875400222452992:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788521343.769117:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521343.770824:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef51dced80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521343.771047:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222452992 00000100:00100000:1.0:1788521343.771056:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222452992 00000100:00100000:1.0:1788521343.771121:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788521343.771130:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6521:x1875400222452992:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788521343.771436:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6521:x1875400222452992:12345-0@lo:1000:mdt00_002.0 Request processed in 307us (2317us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788521343.771455:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788521343.771552:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d22300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6521:1875400222452992:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788521343.771600:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c20 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.771610:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c20 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.771618:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c20 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.771625:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7200 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521343.771629:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c20 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.771638:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c20 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.771654:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8fee410f7a00) 00010000:00010000:2.0:1788521343.771670:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788521343.771675:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c20 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.771681:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c20 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.771706:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1b63 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.771712:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1b63 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.771718:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1b63 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.771730:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749ca400 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521343.771734:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1b63 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.771740:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1b63 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.771750:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:2.0:1788521343.771752:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788521343.771759:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d1b6a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed752 expref: 19 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.771771:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d1b6a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed752 expref: 19 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.771780:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d1b6a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed752 expref: 19 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.771814:0:6521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d1b6a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed752 expref: 19 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521343.771828:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58340380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875400222453120:192.168.203.41@tcp:105: 00000100:00100000:2.0:1788521343.771931:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef51dced80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521343.779427:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58340380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875400222453120:192.168.203.41@tcp:105: 00010000:00010000:2.0:1788521343.779461:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1b63 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.779494:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1b63 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.779529:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1c27 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.779543:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1c27 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.779555:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1c27 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.779565:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1c27 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.779572:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1c27 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.779577:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1c27 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.779583:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521343.779586:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1c27 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.779592:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1c27 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.779604:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:2.0:1788521343.779606:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521343.779610:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1c27 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.779625:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1c27 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.779635:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1c19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.779640:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1c19 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.779646:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1c19 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.779650:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521343.779653:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1c19 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521343.779763:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:2.0:1788521343.779954:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1c19 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.779964:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:2.0:1788521343.779967:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788521343.779970:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1c19 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.779976:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1c19 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521343.780152:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+19:11417:x1875400201406208:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 Request processed in 28280us (28515us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1788521343.780162:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 139 00000020:00080000:2.0:1788521343.780175:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788521343.780431:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788521343.780435:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788521343.781141:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788521343.781153:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788521343.784242:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521343.784763:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201406592 00000100:00100000:1.0:1788521343.784773:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201406592 00000100:00100000:2.0:1788521343.784868:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201406848 00000100:00100000:2.0:1788521343.784873:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201406848 00000100:00100000:2.0:1788521343.784940:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 31 00000100:00100000:2.0:1788521343.784950:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+20:11416:x1875400201406592:12345-192.168.203.41@tcp:49:lfs.0 00000100:00100000:2.0:1788521343.785390:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+20:11416:x1875400201406592:12345-192.168.203.41@tcp:49:lfs.0 Request processed in 440us (5626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521343.785398:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 31 00000100:00100000:2.0:1788521343.785418:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 32 00000100:00100000:2.0:1788521343.785426:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6d4a8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+19:11417:x1875400201406848:12345-192.168.203.41@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788521343.785642:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788521343.785685:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:2.0:1788521343.785716:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1c2e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.785732:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1c2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.785744:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1c2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.785753:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1c2e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.785760:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1c2e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.785766:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1c2e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.785806:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521343.786434:0:13734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521343.786443:0:13734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1c2e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.786452:0:13734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6e00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:3.0:1788521343.786457:0:13734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1c2e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.786465:0:13734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1c2e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.786480:0:13734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8fee410f7a00) 00010000:00010000:3.0:1788521343.786483:0:13734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788521343.786488:0:13734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1c2e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.786495:0:13734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1c2e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521343.786509:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521343.786511:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521343.786513:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521343.786719:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6d4a8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+21:11417:x1875400201406848:12345-192.168.203.41@tcp:35:lhsmtool_posix.0 Request processed in 1290us (2483us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1788521343.786728:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 32 00000020:00080000:2.0:1788521343.786733:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788521343.798107:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521343.798259:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201407104 00000100:00100000:1.0:1788521343.798269:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201407104 00000100:00100000:1.0:1788521343.798330:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 140 00000100:00100000:1.0:1788521343.798349:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+21:11416:x1875400201407104:12345-192.168.203.41@tcp:58:lfs.0 00000040:00080000:1.0:1788521343.798552:0:9815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788521343.798633:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+21:11416:x1875400201407104:12345-192.168.203.41@tcp:58:lfs.0 Request processed in 294us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521343.798642:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 140 00000100:00100000:0.0:1788521343.854615:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521343.854905:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201407232 00000100:00100000:2.0:1788521343.854916:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201407232 00000100:00100000:2.0:1788521343.854986:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 141 00000100:00100000:2.0:1788521343.854997:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+21:11419:x1875400201407232:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:2.0:1788521343.855018:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521343.855037:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1c35 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed78a expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.855119:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c3c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.855133:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c3c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.855145:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c3c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.855158:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1c43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.855166:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1c43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.855172:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1c43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.855260:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1c4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.855271:0:12956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1b55 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed74b expref: 22 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.855280:0:12956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1c4a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.855314:0:12956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1b55 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed74b expref: 22 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521343.855329:0:12956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1b55 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed74b expref: 22 pid: 9815 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521343.855349:0:12956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58340380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12956:1875400222453248:192.168.203.41@tcp:104: 00000100:00100000:2.0:1788521343.855427:0:12956:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef51dce540 going to sleep for 11 seconds 00000100:00100000:2.0:1788521343.868418:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521343.869306:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201407488 00000100:00100000:1.0:1788521343.869316:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201407488 00000100:00100000:1.0:1788521343.869383:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 33 00000100:00100000:1.0:1788521343.869394:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58341180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+23:9947:x1875400201407488:12345-192.168.203.41@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788521343.869631:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58341180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+24:9947:x1875400201407488:12345-192.168.203.41@tcp:35:ldlm_bl.0 Request processed in 239us (1224us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788521343.869639:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 33 00000100:00100000:0.0:1788521343.870793:0:12956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58340380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12956:1875400222453248:192.168.203.41@tcp:104: 00010000:00010000:0.0:1788521343.870821:0:12956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1c4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521343.872200:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521343.872577:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201407616 00000100:00100000:1.0:1788521343.872588:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201407616 00010000:00010000:1.0:1788521343.872629:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1b55 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed74b expref: 24 pid: 9815 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521343.872680:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 77 00000100:00100000:1.0:1788521343.872689:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+24:2395:x1875400201407616:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521343.872703:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521343.872723:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1b55 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed74b expref: 24 pid: 9815 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521343.872737:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1b55 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed74b expref: 24 pid: 9815 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521343.872760:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1b55 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed74b expref: 24 pid: 9815 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521343.872776:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:1.0:1788521343.872782:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1c4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521343.872790:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1c4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521343.872797:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1c4a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521343.872828:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521343.872929:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+23:2395:x1875400201407616:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 240us (735us total) trans 0 rc 0/0 00010000:00010000:0.0:1788521343.874140:0:12956:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1c4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.874152:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1c4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521343.874207:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788521343.874212:0:12956:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788521343.874234:0:12956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1c4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.874248:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1c4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.874257:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c3c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.874264:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c3c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.874271:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c3c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.874277:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7200 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521343.874281:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c3c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.874288:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c3c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.874300:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:0.0:1788521343.874317:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521343.874322:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c3c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.874329:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1c3c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.874353:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1c43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.874360:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1c43 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.874366:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1c43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.874371:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521343.874374:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1c43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.874381:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1c43 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.874389:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8fee410f7800) 00010000:00010000:0.0:1788521343.874392:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521343.874395:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1c43 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.874401:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1c43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.874441:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1c35 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed78a expref: 24 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.874468:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1c4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed78a expref: 23 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521343.874475:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:0.0:1788521343.874478:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788521343.874480:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b6000, rc 0) 00000100:00100000:0.0:1788521343.874552:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+23:11419:x1875400201407232:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 19547us (19936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521343.874560:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 141 00000100:00100000:1.0:1788521343.876234:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 77 00010000:00010000:0.0:1788521344.205638:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788521344.854637:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788521344.854646:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788521344.854673:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788521344.854680:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788521344.854809:0:13799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58343480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1875400222453376:192.168.203.41@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788521344.854931:0:13799:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef435bc600 going to sleep for 11 seconds 00000100:00100000:0.0:1788521344.867097:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521344.867602:0:13799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58343480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1875400222453376:192.168.203.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788521344.867860:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201407744 00000100:00100000:3.0:1788521344.867868:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201407744 00000100:00100000:3.0:1788521344.867944:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 142 00000100:00100000:3.0:1788521344.867954:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f08ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+22:11430:x1875400201407744:12345-192.168.203.41@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788521344.867990:0:6521:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788521344.868632:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f08ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+22:11430:x1875400201407744:12345-192.168.203.41@tcp:53:lhsmtool_posix.0 Request processed in 152us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521344.868643:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 142 00000100:00100000:3.0:1788521344.873430:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521344.873551:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201408000 00000100:00100000:1.0:1788521344.873560:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201408000 00000100:00100000:1.0:1788521344.873620:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 143 00000100:00100000:1.0:1788521344.873630:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+22:11430:x1875400201408000:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788521344.873651:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521344.873678:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1c51 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed791 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521344.873786:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1c58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521344.873800:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1c58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521344.873811:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1c58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521344.873821:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788521344.873937:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1c51 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed791 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521344.873953:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1c58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed791 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521344.873960:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:1.0:1788521344.873963:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521344.873966:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434aba00, rc 0) 00000100:00100000:1.0:1788521344.874018:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+24:11430:x1875400201408000:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 389us (598us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1788521344.874025:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 143 00000100:00100000:3.0:1788521344.894510:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521344.894616:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201408128 00000100:00100000:0.0:1788521344.894627:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201408128 00000100:00100000:0.0:1788521344.894696:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 11 00000100:00100000:0.0:1788521344.894710:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+24:2394:x1875400201408128:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521344.894726:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521344.894748:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1c58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed791 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521344.894765:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:0.0:1788521344.894771:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521344.894828:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+23:2394:x1875400201408128:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 120us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521344.894836:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 11 00000100:00100000:1.0:1788521344.908904:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521344.910780:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201408384 00000100:00100000:0.0:1788521344.910801:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201408384 00000100:00100000:0.0:1788521344.911536:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 144 00000100:00100000:0.0:1788521344.911552:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+23:11430:x1875400201408384:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788521344.912565:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1c66 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521344.912586:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1c66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521344.912598:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1c66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521344.912847:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1c66 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521344.912855:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1c66 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521344.912863:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1c66 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788521344.913026:0:14265:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788521344.913032:0:14265:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788521344.913064:0:14265:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788521344.913070:0:14265:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788521344.913538:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410400 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521344.913543:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1c66 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521344.913552:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1c66 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521344.913565:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:0.0:1788521344.913569:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788521344.913574:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1c66 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521344.913593:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1c66 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521344.914092:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+24:11430:x1875400201408384:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 Request processed in 2539us (5220us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788521344.915267:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 144 00000040:00080000:0.0:1788521344.915392:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788521344.915396:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788521344.919223:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788521344.919239:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788521344.945483:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521344.945559:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201408640 00000100:00100000:1.0:1788521344.945568:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201408640 00000100:00100000:1.0:1788521344.945632:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 34 00000100:00100000:1.0:1788521344.945643:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58342d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+24:11430:x1875400201408640:12345-192.168.203.41@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788521344.945863:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58342d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+25:11430:x1875400201408640:12345-192.168.203.41@tcp:35:lhsmtool_posix.0 Request processed in 222us (388us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788521344.945917:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 34 00010000:00010000:2.0:1788521345.229453:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521346.160045:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521346.160104:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521346.160216:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201408768 00000100:00100000:1.0:1788521346.160227:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201408768 00000100:00100000:1.0:1788521346.160281:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 387 00000100:00100000:1.0:1788521346.160291:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2393:x1875400201408768:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521346.160369:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2393:x1875400201408768:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 78us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521346.160376:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 387 00000100:00100000:3.0:1788521346.160946:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521346.164744:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521346.164767:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521346.164785:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521346.170269:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201408896 00000100:00100000:0.0:1788521346.170286:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201408896 00000100:00100000:0.0:1788521346.170383:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201409024 00000100:00100000:0.0:1788521346.170386:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201409024 00000100:00100000:0.0:1788521346.170421:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 312 00000100:00100000:0.0:1788521346.170431:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+25:2394:x1875400201408896:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521346.170520:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+25:2394:x1875400201408896:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 90us (10414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521346.170528:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 312 00000100:00100000:0.0:1788521346.170546:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 313 00000100:00100000:0.0:1788521346.170553:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+5:2393:x1875400201409024:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521346.170578:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+5:2393:x1875400201409024:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 25us (9634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521346.170585:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 313 00000100:00080000:3.0:1788521346.173774:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788521346.173784:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521346.173803:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201409280 00000100:00100000:3.0:1788521346.173813:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201409280 00000100:00100000:3.0:1788521346.173863:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201409152 00000100:00100000:3.0:1788521346.173867:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201409152 00000100:00100000:3.0:1788521346.173918:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 128 00000100:00100000:3.0:1788521346.173928:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc75e887-507e-4861-8203-e266d82f5177+6:2393:x1875400201409280:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521346.174015:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc75e887-507e-4861-8203-e266d82f5177+6:2393:x1875400201409280:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 89us (9277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521346.174023:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 128 00000100:00100000:3.0:1788521346.174041:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 129 00000100:00100000:3.0:1788521346.174047:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc75e887-507e-4861-8203-e266d82f5177+5:2394:x1875400201409152:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521346.174073:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc75e887-507e-4861-8203-e266d82f5177+5:2394:x1875400201409152:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 27us (9306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521346.174079:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 129 00000100:00100000:3.0:1788521346.174348:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201409536 00000100:00100000:3.0:1788521346.174353:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201409536 00000100:00100000:3.0:1788521346.174398:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 314 00000100:00100000:3.0:1788521346.174415:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef50f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2393:x1875400201409536:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521346.174446:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef50f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2393:x1875400201409536:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 32us (9660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521346.174453:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 314 00000100:00080000:3.0:1788521346.174474:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788521346.174477:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788521346.174479:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788521346.174528:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521346.174549:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201409408 00000100:00100000:3.0:1788521346.174552:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201409408 00000100:00100000:3.0:1788521346.174576:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 315 00000100:00100000:3.0:1788521346.174583:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef50f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2394:x1875400201409408:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521346.174608:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef50f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2394:x1875400201409408:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 25us (80us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521346.174614:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 315 00000100:00080000:3.0:1788521346.174626:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521346.189700:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef44fc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222453504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521346.189779:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521346.189938:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222453504 00000100:00100000:1.0:1788521346.189946:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222453504 00000100:00100000:1.0:1788521346.190020:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788521346.190030:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875400222453504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521346.190060:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788521346.190119:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875400222453504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521346.190127:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:1.0:1788521346.190212:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788521346.190252:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef44fc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222453504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521346.190919:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222453632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788521346.191001:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521346.191262:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222453632 00000100:00100000:0.0:1788521346.191269:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222453632 00000100:00100000:0.0:1788521346.191312:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788521346.191329:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58343480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222453632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788521346.191365:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788521346.191420:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58343480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222453632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521346.191427:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788521346.191463:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222453632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788521346.193265:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875400222453888:0@lo:400:kworker.0 00000100:00100000:0.0:1788521346.193338:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521346.193377:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875400222454400:0@lo:400:kworker.0 00000100:00100000:0.0:1788521346.193405:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521346.193435:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875400222454912:0@lo:400:kworker.0 00000100:00100000:0.0:1788521346.193462:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521346.193489:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788521346.193494:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222453760:0@lo:400:kworker.0 00000100:00100000:0.0:1788521346.193524:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521346.193546:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875400222454272:0@lo:400:kworker.0 00000100:00100000:0.0:1788521346.193569:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521346.193584:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875400222454784:0@lo:400:kworker.0 00000100:00100000:0.0:1788521346.193602:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521346.193626:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222453888 00000100:00100000:0.0:1788521346.193639:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222453888 00000100:00100000:0.0:1788521346.193680:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222454400 00000100:00100000:0.0:1788521346.193684:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222454400 00000100:00100000:0.0:1788521346.193710:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222454912 00000100:00100000:0.0:1788521346.193713:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222454912 00000100:00100000:0.0:1788521346.193724:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222454272 00000100:00100000:0.0:1788521346.193727:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222454272 00000100:00100000:0.0:1788521346.193739:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222454784 00000100:00100000:0.0:1788521346.193741:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222454784 00000100:00100000:0.0:1788521346.193757:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788521346.193765:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875400222453888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521346.193902:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875400222453888:12345-0@lo:400:kworker.0 Request processed in 119us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521346.193914:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788521346.193935:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788521346.193942:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875400222454400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521346.194600:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875400222454400:12345-0@lo:400:kworker.0 Request processed in 30us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521346.194609:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788521346.194625:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788521346.194633:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875400222454912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521346.194666:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875400222454912:12345-0@lo:400:kworker.0 Request processed in 35us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521346.194671:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788521346.194681:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1788521346.194687:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875400222454272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521346.194710:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875400222454272:12345-0@lo:400:kworker.0 Request processed in 24us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521346.194725:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1788521346.194737:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788521346.194742:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875400222454784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521346.194769:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875400222454784:12345-0@lo:400:kworker.0 Request processed in 27us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521346.194775:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788521346.194808:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222454144:0@lo:400:kworker.0 00000100:00100000:0.0:1788521346.194833:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521346.194855:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222454656:0@lo:400:kworker.0 00000100:00100000:0.0:1788521346.194874:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521346.194912:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788521346.194918:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875400222454016:0@lo:400:kworker.0 00000100:00100000:0.0:1788521346.194937:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521346.194951:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222454528:0@lo:400:kworker.0 00000100:00100000:0.0:1788521346.194966:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521346.194996:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222455040:0@lo:400:kworker.0 00000100:00100000:0.0:1788521346.195015:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521346.195038:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222454144 00000100:00100000:0.0:1788521346.195042:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222454144 00000100:00100000:0.0:1788521346.195069:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788521346.195075:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222454144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521346.196241:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222453760 00000100:00100000:1.0:1788521346.196252:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222453760 00000100:00100000:1.0:1788521346.196328:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1788521346.196337:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3644:x1875400222453760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521346.196402:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3644:x1875400222453760:12345-0@lo:400:kworker.0 Request processed in 67us (2877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521346.196409:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00080000:1.0:1788521346.196443:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788521346.196448:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788521346.197856:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222454144:12345-0@lo:400:kworker.0 Request processed in 2775us (3016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521346.197866:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788521346.197921:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222454656 00000100:00100000:0.0:1788521346.197928:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222454656 00000100:00100000:2.0:1788521346.199009:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222453760:0@lo:400:kworker.0 00000100:00100000:2.0:1788521346.199023:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875400222454272:0@lo:400:kworker.0 00000100:00100000:2.0:1788521346.199030:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875400222454784:0@lo:400:kworker.0 00000100:00100000:2.0:1788521346.199042:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875400222453888:0@lo:400:kworker.0 00010000:00080000:2.0:1788521346.199054:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43c66680 x1875400222454400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521346.199062:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875400222454400:0@lo:400:kworker.0 00010000:00080000:2.0:1788521346.199070:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43c66a00 x1875400222454912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521346.199072:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222454528 00000100:00100000:2.0:1788521346.199078:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875400222454912:0@lo:400:kworker.0 00000100:00100000:0.0:1788521346.199080:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222454528 00000100:00100000:2.0:1788521346.199109:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222454016 00000100:00100000:2.0:1788521346.199112:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222454016 00000100:00100000:2.0:1788521346.199139:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788521346.199144:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875400222454016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521346.199186:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875400222454016:12345-0@lo:400:kworker.0 Request processed in 40us (4246us total) trans 0 rc 0/0 00000100:00080000:1.0:1788521346.199218:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521346.199245:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875400222454016:0@lo:400:kworker.0 00000100:00100000:1.0:1788521346.199259:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222454144:0@lo:400:kworker.0 00000100:00100000:2.0:1788521346.199537:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788521346.200331:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222455040 00000100:00100000:3.0:1788521346.200338:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222455040 00000100:00100000:0.0:1788521346.200416:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788521346.200425:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1875400222454656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521346.200490:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1875400222454656:12345-0@lo:400:kworker.0 Request processed in 66us (5614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521346.200496:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788521346.200509:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788521346.200515:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222454528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521346.200542:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222454528:12345-0@lo:400:kworker.0 Request processed in 28us (5575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521346.200549:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788521346.200596:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222454528:0@lo:400:kworker.0 00000100:00100000:0.0:1788521346.200607:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222454656:0@lo:400:kworker.0 00000100:00080000:1.0:1788521346.205492:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788521346.205804:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788521346.205817:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222455040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521346.205938:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222455040:12345-0@lo:400:kworker.0 Request processed in 124us (10921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521346.205947:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788521346.206018:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222455040:0@lo:400:kworker.0 00000100:00080000:3.0:1788521346.206061:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788521346.253203:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521346.701158:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58340380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222455168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788521346.701349:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222455296:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788521346.701412:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521346.701521:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222455296 00000100:00100000:0.0:1788521346.701529:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222455296 00000100:00100000:0.0:1788521346.701587:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788521346.701597:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222455296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788521346.701629:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788521346.701682:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222455296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521346.701692:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788521346.701770:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222455296:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788521346.701836:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521346.702053:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222455168 00000100:00100000:0.0:1788521346.702057:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222455168 00000100:00100000:0.0:1788521346.702097:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788521346.702104:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222455168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788521346.702119:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788521346.702249:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222455168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 144us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521346.702255:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788521346.702351:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58340380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222455168:0@lo:13:osp-pre-1-1.0 00000040:00080000:0.0:1788521346.792874:0:14317:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788521346.793004:0:14317:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788521346.793037:0:14317:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788521346.793045:0:14317:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788521346.970367:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521346.970514:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201409792 00000100:00100000:3.0:1788521346.970542:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201409792 00000100:00100000:3.0:1788521346.970610:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 145 00000100:00100000:3.0:1788521346.970621:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+25:11451:x1875400201409792:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:3.0:1788521346.970653:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521346.970679:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1c6d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed798 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521346.970983:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1c74 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521346.971010:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1c74 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521346.971027:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1c74 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521346.971038:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788521346.971169:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb200/0x411dd0ee4d2d1c6d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed798 expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521346.971190:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1c74 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed798 expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521346.971200:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:3.0:1788521346.971202:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788521346.971206:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749cb800, rc 0) 00000100:00100000:3.0:1788521346.971277:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+27:11451:x1875400201409792:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 657us (924us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788521346.971285:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 145 00000100:00100000:3.0:1788521346.975989:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521346.976102:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201409920 00000100:00100000:2.0:1788521346.976116:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201409920 00000100:00100000:2.0:1788521346.976346:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 146 00000100:00100000:2.0:1788521346.976360:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef50f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+27:11451:x1875400201409920:12345-192.168.203.41@tcp:54:lfs.0 00010000:00010000:2.0:1788521346.976428:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1c82 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521346.976457:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1c82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521346.976470:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1c82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521346.976507:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1c82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521346.976515:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1c82 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521346.976522:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1c82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521346.976528:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521346.976533:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1c82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521346.976541:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1c82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521346.976552:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:2.0:1788521346.976555:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521346.976565:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1c82 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521346.976583:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1c82 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521346.976672:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef50f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+27:11451:x1875400201409920:12345-192.168.203.41@tcp:54:lfs.0 Request processed in 316us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521346.976681:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 146 00000100:00100000:2.0:1788521347.079567:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521347.079703:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201410048 00000100:00100000:3.0:1788521347.079712:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201410048 00000100:00100000:3.0:1788521347.079772:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 54 00000100:00100000:3.0:1788521347.079783:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+6:2393:x1875400201410048:12345-192.168.203.41@tcp:101:cat.0 00010000:00010000:3.0:1788521347.079800:0:8875:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521347.079820:0:8875:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea1ca7e4/0x411dd0ee4d2d1c89 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed79f expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788521347.080115:0:8875:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9aab7e, atime: 0x6a9aab7d, ctime: 0x6a9aab7e, blocks: 0x8 00010000:00010000:3.0:1788521347.080135:0:8875:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=397s v=(0 0) 00010000:00010000:3.0:1788521347.080140:0:8875:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521347.080151:0:8875:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea1ca7e4/0x411dd0ee4d2d1c89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed79f expref: 7 pid: 8875 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521347.080346:0:8875:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ea1ca7e4/0x411dd0ee4d2d1c89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed79f expref: 7 pid: 8875 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521347.080363:0:8875:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749cb200, rc 0) 00000100:00100000:3.0:1788521347.080426:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+7:2393:x1875400201410048:12345-192.168.203.41@tcp:101:cat.0 Request processed in 644us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521347.080433:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 54 00000100:00100000:0.0:1788521347.085512:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521347.089557:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201410176 00000100:00100000:1.0:1788521347.089572:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201410176 00002000:00100000:1.0:1788521347.089633:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8fee43c65f80 x1875400201410176/t0(0) o3->fc75e887-507e-4861-8203-e266d82f5177@192.168.203.41@tcp:348/0 lens 488/0 e 0 to 0 dl 1788521358 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788521347.089645:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fee43c65f80 with x1875400201410176 ext(0->4095) 00002000:00010000:1.0:1788521347.089652:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fee43c65f80 00000100:00100000:1.0:1788521347.089696:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 3 00000100:00100000:1.0:1788521347.089706:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc75e887-507e-4861-8203-e266d82f5177+7:2394:x1875400201410176:12345-192.168.203.41@tcp:3:cat.0 00000100:00100000:1.0:1788521347.090094:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc75e887-507e-4861-8203-e266d82f5177+7:2394:x1875400201410176:12345-192.168.203.41@tcp:3:cat.0 Request processed in 387us (4591us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788521347.090116:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 3 00002000:00100000:1.0:1788521347.090123:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8fee43c65f80 x1875400201410176/t0(0) o3->fc75e887-507e-4861-8203-e266d82f5177@192.168.203.41@tcp:348/0 lens 488/4536 e 0 to 0 dl 1788521358 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788521347.090131:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fee43c65f80 with x1875400201410176 ext(0->4095) 00002000:00010000:1.0:1788521347.090134:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fee43c65f80 00010000:00010000:2.0:1788521347.279435:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788521347.280846:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788521347.981343:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788521347.981354:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788521347.981375:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788521347.981385:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788521348.301085:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521348.749571:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521348.749641:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222455552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788521348.749752:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521348.749824:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222455552 00000100:00100000:2.0:1788521348.749832:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222455552 00000100:00100000:2.0:1788521348.749876:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788521348.749912:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222455552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788521348.749941:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521348.749981:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222455552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521348.749987:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1788521348.750007:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521348.750037:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222455552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788521348.758028:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222455424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521348.758102:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521348.758740:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222455424 00000100:00100000:3.0:1788521348.758751:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222455424 00000100:00100000:3.0:1788521348.758827:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788521348.758837:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875400222455424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788521348.758872:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788521348.758951:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875400222455424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521348.758958:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:0.0:1788521348.759330:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521348.759374:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222455424:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788521349.325244:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788521349.782094:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1788521349.782141:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8fef51dce840 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788521349.782147:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fef4e704900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8fef51dce480 00000020:00080000:1.0:1788521349.782150:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fef4e704f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8fee4247f800 00000020:00080000:1.0:1788521349.782178:0:6498:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1788521349.784391:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1788521349.784476:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1788521349.785063:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:0.0:1788521349.785071:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:3.0:1788521349.787494:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d1c04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521349.787513:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d1c04 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521349.787521:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d1c04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521349.787526:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40030e00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521349.787531:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d1c04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521349.787540:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d1c04 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521349.787558:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8fee410f7a00) 00010000:00010000:3.0:1788521349.787561:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521349.787566:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d1c04 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521349.787573:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d1c04 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788521349.790608:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00010000:00010000:2.0:1788521350.349815:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521351.281494:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521351.281696:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521351.281731:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521351.281756:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521351.281773:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521351.281814:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521351.281840:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521351.281874:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201410560 00000100:00100000:2.0:1788521351.281908:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201410560 00000100:00100000:2.0:1788521351.281979:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201411072 00000100:00100000:2.0:1788521351.281983:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201411072 00000100:00100000:2.0:1788521351.281995:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201410432 00000100:00100000:2.0:1788521351.281998:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201410432 00000100:00100000:2.0:1788521351.282011:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201410944 00000100:00100000:2.0:1788521351.282013:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201410944 00000100:00100000:2.0:1788521351.282030:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 322 00000100:00100000:2.0:1788521351.282042:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2394:x1875400201410560:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521351.282142:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2394:x1875400201410560:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 102us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521351.282151:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 322 00000100:00100000:2.0:1788521351.282171:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 323 00000100:00100000:2.0:1788521351.282178:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2394:x1875400201411072:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521351.282204:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2394:x1875400201411072:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 28us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521351.282211:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 323 00000100:00100000:2.0:1788521351.282223:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 324 00000100:00100000:2.0:1788521351.282229:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58373b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+13:2394:x1875400201410432:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521351.282255:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58373b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+13:2394:x1875400201410432:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 27us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521351.282261:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 324 00000100:00100000:2.0:1788521351.282272:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 325 00000100:00100000:2.0:1788521351.282295:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58373800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2394:x1875400201410944:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521351.282322:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58373800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2394:x1875400201410944:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 38us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521351.282329:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 325 00000100:00080000:0.0:1788521351.282847:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788521351.282861:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788521351.282925:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201410816 00000100:00100000:0.0:1788521351.282931:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201410816 00000100:00100000:0.0:1788521351.282972:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201410688 00000100:00100000:0.0:1788521351.282975:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201410688 00000100:00100000:0.0:1788521351.282998:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 133 00000100:00100000:0.0:1788521351.283006:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc75e887-507e-4861-8203-e266d82f5177+6:2394:x1875400201410816:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521351.283068:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc75e887-507e-4861-8203-e266d82f5177+6:2394:x1875400201410816:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 62us (1334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521351.283075:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 133 00000100:00100000:0.0:1788521351.283089:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 134 00000100:00100000:0.0:1788521351.283679:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58371f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc75e887-507e-4861-8203-e266d82f5177+5:2394:x1875400201410688:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521351.283710:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58371f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc75e887-507e-4861-8203-e266d82f5177+5:2394:x1875400201410688:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 37us (1896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521351.283716:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 134 00000100:00080000:2.0:1788521351.283911:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788521351.283915:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788521351.285730:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201410304 00000100:00100000:1.0:1788521351.285747:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201410304 00000100:00100000:1.0:1788521351.285810:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 389 00000100:00100000:1.0:1788521351.285819:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2394:x1875400201410304:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521351.285915:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2394:x1875400201410304:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 96us (4431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521351.285923:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 389 00000100:00100000:0.0:1788521351.309157:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521351.309188:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222455680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521351.309276:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521351.309314:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef44fc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222456192:0@lo:400:kworker.0 00000100:00100000:0.0:1788521351.309355:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef44fc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222456064:0@lo:400:kworker.0 00000100:00100000:0.0:1788521351.309382:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521351.309401:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef44fcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875400222456576:0@lo:400:kworker.0 00000100:00100000:0.0:1788521351.309422:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521351.309427:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222455680 00000100:00100000:0.0:1788521351.309443:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4325a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875400222457088:0@lo:400:kworker.0 00000100:00100000:1.0:1788521351.309451:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222455680 00000100:00100000:0.0:1788521351.309476:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521351.309517:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788521351.309528:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222455680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521351.309576:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788521351.309621:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222455808:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788521351.309641:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222455680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521351.309654:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788521351.309663:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788521351.309683:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788521351.309721:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1788521351.309727:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1788521351.309760:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222455680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521351.311655:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef44fca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875400222456320:0@lo:400:kworker.0 00000100:00100000:0.0:1788521351.311720:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521351.311791:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521351.311816:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7a4fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222456832:0@lo:400:kworker.0 00000100:00100000:2.0:1788521351.311872:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58340380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875400222456704:0@lo:400:kworker.0 00000100:00100000:0.0:1788521351.311906:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521351.311939:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43dc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222457344:0@lo:400:kworker.0 00000100:00100000:0.0:1788521351.311977:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521351.311995:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521351.312010:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788521351.312019:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef44fc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222455936:0@lo:400:kworker.0 00000100:00100000:0.0:1788521351.312051:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521351.312077:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef44fca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222456448:0@lo:400:kworker.0 00000100:00100000:0.0:1788521351.312102:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521351.312119:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222456960:0@lo:400:kworker.0 00000100:00100000:0.0:1788521351.312138:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521351.312156:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43dc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222457472:0@lo:400:kworker.0 00000100:00100000:0.0:1788521351.312174:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521351.315172:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222456064 00000100:00100000:3.0:1788521351.315193:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222456064 00000100:00100000:2.0:1788521351.315205:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43dcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875400222457216:0@lo:400:kworker.0 00000100:00100000:2.0:1788521351.315272:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521351.315275:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222456576 00000100:00100000:3.0:1788521351.315306:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222456576 00000100:00100000:2.0:1788521351.315344:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222455808 00000100:00100000:2.0:1788521351.315353:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222455808 00000100:00100000:3.0:1788521351.315357:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222457088 00000100:00100000:3.0:1788521351.315363:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222457088 00000100:00100000:3.0:1788521351.315393:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222456320 00000100:00100000:3.0:1788521351.315398:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222456320 00000100:00100000:2.0:1788521351.315408:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222456192 00000100:00100000:3.0:1788521351.315422:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222456704 00000100:00100000:3.0:1788521351.315428:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222456704 00000100:00100000:2.0:1788521351.315429:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222456192 00000100:00100000:3.0:1788521351.315451:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222457216 00000100:00100000:3.0:1788521351.315456:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222457216 00000100:00100000:2.0:1788521351.315458:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222456448 00000100:00100000:2.0:1788521351.315464:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222456448 00000100:00100000:2.0:1788521351.315483:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788521351.315493:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1875400222455808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788521351.315527:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788521351.315579:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1875400222455808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (5914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521351.315586:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788521351.315601:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788521351.315607:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222456192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521351.315656:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222456192:12345-0@lo:400:kworker.0 Request processed in 50us (3874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521351.315663:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788521351.315673:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788521351.315679:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222456448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521351.315703:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222456448:12345-0@lo:400:kworker.0 Request processed in 25us (3601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521351.315708:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788521351.315758:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788521351.315773:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222456064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521351.315834:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788521351.315845:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875400222456576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521351.315989:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1788521351.316000:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875400222457088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521351.322246:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875400222456576:12345-0@lo:400:kworker.0 Request processed in 6392us (12811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521351.322261:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788521351.322314:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788521351.322330:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875400222456320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521351.322415:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875400222456320:12345-0@lo:400:kworker.0 Request processed in 93us (10696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521351.322421:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788521351.322436:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788521351.322444:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875400222456704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521351.322484:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875400222456704:12345-0@lo:400:kworker.0 Request processed in 43us (10491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521351.322491:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788521351.322504:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788521351.322511:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875400222457216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521351.322554:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875400222457216:12345-0@lo:400:kworker.0 Request processed in 44us (7283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521351.322561:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788521351.322636:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef44fcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875400222456576:0@lo:400:kworker.0 00000100:00100000:0.0:1788521351.322659:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222456064:12345-0@lo:400:kworker.0 Request processed in 6882us (13266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521351.322670:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef44fc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222456064:0@lo:400:kworker.0 00000100:00100000:0.0:1788521351.322679:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788521351.322729:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef44fca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222456448:0@lo:400:kworker.0 00000100:00100000:0.0:1788521351.322751:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222455936 00000100:00100000:2.0:1788521351.322758:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222455808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788521351.322762:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222455936 00000100:00100000:2.0:1788521351.322775:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef44fca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875400222456320:0@lo:400:kworker.0 00000100:00100000:2.0:1788521351.322817:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef44fc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222456192:0@lo:400:kworker.0 00010000:00080000:2.0:1788521351.322831:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef58340380 x1875400222456704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521351.322841:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58340380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875400222456704:0@lo:400:kworker.0 00010000:00080000:2.0:1788521351.322851:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43dcaa00 x1875400222457216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521351.322859:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43dcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875400222457216:0@lo:400:kworker.0 00000100:00080000:2.0:1788521351.322984:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788521351.322991:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521351.323149:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1788521351.323163:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3643:x1875400222455936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521351.323258:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3643:x1875400222455936:12345-0@lo:400:kworker.0 Request processed in 99us (11206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521351.323266:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1788521351.323327:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222456832 00000100:00100000:0.0:1788521351.323333:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222456832 00000100:00100000:0.0:1788521351.323366:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222457344 00000100:00100000:0.0:1788521351.323370:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222457344 00000100:00100000:0.0:1788521351.323387:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222456960 00000100:00100000:0.0:1788521351.323390:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222456960 00000100:00100000:0.0:1788521351.323402:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222457472 00000100:00100000:0.0:1788521351.323405:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222457472 00000100:00100000:0.0:1788521351.323417:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788521351.323424:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222456832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521351.323460:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222456832:12345-0@lo:400:kworker.0 Request processed in 37us (11580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521351.323467:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788521351.323478:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788521351.323484:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222457344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521351.323526:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222457344:12345-0@lo:400:kworker.0 Request processed in 43us (11550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521351.323533:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788521351.323544:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788521351.323550:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222456960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521351.323580:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222456960:12345-0@lo:400:kworker.0 Request processed in 30us (11440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521351.323585:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788521351.323595:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788521351.323609:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43eeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222457472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521351.323639:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43eeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222457472:12345-0@lo:400:kworker.0 Request processed in 32us (11465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521351.323646:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:0.0:1788521351.324561:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521351.324568:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521351.324612:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef44fc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222455936:0@lo:400:kworker.0 00000100:00100000:0.0:1788521351.324632:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1788521351.324638:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fee43d20000, transno 4294967305 00000100:00100000:0.0:1788521351.324655:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222456960:0@lo:400:kworker.0 00000100:00100000:0.0:1788521351.324670:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43dc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222457472:0@lo:400:kworker.0 00000100:00100000:0.0:1788521351.324683:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7a4fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222456832:0@lo:400:kworker.0 00000100:00100000:0.0:1788521351.324695:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43dc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222457344:0@lo:400:kworker.0 00000100:00100000:3.0:1788521351.325388:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875400222457088:12345-0@lo:400:kworker.0 Request processed in 9388us (15907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521351.325401:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788521351.326350:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4325a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875400222457088:0@lo:400:kworker.0 00010000:00010000:2.0:1788521351.373698:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521351.821747:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222457600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788521351.821852:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521351.821945:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222457728:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788521351.821992:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521351.822035:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222457600 00000100:00100000:3.0:1788521351.822056:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222457600 00000100:00100000:3.0:1788521351.822136:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788521351.822149:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43dc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222457600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788521351.822193:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788521351.822488:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222457728 00000100:00100000:1.0:1788521351.822493:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222457728 00000100:00100000:1.0:1788521351.822545:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788521351.822554:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222457728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788521351.822573:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788521351.822586:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43dc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222457600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 425us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521351.822606:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788521351.822645:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222457728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521351.822651:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222457600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788521351.822659:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788521351.822750:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222457728:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788521351.868571:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521351.870923:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201411200 00000100:00100000:0.0:1788521351.870945:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201411200 00000100:00100000:1.0:1788521351.874612:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 147 00000100:00100000:1.0:1788521351.874631:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+13:11104:x1875400201411200:12345-192.168.203.41@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788521351.874804:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+13:11104:x1875400201411200:12345-192.168.203.41@tcp:60:lhsmtool_posix.0 Request processed in 171us (6242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521351.874812:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 147 00000100:00100000:2.0:1788521351.878819:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521351.882774:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201411328 00000100:00100000:0.0:1788521351.882798:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201411328 00000100:00100000:1.0:1788521351.882956:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 148 00000100:00100000:1.0:1788521351.882973:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+5:11104:x1875400201411328:12345-192.168.203.41@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788521351.883164:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+5:11104:x1875400201411328:12345-192.168.203.41@tcp:60:lhsmtool_posix.0 Request processed in 196us (4369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521351.883172:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 148 00000100:00100000:2.0:1788521351.887833:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521351.888016:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201411584 00000100:00100000:3.0:1788521351.888029:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201411584 00000100:00100000:3.0:1788521351.888192:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 35 00000100:00100000:3.0:1788521351.888204:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+13:11104:x1875400201411584:12345-192.168.203.41@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788521351.888530:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+14:11104:x1875400201411584:12345-192.168.203.41@tcp:35:lhsmtool_posix.0 Request processed in 329us (709us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788521351.888559:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 35 00000100:00100000:2.0:1788521352.281335:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521352.281499:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201411712 00000100:00100000:3.0:1788521352.281512:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201411712 00000100:00100000:3.0:1788521352.281599:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 149 00000100:00100000:3.0:1788521352.281612:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:11910:x1875400201411712:12345-192.168.203.41@tcp:101:lsof.0 00010000:00010000:3.0:1788521352.281640:0:9815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521352.284090:0:9815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1c90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed7a6 expref: -99 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521352.284176:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1c97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521352.284191:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1c97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521352.284204:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1c97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521352.284254:0:9815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788521352.284258:0:9815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788521352.284309:0:9815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1c97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521352.284335:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1c90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7a6 expref: 7 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521352.284356:0:9815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1c97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7a6 expref: 6 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521352.284365:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef76505500) 00010000:00010000:2.0:1788521352.284367:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788521352.284371:0:9815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7000, rc 0) 00000100:00100000:2.0:1788521352.284499:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:11910:x1875400201411712:12345-192.168.203.41@tcp:101:lsof.0 Request processed in 2889us (3175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521352.284508:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 149 00010000:00010000:2.0:1788521352.397195:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521353.421125:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521353.869624:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222457856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521353.869696:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521353.869995:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222457856 00000100:00100000:1.0:1788521353.870004:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222457856 00000100:00100000:3.0:1788521353.870024:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43eead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222457984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788521353.870056:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521353.870064:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222457984 00000100:00100000:1.0:1788521353.870067:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222457984 00000100:00100000:1.0:1788521353.870084:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788521353.870091:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788521353.870092:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222457856:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521353.870097:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef50f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222457984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788521353.870120:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1788521353.870120:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521353.870161:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222457856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521353.870168:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788521353.870358:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef50f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222457984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 260us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521353.870365:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:0.0:1788521353.870468:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521353.870504:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43eead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222457984:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788521353.870586:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222457856:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788521354.445053:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521355.470143:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788521355.609411:0:14514:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 07:29:13 (1788521353) 00000001:00080000:1.0:1788521355.920102:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:1.0:1788521355.920122:0:6498:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1788521355.921263:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788521355.921287:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788521356.389485:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521356.389531:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521356.389563:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521356.389605:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521356.389629:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521356.389644:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521356.389679:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521356.389710:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201412096 00000100:00100000:0.0:1788521356.389722:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201412096 00000100:00100000:0.0:1788521356.389784:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201412608 00000100:00100000:0.0:1788521356.389786:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201412608 00000100:00100000:0.0:1788521356.389798:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201411968 00000100:00100000:0.0:1788521356.389800:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201411968 00000100:00100000:0.0:1788521356.389811:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201412480 00000100:00100000:0.0:1788521356.389813:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201412480 00000100:00100000:0.0:1788521356.389826:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 332 00000100:00100000:0.0:1788521356.389837:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43ee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2393:x1875400201412096:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521356.389985:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43ee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2393:x1875400201412096:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 149us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521356.389994:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 332 00000100:00100000:0.0:1788521356.390012:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 333 00000100:00100000:0.0:1788521356.390018:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2393:x1875400201412608:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521356.390042:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2393:x1875400201412608:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 25us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521356.390048:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 333 00000100:00100000:0.0:1788521356.390059:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 334 00000100:00100000:0.0:1788521356.390065:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+13:2393:x1875400201411968:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521356.390094:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+13:2393:x1875400201411968:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 30us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521356.390109:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 334 00000100:00100000:0.0:1788521356.390121:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 335 00000100:00100000:0.0:1788521356.390129:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:2393:x1875400201412480:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521356.390154:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:2393:x1875400201412480:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 25us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521356.390160:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 335 00000100:00100000:0.0:1788521356.390184:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201412352 00000100:00100000:0.0:1788521356.390188:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201412352 00000100:00100000:0.0:1788521356.390218:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201412224 00000100:00100000:0.0:1788521356.390221:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201412224 00000100:00100000:0.0:1788521356.390247:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 139 00000100:00100000:0.0:1788521356.390268:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+6:2393:x1875400201412352:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521356.390302:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+6:2393:x1875400201412352:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 35us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521356.390308:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 139 00000100:00100000:0.0:1788521356.390321:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 140 00000100:00100000:0.0:1788521356.390327:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+5:2393:x1875400201412224:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521356.390355:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+5:2393:x1875400201412224:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 28us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521356.390362:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 140 00000100:00100000:1.0:1788521356.390439:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201411840 00000100:00100000:1.0:1788521356.390445:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201411840 00000100:00080000:0.0:1788521356.390484:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788521356.390489:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521356.390492:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788521356.390494:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788521356.395676:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 391 00000100:00100000:1.0:1788521356.395708:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2393:x1875400201411840:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521356.395827:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2393:x1875400201411840:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 134us (6357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521356.395836:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 391 00000100:00100000:1.0:1788521356.429986:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef50f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222458112:0@lo:400:kworker.0 00000100:00100000:1.0:1788521356.430109:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521356.430274:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222458112 00000100:00100000:3.0:1788521356.430287:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222458112 00000100:00100000:3.0:1788521356.430357:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1788521356.430370:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6da2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3645:x1875400222458112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521356.430402:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222458496:0@lo:400:kworker.0 00000100:00100000:1.0:1788521356.430606:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef50f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222458112:0@lo:400:kworker.0 00000100:00100000:1.0:1788521356.430615:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f075180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222458624:0@lo:400:kworker.0 00000100:00100000:2.0:1788521356.430765:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef50f4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875400222458240:0@lo:400:kworker.0 00000100:00100000:0.0:1788521356.439644:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521356.439727:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222459008:0@lo:400:kworker.0 00000100:00100000:0.0:1788521356.439784:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521356.439806:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222459520:0@lo:400:kworker.0 00000100:00100000:0.0:1788521356.439829:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521356.439862:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788521356.439873:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef50f4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222458368:0@lo:400:kworker.0 00000100:00100000:0.0:1788521356.439920:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521356.439938:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875400222458880:0@lo:400:kworker.0 00000100:00100000:0.0:1788521356.439960:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521356.439980:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875400222459392:0@lo:400:kworker.0 00000100:00100000:0.0:1788521356.440005:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521356.440052:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222458368 00000100:00100000:0.0:1788521356.440062:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222458368 00000100:00100000:0.0:1788521356.440118:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788521356.440865:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222458368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521356.440981:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222458368:12345-0@lo:400:kworker.0 Request processed in 124us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521356.440989:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788521356.441054:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef50f4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222458368:0@lo:400:kworker.0 00000100:00100000:0.0:1788521356.441092:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222458496 00000100:00100000:0.0:1788521356.441098:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222458496 00000100:00100000:0.0:1788521356.441665:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222458880 00000100:00100000:0.0:1788521356.441672:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222458880 00000100:00100000:0.0:1788521356.441714:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222459392 00000100:00100000:0.0:1788521356.441717:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222459392 00000100:00100000:0.0:1788521356.441761:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788521356.441769:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222458496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521356.441837:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222458496:12345-0@lo:400:kworker.0 Request processed in 68us (2205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521356.441843:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788521356.441859:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1788521356.441865:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a4fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875400222458880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521356.441926:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a4fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875400222458880:12345-0@lo:400:kworker.0 Request processed in 61us (1964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521356.441933:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1788521356.441946:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1788521356.441952:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875400222459392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521356.441979:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875400222459392:12345-0@lo:400:kworker.0 Request processed in 28us (1974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521356.441986:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1788521356.442012:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222459008 00000100:00100000:0.0:1788521356.442016:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222459008 00000100:00100000:0.0:1788521356.442043:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222459520 00000100:00100000:0.0:1788521356.442045:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222459520 00000100:00100000:0.0:1788521356.442066:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788521356.442072:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222459008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521356.442101:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222459008:12345-0@lo:400:kworker.0 Request processed in 30us (2317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521356.442107:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788521356.442117:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788521356.442962:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521356.443089:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222459136:0@lo:400:kworker.0 00000100:00100000:1.0:1788521356.443140:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521356.443156:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222459648:0@lo:400:kworker.0 00000100:00100000:1.0:1788521356.443525:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521356.443654:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222458624 00000100:00100000:1.0:1788521356.443662:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222458624 00000100:00100000:1.0:1788521356.444096:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788521356.444110:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222458624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521356.444223:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43eead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222459520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521356.444671:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222458624:12345-0@lo:400:kworker.0 Request processed in 564us (1714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521356.444680:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788521356.444868:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f075180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222458624:0@lo:400:kworker.0 00000100:00100000:1.0:1788521356.444976:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222459136 00000100:00100000:1.0:1788521356.444983:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222459136 00000100:00100000:1.0:1788521356.445374:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222459648 00000100:00100000:1.0:1788521356.445379:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222459648 00000100:00100000:1.0:1788521356.445403:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788521356.445412:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43dc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222459136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521356.445748:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43dc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222459136:12345-0@lo:400:kworker.0 Request processed in 336us (2612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521356.445755:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788521356.445769:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788521356.445776:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222459648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521356.445822:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222459648:12345-0@lo:400:kworker.0 Request processed in 46us (2297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521356.445827:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788521356.445869:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222459136:0@lo:400:kworker.0 00000100:00100000:1.0:1788521356.445906:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222459648:0@lo:400:kworker.0 00010000:00080000:1.0:1788521356.445976:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43c69f80 x1875400222458880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521356.445989:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875400222458880:0@lo:400:kworker.0 00010000:00080000:1.0:1788521356.446004:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43c69180 x1875400222459392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521356.446021:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875400222459392:0@lo:400:kworker.0 00000100:00100000:1.0:1788521356.446037:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222458496:0@lo:400:kworker.0 00000100:00100000:1.0:1788521356.446051:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222459008:0@lo:400:kworker.0 00000100:00080000:1.0:1788521356.446081:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788521356.446086:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788521356.446090:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788521356.446811:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43dc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222459904:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788521356.446872:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521356.447086:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222459904 00000100:00100000:1.0:1788521356.447095:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222459904 00000100:00100000:1.0:1788521356.447139:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788521356.447147:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222459904:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788521356.447926:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6da2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3645:x1875400222458112:12345-0@lo:400:kworker.0 Request processed in 17554us (17812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521356.447941:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000004:00000024:1.0:1788521356.449815:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788521356.454929:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43eead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222459520:12345-0@lo:400:kworker.0 Request processed in 12789us (15080us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521356.454951:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788521356.454996:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222459520:0@lo:400:kworker.0 00000100:00100000:2.0:1788521356.455738:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521356.455954:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875400222458752:0@lo:400:kworker.0 00000100:00100000:2.0:1788521356.456019:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521356.456054:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875400222459264:0@lo:400:kworker.0 00000100:00100000:2.0:1788521356.456082:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521356.456116:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222458240 00000100:00100000:0.0:1788521356.456134:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222458240 00000100:00100000:1.0:1788521356.456184:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222459904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 9035us (9309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521356.456194:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788521356.456271:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43dc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222459904:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788521356.460769:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222458752 00000100:00100000:1.0:1788521356.460784:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222459264 00000100:00100000:1.0:1788521356.460788:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222459264 00000100:00100000:0.0:1788521356.460788:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222458752 00000100:00100000:2.0:1788521356.460855:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1788521356.461778:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1788521356.461796:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875400222458752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521356.461941:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875400222458752:12345-0@lo:400:kworker.0 Request processed in 151us (5919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521356.461949:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00080000:0.0:1788521356.461995:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521356.465007:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875400222458240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521356.465410:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43eeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222459776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521356.465697:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875400222458240:12345-0@lo:400:kworker.0 Request processed in 4774us (9961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521356.465772:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788521356.465856:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521356.465961:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef50f4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875400222458240:0@lo:400:kworker.0 00000100:00100000:3.0:1788521356.465976:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875400222458752:0@lo:400:kworker.0 00000100:00100000:0.0:1788521356.466126:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222459776 00000100:00100000:0.0:1788521356.466136:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222459776 00000100:00100000:0.0:1788521356.466198:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788521356.466207:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222459776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788521356.466656:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788521356.466729:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222459776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 522us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521356.466736:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788521356.466833:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43eeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222459776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521356.467935:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788521356.467961:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875400222459264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521356.468064:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875400222459264:12345-0@lo:400:kworker.0 Request processed in 117us (11981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521356.468072:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1788521356.468345:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875400222459264:0@lo:400:kworker.0 00010000:00010000:2.0:1788521356.493167:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521356.942401:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee41aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222460032:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788521356.942500:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43dc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222460160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788521356.942510:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521356.942554:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521356.942645:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222460032 00000100:00100000:0.0:1788521356.942657:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222460032 00000100:00100000:0.0:1788521356.942723:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788521356.942734:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222460032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788521356.943135:0:10099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788521356.943207:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222460032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 474us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521356.943216:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788521356.943295:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee41aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222460032:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788521356.943347:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222460160 00000100:00100000:0.0:1788521356.943352:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222460160 00000100:00100000:0.0:1788521356.946370:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788521356.947000:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222460160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788521356.947039:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788521356.947149:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222460160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 762us (4594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521356.947373:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43dc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222460160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788521356.953987:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788521357.053846:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521357.053994:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201412864 00000100:00100000:3.0:1788521357.054009:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201412864 00000100:00100000:1.0:1788521357.054189:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 150 00000100:00100000:1.0:1788521357.054204:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee41aab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+13:12177:x1875400201412864:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788521357.054234:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521357.054272:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1c9e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed7ad expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521357.054369:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1ca5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521357.055721:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1ca5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521357.055751:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1ca5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521357.057381:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1cac lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521357.057479:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1cac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521357.057496:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1cac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521357.057623:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1cb3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521357.057632:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521357.057640:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521357.057654:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788521357.057810:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1ca5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521357.057818:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1ca5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521357.057825:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1ca5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521357.057831:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434ab600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521357.057836:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1ca5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521357.057843:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1ca5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521357.057865:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8fee42476a00) 00010000:00010000:1.0:1788521357.057868:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521357.057873:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1ca5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521357.057880:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1ca5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521357.058215:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1cac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521357.058222:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1cac lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521357.058228:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1cac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521357.058232:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa000 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521357.058236:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1cac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521357.058242:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1cac lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521357.058261:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8fef71ec0500) 00010000:00010000:1.0:1788521357.058263:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521357.058267:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1cac lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521357.058272:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1cac lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521357.059585:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1c9e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7ad expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521357.059602:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7ad expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521357.059610:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fee410f5900) 00010000:00010000:1.0:1788521357.059613:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521357.059616:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434aa200, rc 0) 00000100:00100000:1.0:1788521357.060925:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee41aab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+15:12177:x1875400201412864:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 6715us (7085us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1788521357.060936:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 150 00000100:00100000:3.0:1788521357.075503:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521357.076581:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201413120 00000100:00100000:2.0:1788521357.076599:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201413120 00000100:00100000:2.0:1788521357.076689:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 151 00000100:00100000:2.0:1788521357.076702:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+15:12177:x1875400201413120:12345-192.168.203.41@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788521357.076860:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+15:12177:x1875400201413120:12345-192.168.203.41@tcp:59:lhsmtool_posix.0 Request processed in 160us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521357.076945:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 151 00000100:00100000:2.0:1788521357.081503:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521357.081934:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521357.082071:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201413248 00000100:00100000:2.0:1788521357.082084:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201413248 00000100:00100000:2.0:1788521357.082168:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 152 00000100:00100000:2.0:1788521357.082180:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+5:12177:x1875400201413248:12345-192.168.203.41@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788521357.082342:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+5:12177:x1875400201413248:12345-192.168.203.41@tcp:59:lhsmtool_posix.0 Request processed in 165us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521357.082350:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 152 00000100:00100000:0.0:1788521357.082931:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201412992 00000100:00100000:0.0:1788521357.082939:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201412992 00000100:00100000:0.0:1788521357.082991:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 12 00000100:00100000:0.0:1788521357.083000:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4e7e3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+15:2395:x1875400201412992:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521357.083021:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521357.083053:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1cb3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7ad expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521357.083077:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fee410f5900) 00010000:00010000:0.0:1788521357.083083:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521357.083254:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4e7e3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+14:2395:x1875400201412992:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 246us (1757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521357.083284:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 12 00000040:00080000:2.0:1788521357.197629:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788521357.197641:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788521357.197769:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1788521357.197776:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788521357.519126:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788521357.519998:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521358.561589:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521358.989477:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222460288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521358.989548:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521358.989638:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222460288 00000100:00100000:1.0:1788521358.989646:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222460288 00000100:00100000:1.0:1788521358.989702:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788521358.989712:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222460288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788521358.989738:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788521358.992209:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521358.994252:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222460288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4523us (4686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521358.994265:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788521358.994453:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788521358.994468:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222460416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788521358.994525:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521358.994570:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222460416 00000100:00100000:2.0:1788521358.994578:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222460416 00000100:00100000:2.0:1788521358.994626:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788521358.994634:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222460416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788521358.994655:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521358.994697:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222460416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521358.994704:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:2.0:1788521358.994721:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521358.994783:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222460416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788521358.996465:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222460288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521359.188539:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521359.198690:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201413376 00000100:00100000:1.0:1788521359.198705:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201413376 00000100:00100000:0.0:1788521359.198861:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 153 00000100:00100000:0.0:1788521359.198874:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+14:12219:x1875400201413376:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:0.0:1788521359.198916:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521359.198939:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1cc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed7b4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.199127:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1cc8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.199143:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1cc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.199157:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1cc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.199173:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1ccf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.199181:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1ccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.199188:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1ccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.199241:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1cc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.199250:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1cc8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.199339:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1cc8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.199346:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410000 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521359.199351:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1cc8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.199361:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1cc8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.199375:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef76505500) 00010000:00010000:0.0:1788521359.199378:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521359.199383:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1cc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.199390:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1cc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.199405:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1ccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.199412:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1ccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.199418:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1ccf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.199424:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410a00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521359.199426:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1ccf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.199443:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1ccf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.199452:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8fee42474f00) 00010000:00010000:0.0:1788521359.199455:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521359.199458:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1ccf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.199464:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d1ccf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.199497:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1cc1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7b4 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.199507:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef76505500) 00010000:00010000:0.0:1788521359.199510:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521359.199514:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1cc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7b4 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.199523:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42410600, rc 0) 00000100:00100000:0.0:1788521359.199593:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+14:12219:x1875400201413376:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 722us (11062us total) trans 0 rc 301/301 00000100:00100000:0.0:1788521359.199602:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 153 00000100:00080000:2.0:1788521359.199691:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521359.206455:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521359.206529:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201413632 00000100:00100000:1.0:1788521359.206539:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201413632 00000100:00100000:1.0:1788521359.206596:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 154 00000100:00100000:1.0:1788521359.206606:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+14:12219:x1875400201413632:12345-192.168.203.41@tcp:36:lfs.0 00010000:00010000:1.0:1788521359.206666:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521359.206692:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbe00/0x411dd0ee4d2d1615 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5d8 expref: 14 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.206710:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef76505500) 00010000:00010000:1.0:1788521359.206715:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788521359.206786:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1cd6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.206802:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1c97 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7a6 expref: 5 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.206812:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1cd6 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.206844:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1c97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7a6 expref: 5 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.206858:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1c97 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7a6 expref: 5 pid: 9815 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521359.206873:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43dc9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1875400222460544:192.168.203.41@tcp:104: 00000100:00100000:1.0:1788521359.206988:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee4241f480 going to sleep for 11 seconds 00000100:00100000:1.0:1788521359.216652:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521359.216687:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201413760 00000100:00100000:1.0:1788521359.216695:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201413760 00010000:00010000:1.0:1788521359.216748:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1c97 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7a6 expref: 6 pid: 9815 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521359.216803:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 78 00000100:00100000:1.0:1788521359.216813:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43dcad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:2396:x1875400201413760:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521359.216840:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521359.216848:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1c97 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7a6 expref: 6 pid: 9815 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.216863:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1c97 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7a6 expref: 6 pid: 9815 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.216911:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef76505500) 00010000:00010000:1.0:1788521359.216917:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1cd6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.216928:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1cd6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.216936:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1cd6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.216957:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521359.217011:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43dcad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:2396:x1875400201413760:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 199us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521359.217019:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 78 00000100:00080000:1.0:1788521359.217520:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788521359.218859:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1c97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7a6 expref: 5 pid: 9815 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521359.218880:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43dc9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1875400222460544:192.168.203.41@tcp:104: 00010000:00010000:3.0:1788521359.218937:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1cd6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.218948:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1cd6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.218954:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1cd6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.218981:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1cdd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.218993:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1cdd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.219003:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1cdd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.221403:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1ce4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.221423:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1ce4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.221434:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1ce4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788521359.221453:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e7e357fb reply state 00000000dd0b9f32 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1ce4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.221464:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1ce4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.221484:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:3.0:1788521359.221487:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788521359.221492:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788521359.221498:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788521359.221508:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1cd6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.221516:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1cd6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.221524:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1cd6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.221531:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aaa00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521359.221536:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1cd6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.221545:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1cd6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.222428:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef76505500) 00010000:00010000:3.0:1788521359.222431:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521359.222437:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1cd6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.222446:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1cd6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788521359.222468:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e7e357fb reply state 00000000dd0b9f32 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1cdd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.222489:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1cdd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.222497:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8fef76505400) 00010000:00010000:3.0:1788521359.222500:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788521359.222503:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788521359.222610:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+15:12219:x1875400201413632:12345-192.168.203.41@tcp:36:lfs.0 Request processed in 16001us (16162us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788521359.222621:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 154 00000100:00100000:2.0:1788521359.334214:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521359.334313:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201413888 00000100:00100000:3.0:1788521359.334322:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201413888 00000100:00100000:3.0:1788521359.334385:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 155 00000100:00100000:3.0:1788521359.334396:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+15:12227:x1875400201413888:12345-192.168.203.41@tcp:101:lctl.0 00010000:00010000:3.0:1788521359.334421:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521359.334445:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d1ceb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed7bb expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.334514:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbe00/0x411dd0ee4d2d1cf2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.334529:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbe00/0x411dd0ee4d2d1cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.334541:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbe00/0x411dd0ee4d2d1cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521359.334583:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788521359.334586:0:12956:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788521359.334619:0:12956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbe00/0x411dd0ee4d2d1cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.334639:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d1ceb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7bb expref: 17 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.334656:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbe00/0x411dd0ee4d2d1cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7bb expref: 16 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.334664:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef76505500) 00010000:00010000:3.0:1788521359.334667:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788521359.334670:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef749cbe00, rc 0) 00000100:00100000:3.0:1788521359.334798:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+16:12227:x1875400201413888:12345-192.168.203.41@tcp:101:lctl.0 Request processed in 404us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521359.334804:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 155 00000100:00100000:3.0:1788521359.422528:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521359.422693:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201414016 00000100:00100000:1.0:1788521359.422703:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201414016 00000100:00100000:1.0:1788521359.422771:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 156 00000100:00100000:1.0:1788521359.422798:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+16:12233:x1875400201414016:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:1.0:1788521359.422817:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521359.422836:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1cf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed7c2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.422932:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1d00 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.422948:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1d00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.422961:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1d00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.422973:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1d07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.422980:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1d07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.422987:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1d07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.423075:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1d0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.423084:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1d0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.423091:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1d0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521359.423136:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788521359.423141:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788521359.423161:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1d0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.423172:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1d00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.423178:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1d00 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.423185:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1d00 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.423191:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521359.423196:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1d00 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.423203:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1d00 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.423217:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef76505500) 00010000:00010000:1.0:1788521359.423220:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521359.423225:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1d00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.423244:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1d00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.423258:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1d07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.423273:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1d07 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.423280:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1d07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.423284:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aac00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521359.423288:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1d07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.423294:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1d07 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.423302:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8fef76505400) 00010000:00010000:1.0:1788521359.423305:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521359.423308:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1d07 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.423314:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1d07 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.423342:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1cf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7c2 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.423356:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1d0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7c2 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.423364:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:1.0:1788521359.423366:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788521359.423374:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434aba00, rc 0) 00000100:00100000:1.0:1788521359.423601:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+17:12233:x1875400201414016:12345-192.168.203.41@tcp:101:bash.0 Request processed in 805us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521359.423609:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 156 00000100:00100000:0.0:1788521359.435406:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521359.435482:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201414272 00000100:00100000:3.0:1788521359.435491:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201414272 00000100:00100000:3.0:1788521359.435550:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 157 00000100:00100000:3.0:1788521359.435560:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+17:12233:x1875400201414272:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:3.0:1788521359.435580:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521359.435600:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d1d15 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed7c9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.435698:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1d1c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.435820:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1d1c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.435853:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1d1c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.435946:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d1d23 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.435955:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d1d23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.435962:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d1d23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788521359.436790:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788521359.437197:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fdc00/0x411dd0ee4d2d1d2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.437210:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fdc00/0x411dd0ee4d2d1d2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.437219:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fdc00/0x411dd0ee4d2d1d2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.437408:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1d1c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.437417:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1d1c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.437425:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1d1c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.437432:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749ca400 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521359.437452:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1d1c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.437461:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1d1c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.437475:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:3.0:1788521359.437478:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521359.437483:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1d1c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.437490:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca400/0x411dd0ee4d2d1d1c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788521359.437503:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000084c98a80 reply state 00000000dea241a3 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d1d23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.437514:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d1d23 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.437521:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8fef76505000) 00010000:00010000:3.0:1788521359.437523:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788521359.437526:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788521359.437562:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749caa00/0x411dd0ee4d2d1d15 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7c9 expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.437577:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fdc00/0x411dd0ee4d2d1d2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7c9 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.437584:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef76505d00) 00010000:00010000:3.0:1788521359.437587:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521359.437596:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fdc00, rc 0) 00000100:00100000:3.0:1788521359.437720:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+20:12233:x1875400201414272:12345-192.168.203.41@tcp:101:bash.0 Request processed in 2153us (2316us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1788521359.437728:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 157 00000100:00100000:0.0:1788521359.445750:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521359.445843:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201414400 00000100:00100000:1.0:1788521359.445853:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201414400 00000100:00100000:1.0:1788521359.445947:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 55 00000100:00100000:1.0:1788521359.445958:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef50f4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201414400:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:1.0:1788521359.445977:0:8875:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521359.446006:0:8875:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad43823c/0x411dd0ee4d2d1d38 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed7d0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788521359.446034:0:8875:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788521359.446053:0:8875:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=409s v=(0 0) 00010000:00010000:1.0:1788521359.446058:0:8875:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521359.446066:0:8875:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad43823c/0x411dd0ee4d2d1d38 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7d0 expref: 6 pid: 8875 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.446088:0:8875:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ad43823c/0x411dd0ee4d2d1d38 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7d0 expref: 6 pid: 8875 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.446101:0:8875:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434aa800, rc 0) 00000100:00100000:1.0:1788521359.446157:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef50f4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+6:2395:x1875400201414400:12345-192.168.203.41@tcp:101:bash.0 Request processed in 201us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521359.446164:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 55 00000100:00080000:3.0:1788521359.446578:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521359.448946:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521359.449218:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201414528 00000100:00100000:3.0:1788521359.449227:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201414528 00000100:00100000:3.0:1788521359.449291:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 56 00000100:00100000:3.0:1788521359.449301:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43dc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+6:12233:x1875400201414528:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:3.0:1788521359.449318:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521359.449336:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008624e10f/0x411dd0ee4d2d1d3f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed7d7 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.449367:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad43823c/0x411dd0ee4d2d1d38 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7d0 expref: 7 pid: 8875 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.449377:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521359.449380:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521359.449386:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008624e10f/0x411dd0ee4d2d1d3f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7d7 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.449422:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ad43823c/0x411dd0ee4d2d1d38 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7d0 expref: 7 pid: 8875 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.449437:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ad43823c/0x411dd0ee4d2d1d38 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7d0 expref: 7 pid: 8875 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521359.449472:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1875400222460672:192.168.203.41@tcp:104: 00000100:00100000:3.0:1788521359.449576:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef6d98ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521359.454622:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1875400222460672:192.168.203.41@tcp:104: 00010000:00010000:3.0:1788521359.454668:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008624e10f/0x411dd0ee4d2d1d3f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7d7 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.454690:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fcc00, rc 0) 00000100:00100000:0.0:1788521359.457434:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43dc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+7:12233:x1875400201414528:12345-192.168.203.41@tcp:101:bash.0 Request processed in 8123us (8484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521359.457447:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 56 00000100:00100000:0.0:1788521359.458187:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521359.458485:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201414656 00000100:00100000:1.0:1788521359.458501:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201414656 00010000:00010000:1.0:1788521359.458539:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ad43823c/0x411dd0ee4d2d1d38 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7d0 expref: 7 pid: 8875 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521359.458577:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 79 00000100:00100000:1.0:1788521359.458587:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef50f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+7:2396:x1875400201414656:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521359.458601:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521359.458621:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ad43823c/0x411dd0ee4d2d1d38 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7d0 expref: 7 pid: 8875 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.458635:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ad43823c/0x411dd0ee4d2d1d38 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7d0 expref: 7 pid: 8875 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.458657:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad43823c/0x411dd0ee4d2d1d38 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7d0 expref: 7 pid: 8875 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.458673:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521359.458677:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521359.458685:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008624e10f/0x411dd0ee4d2d1d3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7d7 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.458696:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008624e10f/0x411dd0ee4d2d1d3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7d7 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.458802:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008624e10f/0x411dd0ee4d2d1d3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7d7 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521359.458830:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43dca300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6506:1875400222460800:192.168.203.41@tcp:105: 00000100:00100000:1.0:1788521359.458945:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee4241f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788521359.466937:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43dca300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6506:1875400222460800:192.168.203.41@tcp:105: 00010000:00010000:1.0:1788521359.466961:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521359.467018:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef50f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+6:2396:x1875400201414656:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 8432us (8833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521359.467029:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 79 00000100:00100000:1.0:1788521359.471827:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521359.471968:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201414912 00000100:00100000:3.0:1788521359.471979:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201414912 00000100:00100000:3.0:1788521359.472044:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 36 00000100:00100000:3.0:1788521359.472054:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43dca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+20:12233:x1875400201414912:12345-192.168.203.41@tcp:35:bash.0 00000100:00100000:3.0:1788521359.472353:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43dca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+21:12233:x1875400201414912:12345-192.168.203.41@tcp:35:bash.0 Request processed in 299us (534us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788521359.472361:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 36 00010000:00010000:0.0:1788521359.568964:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521359.578990:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521359.579092:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201415168 00000100:00100000:3.0:1788521359.579102:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201415168 00000100:00100000:3.0:1788521359.579164:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 158 00000100:00100000:3.0:1788521359.579175:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef50f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+21:12243:x1875400201415168:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:3.0:1788521359.579200:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521359.579221:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1d46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed7de expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521359.579333:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788521359.579457:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1d46 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7de expref: 23 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.579472:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef76505500) 00010000:00010000:3.0:1788521359.579475:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788521359.579481:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1d46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7de expref: 23 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.579494:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fce00, rc 0) 00000100:00100000:3.0:1788521359.579557:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef50f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+22:12243:x1875400201415168:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 384us (576us total) trans 4294967421 rc 301/301 00000100:00100000:3.0:1788521359.579565:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 158 00000100:00100000:0.0:1788521359.586738:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521359.586818:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201415424 00000100:00100000:3.0:1788521359.586829:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201415424 00000100:00100000:3.0:1788521359.586908:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 37 00000100:00100000:3.0:1788521359.586919:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+22:12243:x1875400201415424:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:3.0:1788521359.587134:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+23:12243:x1875400201415424:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 216us (405us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788521359.587142:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 37 00000100:00100000:1.0:1788521359.684745:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521359.684949:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201415552 00000100:00100000:0.0:1788521359.684960:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201415552 00000100:00100000:0.0:1788521359.685029:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 159 00000100:00100000:0.0:1788521359.685040:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+23:12249:x1875400201415552:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:0.0:1788521359.685063:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521359.685083:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1d54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed7e5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.685277:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1d5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.685396:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1d5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.685419:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1d5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521359.685465:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788521359.685470:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788521359.685612:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1d5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.685644:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1d54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7e5 expref: 25 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.685664:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1d5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7e5 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.685685:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:0.0:1788521359.685688:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788521359.685692:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411c00, rc 0) 00000100:00100000:0.0:1788521359.685801:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+24:12249:x1875400201415552:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 762us (1883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521359.685808:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 159 00000100:00100000:0.0:1788521359.693521:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521359.695044:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201415808 00000100:00100000:3.0:1788521359.695177:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201415808 00000100:00100000:3.0:1788521359.695252:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 160 00000100:00100000:3.0:1788521359.695264:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+24:12249:x1875400201415808:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:3.0:1788521359.695285:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521359.695317:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1d62 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed7ec expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.695589:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fca00/0x411dd0ee4d2d1d69 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.695604:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fca00/0x411dd0ee4d2d1d69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.695618:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fca00/0x411dd0ee4d2d1d69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521359.695631:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788521359.696194:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1d62 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7ec expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.696216:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fca00/0x411dd0ee4d2d1d69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7ec expref: 26 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.696224:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef76505d00) 00010000:00010000:3.0:1788521359.696237:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521359.696241:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fca00, rc 0) 00000100:00100000:3.0:1788521359.696369:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+26:12249:x1875400201415808:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 1105us (2855us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1788521359.696377:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 160 00000100:00100000:2.0:1788521359.700564:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521359.701321:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201416064 00000100:00100000:0.0:1788521359.701332:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201416064 00000100:00100000:0.0:1788521359.701446:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 161 00000100:00100000:0.0:1788521359.701459:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+26:12249:x1875400201416064:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:0.0:1788521359.701485:0:9815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521359.701510:0:9815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1d77 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed7f3 expref: -99 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521359.701513:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00010000:00010000:0.0:1788521359.701635:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1d7e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.701650:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1d7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.701664:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1d7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521359.701677:0:9815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788521359.702031:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1d77 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7f3 expref: 29 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.702085:0:9815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1d7e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7f3 expref: 28 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.702094:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef76505d00) 00010000:00010000:0.0:1788521359.702097:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788521359.702101:0:9815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42410000, rc 0) 00000100:00100000:0.0:1788521359.702174:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+28:12249:x1875400201416064:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 717us (1619us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1788521359.702181:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 161 00000100:00100000:2.0:1788521359.707126:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201416192 00000100:00100000:2.0:1788521359.707150:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201416192 00000100:00100000:2.0:1788521359.707223:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 13 00000100:00100000:2.0:1788521359.707245:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+28:2395:x1875400201416192:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521359.707263:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521359.707288:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fca00/0x411dd0ee4d2d1d69 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7ec expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521359.707308:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef76505d00) 00010000:00010000:2.0:1788521359.707313:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521359.707384:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+27:2395:x1875400201416192:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 142us (5884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521359.707391:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 13 00000100:00100000:3.0:1788521359.729766:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521359.729924:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201416320 00000100:00100000:1.0:1788521359.729942:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201416320 00000100:00100000:1.0:1788521359.730011:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 57 00000100:00100000:1.0:1788521359.730021:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+6:2394:x1875400201416320:12345-192.168.203.41@tcp:1:lfs.0 00010000:00010000:1.0:1788521359.730066:0:8875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d1d8c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.730086:0:8875:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008624e10f/0x411dd0ee4d2d1d3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7d7 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.730095:0:8875:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521359.730100:0:8875:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788521359.730105:0:8875:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d1d8c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.730169:0:8875:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008624e10f/0x411dd0ee4d2d1d3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7d7 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.730184:0:8875:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008624e10f/0x411dd0ee4d2d1d3f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7d7 expref: 6 pid: 8436 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521359.730198:0:8875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43dca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8875:1875400222460928:192.168.203.41@tcp:104: 00000100:00100000:1.0:1788521359.730355:0:8875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee4241f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788521359.736810:0:8875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43dca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8875:1875400222460928:192.168.203.41@tcp:104: 00010000:00010000:1.0:1788521359.736843:0:8875:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d1d8c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521359.744029:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521359.746194:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201416448 00000100:00100000:1.0:1788521359.746208:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201416448 00002000:00100000:1.0:1788521359.746280:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8fee43c6b480 x1875400201416448/t0(0) o4->fc75e887-507e-4861-8203-e266d82f5177@192.168.203.41@tcp:360/0 lens 504/0 e 0 to 0 dl 1788521370 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788521359.746293:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fee43c6b480 with x1875400201416448 ext(0->12) 00010000:00010000:1.0:1788521359.746303:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008624e10f/0x411dd0ee4d2d1d3f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7d7 expref: 7 pid: 8436 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.746322:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008624e10f/0x411dd0ee4d2d1d3f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7d7 expref: 7 pid: 8436 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788521359.746332:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8fee43c6b480 00000100:00100000:1.0:1788521359.746391:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 2 00000100:00100000:1.0:1788521359.746402:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc75e887-507e-4861-8203-e266d82f5177+7:2395:x1875400201416448:12345-192.168.203.41@tcp:4:lfs.0 00000100:00100000:1.0:1788521359.748040:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc75e887-507e-4861-8203-e266d82f5177+9:2395:x1875400201416448:12345-192.168.203.41@tcp:4:lfs.0 Request processed in 1632us (4013us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788521359.748052:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 2 00002000:00100000:1.0:1788521359.748062:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8fee43c6b480 x1875400201416448/t4294967306(0) o4->fc75e887-507e-4861-8203-e266d82f5177@192.168.203.41@tcp:360/0 lens 504/448 e 0 to 0 dl 1788521370 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788521359.748073:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fee43c6b480 with x1875400201416448 ext(0->12) 00010000:00010000:1.0:1788521359.748082:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008624e10f/0x411dd0ee4d2d1d3f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7d7 expref: 9 pid: 8436 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.748099:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008624e10f/0x411dd0ee4d2d1d3f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7d7 expref: 9 pid: 8436 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788521359.748107:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8fee43c6b480 00000100:00100000:0.0:1788521359.756789:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521359.756939:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201416576 00000100:00100000:1.0:1788521359.756962:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201416576 00010000:00010000:1.0:1788521359.757394:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008624e10f/0x411dd0ee4d2d1d3f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7d7 expref: 9 pid: 8436 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521359.757579:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 80 00000100:00100000:1.0:1788521359.757595:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43505c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+9:2396:x1875400201416576:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521359.757617:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788521359.757642:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788521359.757645:0:6506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788521358 00002000:00010000:1.0:1788521359.757666:0:6506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788521359 00002000:00010000:1.0:1788521359.757669:0:6506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788521358 00002000:00010000:1.0:1788521359.757671:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788521359.757680:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008624e10f/0x411dd0ee4d2d1d3f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7d7 expref: 9 pid: 8436 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.757698:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008624e10f/0x411dd0ee4d2d1d3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7d7 expref: 9 pid: 8436 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.757727:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008624e10f/0x411dd0ee4d2d1d3f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7d7 expref: 9 pid: 8436 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.757749:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788521359.757754:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788521359.757761:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d1d8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.757772:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d1d8c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.757814:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521359.757967:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43505c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+8:2396:x1875400201416576:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 376us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521359.757976:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 80 00010000:00010000:0.0:1788521359.758092:0:8875:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d1d8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.758104:0:8875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d1d8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.758131:0:8875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d1d8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.758140:0:8875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d1d8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.758148:0:8875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d1d8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.758169:0:8875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa600 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:0.0:1788521359.758175:0:8875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d1d8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.758186:0:8875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d1d8c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.758198:0:8875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d1d8c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.758207:0:8875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d1d8c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521359.758273:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+8:2394:x1875400201416320:12345-192.168.203.41@tcp:1:lfs.0 Request processed in 28253us (28516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521359.758281:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 57 00000100:00100000:2.0:1788521359.763047:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521359.763164:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201416832 00000100:00100000:3.0:1788521359.763174:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201416832 00000100:00100000:3.0:1788521359.763241:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 38 00000100:00100000:3.0:1788521359.763268:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6d4a9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+27:12249:x1875400201416832:12345-192.168.203.41@tcp:35:lfs.0 00000004:00010000:3.0:1788521359.763334:0:6522:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1d7e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7f3 expref: 27 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788521359.763538:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1788521359.763571:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1788521359.763846:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:3.0:1788521359.763920:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d1d93 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.763935:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fdc00/0x411dd0ee4d2d1d2a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7c9 expref: 31 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.763943:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d1d93 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.763982:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fdc00/0x411dd0ee4d2d1d2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7c9 expref: 31 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.763997:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fdc00/0x411dd0ee4d2d1d2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7c9 expref: 31 pid: 6519 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521359.764010:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43eeb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6522:1875400222461056:192.168.203.41@tcp:104: 00000100:00100000:3.0:1788521359.764096:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef816b7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521359.775435:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521359.775459:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43eeb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6522:1875400222461056:192.168.203.41@tcp:104: 00010000:00010000:2.0:1788521359.775501:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d1d93 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521359.775752:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201416960 00000100:00100000:1.0:1788521359.775763:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201416960 00010000:00010000:1.0:1788521359.775811:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fdc00/0x411dd0ee4d2d1d2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7c9 expref: 32 pid: 6519 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521359.775873:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 81 00000100:00100000:1.0:1788521359.775942:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee437c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+32:2396:x1875400201416960:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521359.775963:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521359.775971:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fdc00/0x411dd0ee4d2d1d2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7c9 expref: 32 pid: 6519 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.775987:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fdc00/0x411dd0ee4d2d1d2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7c9 expref: 32 pid: 6519 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.776020:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fdc00/0x411dd0ee4d2d1d2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7c9 expref: 32 pid: 6519 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.776039:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef76505d00) 00010000:00010000:1.0:1788521359.776045:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d1d93 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.776056:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d1d93 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.776064:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d1d93 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.776090:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521359.776145:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee437c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+31:2396:x1875400201416960:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 263us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521359.776153:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 81 00010000:00010000:2.0:1788521359.777665:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d1d93 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521359.777682:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d1d93 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521359.777839:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:2.0:1788521359.778006:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1788521359.778099:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43df1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1875400222461184:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788521359.778252:0:6522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521359.778297:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4853ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521359.778313:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222461184 00000100:00100000:1.0:1788521359.778341:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222461184 00000100:00100000:1.0:1788521359.778463:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788521359.778474:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1875400222461184:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788521359.778627:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1875400222461184:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 154us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521359.778635:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788521359.779399:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43df1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1875400222461184:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788521359.781535:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:2.0:1788521359.781636:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43df1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1875400222461312:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788521359.781701:0:6522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521359.787480:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4853c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521359.789296:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222461312 00000100:00100000:0.0:1788521359.789318:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222461312 00000100:00100000:3.0:1788521359.789631:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788521359.789655:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1875400222461312:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788521359.789917:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6522:x1875400222461312:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 274us (8215us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788521359.789937:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788521359.791984:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43df1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1875400222461312:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788521359.792204:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1788521359.792273:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d1d93 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.792285:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d1d93 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.792293:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d1d93 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.792299:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef413fc600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521359.792304:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d1d93 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.792311:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d1d93 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.792324:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef76505d00) 00010000:00010000:3.0:1788521359.792327:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788521359.792331:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d1d93 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.792337:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d1d93 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788521359.792523:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788521359.792586:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1788521359.792599:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 409858715157ns, next at 410858712652ns, rc = 0 00000001:00080000:3.0:1788521359.792605:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1788521359.792742:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef76505d00) 00010000:00010000:3.0:1788521359.792759:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788521359.792767:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1d7e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7f3 expref: 35 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521359.792977:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6d4a9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+34:12249:x1875400201416832:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 29711us (29938us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1788521359.792988:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 38 00000020:00080000:3.0:1788521359.792993:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788521359.795869:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521359.796007:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201417088 00000100:00100000:1.0:1788521359.796022:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201417088 00000100:00100000:1.0:1788521359.796105:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 162 00000100:00100000:1.0:1788521359.796116:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee437c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+34:12249:x1875400201417088:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:1.0:1788521359.796150:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521359.796173:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1d9a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed7fa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.796239:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1d9a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7fa expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.796255:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1d9a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7fa expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.796275:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:1.0:1788521359.796279:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788521359.796282:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434aaa00, rc 0) 00000100:00100000:1.0:1788521359.796342:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee437c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+35:12249:x1875400201417088:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 228us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521359.796348:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 162 00000100:00100000:1.0:1788521359.801807:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521359.801927:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201417344 00000100:00100000:2.0:1788521359.802024:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201417344 00000100:00100000:2.0:1788521359.802123:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 39 00000100:00100000:2.0:1788521359.802137:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43dca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+35:12249:x1875400201417344:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:2.0:1788521359.802774:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43dca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+36:12249:x1875400201417344:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 637us (973us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788521359.802784:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 39 00000100:00100000:2.0:1788521359.898462:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521359.900762:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201417600 00000100:00100000:3.0:1788521359.900776:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201417600 00000100:00100000:3.0:1788521359.900844:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 163 00000100:00100000:3.0:1788521359.900854:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+36:12259:x1875400201417600:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:3.0:1788521359.900877:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521359.900927:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d1da1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed801 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521359.901024:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788521359.901125:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d1da1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed801 expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.901141:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef76505500) 00010000:00010000:3.0:1788521359.901147:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788521359.901153:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d1da1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed801 expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521359.901171:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fc600, rc 0) 00000100:00100000:2.0:1788521359.901383:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+37:12259:x1875400201417600:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 529us (2928us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1788521359.901391:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 163 00000100:00100000:1.0:1788521359.915973:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521359.916050:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201417728 00000100:00100000:0.0:1788521359.916067:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201417728 00000100:00100000:0.0:1788521359.916157:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 164 00000100:00100000:0.0:1788521359.916168:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+37:12259:x1875400201417728:12345-192.168.203.41@tcp:34:lfs.0 00010000:00010000:0.0:1788521359.916273:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1daf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.916294:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1daf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.916324:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1daf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.916337:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1db6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.916344:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1db6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.916350:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1db6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.916471:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1dbd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.916481:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1dbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.916489:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1dbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788521359.916546:0:9815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1dbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.916561:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1daf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.916569:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1daf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.916577:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1daf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.916594:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410400 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521359.916600:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1daf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.916609:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1daf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.916624:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:0.0:1788521359.916627:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521359.916633:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1daf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.916639:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1daf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.916655:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1db6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.916661:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1db6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.916666:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1db6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.916671:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521359.916674:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1db6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.916679:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1db6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.916698:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8fef76505000) 00010000:00010000:0.0:1788521359.916700:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521359.916704:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1db6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.916710:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1db6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.916720:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1dbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.916726:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1dbd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.916731:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1dbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.916735:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42411800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521359.916738:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1dbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.916743:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1dbd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.916749:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:0.0:1788521359.916751:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521359.916754:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1dbd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521359.916758:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1dbd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521359.917003:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+37:12259:x1875400201417728:12345-192.168.203.41@tcp:34:lfs.0 Request processed in 834us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521359.917013:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 164 00000100:00100000:1.0:1788521359.923626:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521359.926155:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201417984 00000100:00100000:2.0:1788521359.926176:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201417984 00000100:00100000:2.0:1788521359.926299:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 40 00000100:00100000:2.0:1788521359.926312:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+37:12259:x1875400201417984:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:2.0:1788521359.926860:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+38:12259:x1875400201417984:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 549us (3245us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788521359.926870:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 40 00000100:00100000:3.0:1788521359.979799:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521359.979955:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201418240 00000100:00100000:1.0:1788521359.979975:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201418240 00000100:00100000:1.0:1788521359.980134:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 165 00000100:00100000:1.0:1788521359.980148:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee437c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+38:12262:x1875400201418240:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:1.0:1788521359.980183:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521359.980211:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1dc4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed808 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.980345:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1dcb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.980364:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1dcb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.980380:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1dcb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.980392:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1dd2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.980399:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.980405:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.980560:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1dd9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.980569:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.980592:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521359.980604:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788521359.980711:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1dcb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.980719:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1dcb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.980727:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1dcb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.980733:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa000 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521359.980739:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1dcb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.980760:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1dcb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.980776:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:1.0:1788521359.980779:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521359.980785:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1dcb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.980791:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1dcb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.980807:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.980814:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1dd2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.980826:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.980832:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa200 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521359.980834:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.980841:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1dd2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.980849:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8fef76505000) 00010000:00010000:1.0:1788521359.980851:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521359.980854:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1dd2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.980859:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1dd2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.980996:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1dc4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed808 expref: 41 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.981014:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed808 expref: 40 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521359.981021:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:1.0:1788521359.981023:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521359.981026:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434abe00, rc 0) 00000100:00100000:1.0:1788521359.981121:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee437c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+40:12262:x1875400201418240:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 975us (1331us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788521359.981138:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 165 00000100:00100000:3.0:1788521359.995246:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521359.995458:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201418368 00000100:00100000:2.0:1788521359.995468:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201418368 00000100:00100000:2.0:1788521359.995530:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 166 00000100:00100000:2.0:1788521359.995540:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef767d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+40:12262:x1875400201418368:12345-192.168.203.41@tcp:54:lfs.0 00010000:00010000:2.0:1788521359.995612:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1de7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521359.995629:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1de7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521359.995640:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1de7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521359.995672:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1de7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521359.995678:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1de7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521359.995684:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1de7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521359.995689:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521359.995693:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1de7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521359.995717:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1de7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521359.995729:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:2.0:1788521359.995732:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521359.995737:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1de7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521359.995743:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1de7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521359.995812:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef767d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+40:12262:x1875400201418368:12345-192.168.203.41@tcp:54:lfs.0 Request processed in 273us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521359.995819:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 166 00000100:00100000:2.0:1788521360.000021:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521360.000371:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201418624 00000100:00100000:0.0:1788521360.000381:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201418624 00000100:00100000:0.0:1788521360.001439:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 41 00000100:00100000:0.0:1788521360.001454:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+40:12262:x1875400201418624:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:0.0:1788521360.001760:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+41:12262:x1875400201418624:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 310us (1747us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788521360.001767:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 41 00000100:00100000:3.0:1788521360.362160:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521360.362592:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201418880 00000100:00100000:2.0:1788521360.362607:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201418880 00000100:00100000:2.0:1788521360.362693:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 167 00000100:00100000:2.0:1788521360.362703:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+41:12293:x1875400201418880:12345-192.168.203.41@tcp:101:cat.0 00010000:00010000:2.0:1788521360.362726:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521360.362746:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1dee lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed80f expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521360.362851:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1df5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521360.362866:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1df5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521360.362940:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1df5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521360.362952:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788521360.363058:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1dee lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed80f expref: 44 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521360.363075:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1df5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed80f expref: 43 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521360.363083:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:2.0:1788521360.363086:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521360.363089:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7200, rc 0) 00000100:00100000:2.0:1788521360.363157:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+43:12293:x1875400201418880:12345-192.168.203.41@tcp:101:cat.0 Request processed in 456us (1012us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788521360.363164:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 167 00000100:00100000:0.0:1788521360.368256:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521360.368301:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521360.368484:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201419264 00000100:00100000:1.0:1788521360.368497:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201419264 00000100:00100000:1.0:1788521360.368588:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 14 00000100:00100000:1.0:1788521360.368601:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43504380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+43:2395:x1875400201419264:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521360.368622:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521360.368655:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1df5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed80f expref: 43 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.368680:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:1.0:1788521360.368686:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521360.368757:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43504380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+42:2395:x1875400201419264:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 158us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521360.368766:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 14 00000100:00100000:2.0:1788521360.369416:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201419136 00000100:00100000:2.0:1788521360.369431:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201419136 00000100:00100000:2.0:1788521360.369516:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 42 00000100:00100000:2.0:1788521360.369528:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+42:12293:x1875400201419136:12345-192.168.203.41@tcp:35:cat.0 00000100:00100000:2.0:1788521360.369806:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+43:12293:x1875400201419136:12345-192.168.203.41@tcp:35:cat.0 Request processed in 280us (1565us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1788521360.369813:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 42 00000100:00100000:0.0:1788521360.458815:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521360.458906:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201419520 00000100:00100000:1.0:1788521360.458916:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201419520 00000100:00100000:1.0:1788521360.458965:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 168 00000100:00100000:1.0:1788521360.458973:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+43:12299:x1875400201419520:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:1.0:1788521360.458994:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521360.458996:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788521360.459018:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1d5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7e5 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.459033:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:1.0:1788521360.459036:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788521360.459047:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1e03 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed816 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.459149:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1e0a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.459163:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1dd9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed808 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.459172:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1e0a lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.459202:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed808 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.459216:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1dd9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed808 expref: 43 pid: 6520 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521360.459238:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43dcb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1875400222461440:192.168.203.41@tcp:104: 00000100:00100000:1.0:1788521360.459342:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee4241fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521360.468868:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521360.469083:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201419648 00000100:00100000:3.0:1788521360.469091:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201419648 00010000:00010000:3.0:1788521360.469121:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1dd9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed808 expref: 44 pid: 6520 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521360.469159:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 82 00000100:00100000:3.0:1788521360.469168:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4e7e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+44:2395:x1875400201419648:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521360.469183:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521360.469189:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1dd9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed808 expref: 44 pid: 6520 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521360.469203:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1dd9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed808 expref: 44 pid: 6520 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521360.469234:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:3.0:1788521360.469239:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1e0a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521360.469249:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1e0a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521360.469261:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1e0a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521360.469290:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521360.469357:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4e7e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+44:2395:x1875400201419648:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 189us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521360.469381:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 82 00010000:00010000:1.0:1788521360.470506:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1dd9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed808 expref: 43 pid: 6520 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521360.470528:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43dcb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1875400222461440:192.168.203.41@tcp:104: 00010000:00010000:1.0:1788521360.470764:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1e0a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.470775:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1e0a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.470800:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1e0a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521360.470820:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788521360.470974:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1e03 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed816 expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.470990:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1e0a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed816 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.470999:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:1.0:1788521360.471001:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788521360.471004:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434aa000, rc 0) 00000100:00100000:1.0:1788521360.471062:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+43:12299:x1875400201419520:12345-192.168.203.41@tcp:101:dd.0 Request processed in 12088us (12253us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1788521360.471070:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 168 00000100:00100000:0.0:1788521360.474970:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521360.475134:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201419776 00000100:00100000:2.0:1788521360.475144:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201419776 00000100:00100000:2.0:1788521360.475194:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 169 00000100:00100000:2.0:1788521360.475218:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+43:12299:x1875400201419776:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:2.0:1788521360.475251:0:9815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521360.475270:0:9815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1e18 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed81d expref: -99 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521360.475315:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1e1f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521360.475330:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1e1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521360.475342:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1e1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521360.475466:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1e18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed81d expref: 45 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521360.475483:0:9815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1e1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed81d expref: 44 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521360.475492:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:2.0:1788521360.475495:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788521360.475498:0:9815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7000, rc 0) 00000100:00100000:2.0:1788521360.475863:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+44:12299:x1875400201419776:12345-192.168.203.41@tcp:101:dd.0 Request processed in 645us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521360.475870:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 169 00000100:00100000:3.0:1788521360.482328:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521360.482460:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201420032 00000100:00100000:1.0:1788521360.482472:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201420032 00000100:00100000:1.0:1788521360.482557:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 170 00000100:00100000:1.0:1788521360.482576:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+44:12299:x1875400201420032:12345-192.168.203.41@tcp:36:dd.0 00010000:00010000:1.0:1788521360.482875:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1e26 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.482936:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1e26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.482951:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1e26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788521360.483028:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:1.0:1788521360.483053:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b668ca9 reply state 0000000072610990 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1e26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.483068:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1e26 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.483077:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:1.0:1788521360.483080:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788521360.483084:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788521360.483200:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+47:12299:x1875400201420032:12345-192.168.203.41@tcp:36:dd.0 Request processed in 627us (885us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1788521360.483209:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 170 00000020:00080000:1.0:1788521360.483216:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788521360.593620:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521360.766694:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521360.767345:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201420160 00000100:00100000:0.0:1788521360.767361:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201420160 00000100:00100000:0.0:1788521360.767445:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 171 00000100:00100000:0.0:1788521360.767457:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43dcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+47:12313:x1875400201420160:12345-192.168.203.41@tcp:101:stat.0 00010000:00010000:0.0:1788521360.767483:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521360.767506:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1e2d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed824 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521360.767573:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1e34 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521360.767604:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1e34 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521360.767616:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1e34 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521360.767629:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1e3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521360.767636:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1e3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521360.767643:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1e3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521360.767710:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1e42 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521360.767720:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1e0a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed816 expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521360.767729:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1e42 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521360.767761:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1e0a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed816 expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521360.767775:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1e0a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed816 expref: 48 pid: 6520 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521360.767799:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43505c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1875400222461568:192.168.203.41@tcp:104: 00000100:00100000:0.0:1788521360.767942:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef5240fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788521360.772060:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521360.772333:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201420416 00000100:00100000:3.0:1788521360.772351:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201420416 00000100:00100000:3.0:1788521360.772434:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 43 00000100:00100000:3.0:1788521360.772449:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+49:9947:x1875400201420416:12345-192.168.203.41@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788521360.773079:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+50:9947:x1875400201420416:12345-192.168.203.41@tcp:35:ldlm_bl.0 Request processed in 630us (1024us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788521360.773088:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 43 00000100:00100000:1.0:1788521360.774772:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43505c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1875400222461568:192.168.203.41@tcp:104: 00010000:00010000:1.0:1788521360.774811:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1e42 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521360.778841:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521360.779352:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201420544 00000100:00100000:2.0:1788521360.779374:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201420544 00010000:00010000:2.0:1788521360.779429:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1e0a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed816 expref: 50 pid: 6520 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521360.779501:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 83 00000100:00100000:2.0:1788521360.779513:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+50:2395:x1875400201420544:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521360.779534:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521360.779543:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1e0a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed816 expref: 50 pid: 6520 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521360.779558:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1e0a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed816 expref: 50 pid: 6520 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521360.779584:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1e0a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed816 expref: 50 pid: 6520 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521360.779613:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:2.0:1788521360.779620:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1e42 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521360.779631:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1e42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521360.779639:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1e42 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521360.779678:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521360.779753:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+49:2395:x1875400201420544:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 242us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521360.779760:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 83 00010000:00010000:1.0:1788521360.780052:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1e42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.780062:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1e42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521360.780134:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788521360.780140:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788521360.780167:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1e42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.780199:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1e42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.780213:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1e34 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.780229:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1e34 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.780237:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1e34 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.780243:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521360.780249:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1e34 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.780258:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1e34 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.780270:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:1.0:1788521360.780273:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521360.780276:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1e34 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.780292:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1e34 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.780306:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1e3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.780312:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1e3b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.780325:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1e3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.780330:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42411800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521360.780332:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1e3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.780338:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1e3b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.780347:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8fef76505000) 00010000:00010000:1.0:1788521360.780349:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521360.780352:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1e3b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.780357:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1e3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.780410:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1e2d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed824 expref: 49 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.780427:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1e42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed824 expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521360.780434:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:1.0:1788521360.780436:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521360.780439:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42410000, rc 0) 00000100:00100000:1.0:1788521360.780489:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43dcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+48:12313:x1875400201420160:12345-192.168.203.41@tcp:101:stat.0 Request processed in 13035us (13809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521360.780506:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 171 00000100:00100000:3.0:1788521360.861186:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521360.862374:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201420800 00000100:00100000:0.0:1788521360.862396:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201420800 00000100:00100000:0.0:1788521360.862502:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 172 00000100:00100000:0.0:1788521360.862522:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+48:12319:x1875400201420800:12345-192.168.203.41@tcp:36:truncate.0 00010000:00010000:0.0:1788521360.862626:0:12956:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521360.862667:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1e42 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed824 expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521360.862701:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:0.0:1788521360.862708:0:12956:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521360.864121:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1e49 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521360.864160:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1e49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521360.864181:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1e49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788521360.864269:0:12956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1788521360.864292:0:12956:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f096323 reply state 00000000e0700e99 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1e49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521360.864305:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1e49 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521360.864332:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:0.0:1788521360.864335:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788521360.864340:0:12956:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788521360.864488:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+50:12319:x1875400201420800:12345-192.168.203.41@tcp:36:truncate.0 Request processed in 1970us (3313us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1788521360.864495:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 172 00000020:00080000:0.0:1788521360.864501:0:12956:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788521361.009988:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521361.010100:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201420928 00000100:00100000:1.0:1788521361.010114:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201420928 00000100:00100000:1.0:1788521361.010206:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 173 00000100:00100000:1.0:1788521361.010228:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+50:12333:x1875400201420928:12345-192.168.203.41@tcp:101:stat.0 00010000:00010000:1.0:1788521361.010260:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521361.010289:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1e50 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed82b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.010378:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1e57 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.010397:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1e57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.010413:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1e57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.010425:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1e5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.010433:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1e5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.010439:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1e5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.010531:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1e65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.010562:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1e65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.010569:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1e65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521361.011067:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1788521361.011073:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788521361.011102:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1e65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.011119:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1e65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.011129:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1e57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.011136:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1e57 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.011143:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1e57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.011150:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521361.011155:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1e57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.011163:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1e57 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.011178:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:1.0:1788521361.011193:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521361.011199:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1e57 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.011207:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1e57 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.011235:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1e5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.011242:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1e5e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.011248:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1e5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.011253:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa200 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521361.011256:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1e5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.011262:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1e5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.011269:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8fef76505000) 00010000:00010000:1.0:1788521361.011272:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521361.011274:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1e5e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.011279:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1e5e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.011314:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1e50 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed82b expref: 52 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.011344:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1e65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed82b expref: 51 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.011352:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:1.0:1788521361.011354:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521361.011356:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434aa000, rc 0) 00000100:00100000:1.0:1788521361.011453:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+51:12333:x1875400201420928:12345-192.168.203.41@tcp:101:stat.0 Request processed in 1236us (1479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521361.011462:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 173 00000100:00080000:3.0:1788521361.011581:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521361.091314:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521361.091438:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201421184 00000100:00100000:0.0:1788521361.091452:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201421184 00000100:00100000:0.0:1788521361.091530:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 174 00000100:00100000:0.0:1788521361.091551:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43dcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+51:12344:x1875400201421184:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:0.0:1788521361.091580:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521361.091677:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1e6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed832 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521361.091808:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788521361.092096:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1e6c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed832 expref: 53 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521361.092114:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef76505500) 00010000:00010000:0.0:1788521361.092117:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788521361.092124:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1e6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed832 expref: 53 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521361.092143:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42410000, rc 0) 00000100:00100000:0.0:1788521361.092232:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43dcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+52:12344:x1875400201421184:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 692us (934us total) trans 4294967447 rc 301/301 00000100:00100000:0.0:1788521361.092257:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 174 00000100:00100000:0.0:1788521361.095701:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521361.095861:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201421440 00000100:00100000:1.0:1788521361.095874:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201421440 00000100:00100000:1.0:1788521361.096003:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 44 00000100:00100000:1.0:1788521361.096014:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6d4aac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+52:12344:x1875400201421440:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:1.0:1788521361.096306:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6d4aac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+53:12344:x1875400201421440:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 293us (617us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1788521361.096315:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 44 00000100:00100000:1.0:1788521361.161810:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521361.161923:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201421696 00000100:00100000:0.0:1788521361.161936:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201421696 00000100:00100000:0.0:1788521361.162024:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 175 00000100:00100000:0.0:1788521361.162037:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43dca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+53:12350:x1875400201421696:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:0.0:1788521361.162071:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521361.162098:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1e7a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed839 expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521361.162251:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1e81 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521361.162271:0:12956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1e65 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed82b expref: 54 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521361.162282:0:12956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1e81 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521361.162324:0:12956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1e65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed82b expref: 54 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521361.162340:0:12956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1e65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed82b expref: 54 pid: 6521 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521361.162356:0:12956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43506300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12956:1875400222461696:192.168.203.41@tcp:104: 00000100:00100000:0.0:1788521361.162500:0:12956:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef5240f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521361.169525:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521361.169666:0:12956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43506300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12956:1875400222461696:192.168.203.41@tcp:104: 00010000:00010000:2.0:1788521361.169721:0:12956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1e81 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521361.170837:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201421824 00000100:00100000:1.0:1788521361.170852:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201421824 00010000:00010000:2.0:1788521361.171156:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1e65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed82b expref: 55 pid: 6521 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521361.171255:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 84 00000100:00100000:2.0:1788521361.171267:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43504380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+55:2395:x1875400201421824:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521361.171288:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521361.171296:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1e65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed82b expref: 55 pid: 6521 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521361.171312:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1e65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed82b expref: 55 pid: 6521 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521361.171342:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1e65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed82b expref: 55 pid: 6521 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521361.171362:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:2.0:1788521361.171368:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1e81 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521361.171381:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1e81 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521361.171389:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1e81 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521361.171548:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521361.171787:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43504380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+54:2395:x1875400201421824:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 521us (2274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521361.171797:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 84 00010000:00010000:0.0:1788521361.171855:0:12956:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1e81 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521361.171865:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1e81 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521361.171907:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788521361.172083:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1e7a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed839 expref: 55 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521361.172103:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1e81 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed839 expref: 54 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521361.172112:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:0.0:1788521361.172115:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788521361.172117:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411800, rc 0) 00000100:00100000:0.0:1788521361.172147:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43dca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+54:12350:x1875400201421696:12345-192.168.203.41@tcp:101:bash.0 Request processed in 10113us (10351us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1788521361.172154:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 175 00000100:00100000:0.0:1788521361.181817:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521361.182106:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201422080 00000100:00100000:1.0:1788521361.182119:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201422080 00000100:00100000:0.0:1788521361.182301:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 176 00000100:00100000:0.0:1788521361.182314:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+54:12350:x1875400201422080:12345-192.168.203.41@tcp:36:bash.0 00010000:00010000:0.0:1788521361.183080:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1e8f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521361.183105:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1e8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521361.183143:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1e8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788521361.183197:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1788521361.183232:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9ab9492 reply state 000000002a2341c0 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1e8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521361.183247:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1e8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521361.183256:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:0.0:1788521361.183259:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788521361.183264:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788521361.183495:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+57:12350:x1875400201422080:12345-192.168.203.41@tcp:36:bash.0 Request processed in 1181us (1694us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1788521361.183506:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 176 00000020:00080000:0.0:1788521361.183513:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788521361.192106:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521361.192495:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201422208 00000100:00100000:2.0:1788521361.192508:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201422208 00000100:00100000:2.0:1788521361.192608:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 177 00000100:00100000:2.0:1788521361.192621:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+57:12350:x1875400201422208:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:2.0:1788521361.192654:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521361.192685:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1e96 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed840 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521361.192826:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1e9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521361.192846:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1e81 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed839 expref: 58 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521361.192856:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1e9d lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521361.192939:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1e81 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed839 expref: 58 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521361.192955:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1e81 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed839 expref: 58 pid: 12956 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521361.192972:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43df2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1875400222461824:192.168.203.41@tcp:104: 00000100:00100000:2.0:1788521361.193095:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4853c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788521361.196682:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521361.196859:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43df2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1875400222461824:192.168.203.41@tcp:104: 00010000:00010000:1.0:1788521361.196935:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1e9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521361.197422:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201422336 00000100:00100000:3.0:1788521361.197432:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201422336 00010000:00010000:3.0:1788521361.197484:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1e81 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed839 expref: 59 pid: 12956 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521361.197528:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 85 00000100:00100000:3.0:1788521361.197539:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+59:2396:x1875400201422336:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521361.197559:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521361.197567:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1e81 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed839 expref: 59 pid: 12956 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521361.197582:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1e81 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed839 expref: 59 pid: 12956 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521361.197635:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d1e81 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed839 expref: 59 pid: 12956 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521361.197655:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:3.0:1788521361.197661:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1e9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521361.197673:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1e9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521361.197682:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1e9d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521361.197716:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521361.197793:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+58:2396:x1875400201422336:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 256us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521361.197805:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 85 00010000:00010000:1.0:1788521361.198284:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1e9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.198294:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1e9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521361.198362:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788521361.198367:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788521361.198392:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1e9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.198431:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1e96 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed840 expref: 58 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.198450:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1e9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed840 expref: 57 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.198458:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:1.0:1788521361.198461:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521361.198464:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7800, rc 0) 00000100:00100000:1.0:1788521361.198510:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+57:12350:x1875400201422208:12345-192.168.203.41@tcp:101:bash.0 Request processed in 5892us (6419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521361.198518:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 177 00000100:00100000:2.0:1788521361.202453:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521361.202764:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201422592 00000100:00100000:1.0:1788521361.202779:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201422592 00000100:00100000:1.0:1788521361.202935:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 45 00000100:00100000:1.0:1788521361.202949:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58341180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+57:12350:x1875400201422592:12345-192.168.203.41@tcp:35:bash.0 00000100:00100000:1.0:1788521361.203401:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58341180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+58:12350:x1875400201422592:12345-192.168.203.41@tcp:35:bash.0 Request processed in 454us (962us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1788521361.203430:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 45 00000100:00100000:3.0:1788521361.296088:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521361.296297:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201422848 00000100:00100000:0.0:1788521361.296312:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201422848 00000100:00100000:0.0:1788521361.296393:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 178 00000100:00100000:0.0:1788521361.296405:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+58:12360:x1875400201422848:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:0.0:1788521361.296440:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521361.296468:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1ea4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed847 expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521361.296740:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788521361.296874:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1ea4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed847 expref: 60 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521361.296960:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef76505500) 00010000:00010000:0.0:1788521361.296963:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788521361.296971:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1ea4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed847 expref: 60 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521361.297051:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411e00, rc 0) 00000100:00100000:0.0:1788521361.297201:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+59:12360:x1875400201422848:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 797us (1134us total) trans 4294967453 rc 301/301 00000100:00100000:0.0:1788521361.297209:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 178 00000100:00100000:0.0:1788521361.302099:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521361.302209:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201422976 00000100:00100000:1.0:1788521361.302230:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201422976 00000100:00100000:1.0:1788521361.302305:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 179 00000100:00100000:1.0:1788521361.302318:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+59:12360:x1875400201422976:12345-192.168.203.41@tcp:34:lfs.0 00010000:00010000:1.0:1788521361.302427:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1eb2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.302449:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1eb2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.302463:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1eb2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.302474:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1eb9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.302481:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.302487:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.302599:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1ec0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.302618:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.302626:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788521361.302707:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.302724:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1eb2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.302732:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1eb2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.302739:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1eb2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.302745:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521361.302751:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1eb2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.302759:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1eb2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.302774:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:1.0:1788521361.302778:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521361.302784:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1eb2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.302791:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1eb2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.302809:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.302815:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1eb9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.302828:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1eb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.302834:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521361.302838:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1eb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.302844:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1eb9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.302853:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8fef76505000) 00010000:00010000:1.0:1788521361.302856:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521361.302859:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1eb9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.302866:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1eb9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.302876:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.302940:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1ec0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.302947:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1ec0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.302951:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434ab600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521361.302954:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1ec0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.302970:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1ec0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.302979:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:1.0:1788521361.302982:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521361.302985:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1ec0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.302991:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1ec0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521361.303089:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+59:12360:x1875400201422976:12345-192.168.203.41@tcp:34:lfs.0 Request processed in 772us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521361.303099:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 179 00000100:00100000:2.0:1788521361.307229:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521361.307681:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201423232 00000100:00100000:3.0:1788521361.307694:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201423232 00000100:00100000:3.0:1788521361.308916:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 46 00000100:00100000:3.0:1788521361.308941:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58342d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+59:12360:x1875400201423232:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:3.0:1788521361.309260:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58342d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+60:12360:x1875400201423232:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 331us (2055us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788521361.309269:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 46 00000100:00100000:2.0:1788521361.360973:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521361.361196:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201423488 00000100:00100000:1.0:1788521361.361209:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201423488 00000100:00100000:1.0:1788521361.361298:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 180 00000100:00100000:1.0:1788521361.361309:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+60:12363:x1875400201423488:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:1.0:1788521361.361339:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521361.361367:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1ec7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed84e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.361467:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1ece lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.361486:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1ece lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.361500:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1ece lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.361532:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1ed5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.361551:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.361559:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.361699:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1edc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.361709:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1edc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.361716:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1edc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521361.361728:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788521361.361829:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1ece lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.361838:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1ece lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.361846:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1ece lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.361852:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521361.361857:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1ece lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.361876:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1ece lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.361932:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:1.0:1788521361.361945:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521361.361952:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1ece lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.361960:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1ece lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.361977:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.361991:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1ed5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.361996:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.362001:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521361.362003:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.362008:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1ed5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.362014:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8fef76505000) 00010000:00010000:1.0:1788521361.362016:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521361.362019:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1ed5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.362034:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1ed5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.362078:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1ec7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed84e expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.362092:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1edc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed84e expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.362101:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:1.0:1788521361.362103:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521361.362106:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434aa000, rc 0) 00000100:00100000:1.0:1788521361.362175:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+62:12363:x1875400201423488:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 868us (1218us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788521361.362182:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 180 00000100:00100000:0.0:1788521361.372576:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521361.373037:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201423616 00000100:00100000:1.0:1788521361.373051:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201423616 00000100:00100000:1.0:1788521361.373130:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 181 00000100:00100000:1.0:1788521361.373142:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee435ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+62:12363:x1875400201423616:12345-192.168.203.41@tcp:54:lfs.0 00010000:00010000:1.0:1788521361.373241:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1eea lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.373264:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1eea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.373281:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1eea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.373352:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1eea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.373360:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1eea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.373368:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1eea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.373374:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434ab600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521361.373379:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1eea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.373387:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1eea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.373402:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:1.0:1788521361.373406:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788521361.373412:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1eea lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.373419:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1eea lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521361.373520:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee435ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+62:12363:x1875400201423616:12345-192.168.203.41@tcp:54:lfs.0 Request processed in 379us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521361.373528:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 181 00000100:00100000:2.0:1788521361.375920:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521361.376080:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201423872 00000100:00100000:3.0:1788521361.376092:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201423872 00000100:00100000:3.0:1788521361.376164:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 47 00000100:00100000:3.0:1788521361.376174:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58340380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+62:12363:x1875400201423872:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:3.0:1788521361.376441:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58340380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+63:12363:x1875400201423872:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 267us (557us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788521361.376449:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 47 00000100:00100000:2.0:1788521361.381958:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521361.382119:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201424000 00000100:00100000:0.0:1788521361.382131:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201424000 00000100:00100000:0.0:1788521361.382210:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 15 00000100:00100000:0.0:1788521361.382231:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fcb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+63:2396:x1875400201424000:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521361.382252:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521361.382285:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1edc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed84e expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521361.382307:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:0.0:1788521361.382314:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521361.382387:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fcb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+62:2396:x1875400201424000:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 161us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521361.382395:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 15 00000100:00100000:0.0:1788521361.509865:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521361.510006:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521361.510028:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521361.510065:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521361.510098:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201424128 00000100:00100000:0.0:1788521361.510109:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201424128 00000100:00100000:0.0:1788521361.510171:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 393 00000100:00100000:0.0:1788521361.510183:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2394:x1875400201424128:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521361.510278:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2394:x1875400201424128:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 96us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521361.510286:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 393 00000100:00100000:2.0:1788521361.510325:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201424256 00000100:00100000:2.0:1788521361.510330:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201424256 00000100:00100000:0.0:1788521361.510344:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521361.510367:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201424512 00000100:00100000:0.0:1788521361.510371:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201424512 00000100:00100000:2.0:1788521361.510376:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201424768 00000100:00100000:2.0:1788521361.510379:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201424768 00000100:00100000:0.0:1788521361.510396:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201424384 00000100:00100000:2.0:1788521361.510397:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 342 00000100:00100000:0.0:1788521361.510398:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201424384 00000100:00100000:2.0:1788521361.510403:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef81499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+5:2394:x1875400201424256:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521361.510418:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 145 00000100:00100000:0.0:1788521361.510424:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef8149a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+6:2394:x1875400201424512:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521361.510439:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef81499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+5:2394:x1875400201424256:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 37us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521361.510445:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef8149a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+6:2394:x1875400201424512:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 22us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521361.510446:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 342 00000100:00100000:0.0:1788521361.510451:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 145 00000100:00100000:2.0:1788521361.510460:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 343 00000100:00100000:0.0:1788521361.510460:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 146 00000100:00100000:2.0:1788521361.510466:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef8149aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2394:x1875400201424768:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521361.510466:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58370380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+7:2394:x1875400201424384:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521361.510487:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58370380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+7:2394:x1875400201424384:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 22us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521361.510489:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef8149aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2394:x1875400201424768:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 24us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521361.510493:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 146 00000100:00100000:2.0:1788521361.510495:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 343 00000100:00080000:2.0:1788521361.510510:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788521361.510515:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521361.510517:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788521361.510587:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521361.510607:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201424640 00000100:00100000:2.0:1788521361.510611:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201424640 00000100:00080000:2.0:1788521361.510628:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521361.510648:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 344 00000100:00100000:2.0:1788521361.510664:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2394:x1875400201424640:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521361.510694:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2394:x1875400201424640:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 31us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521361.510700:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 344 00000100:00100000:2.0:1788521361.517729:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521361.517970:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201425024 00000100:00100000:0.0:1788521361.518007:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201425024 00000100:00100000:0.0:1788521361.518293:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 182 00000100:00100000:0.0:1788521361.518307:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+62:12381:x1875400201425024:12345-192.168.203.41@tcp:101:cat.0 00010000:00010000:0.0:1788521361.518339:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521361.518368:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1ef1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed855 expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521361.518544:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1ef8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521361.518562:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1ef8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521361.518576:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1ef8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521361.518589:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788521361.518722:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1ef1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed855 expref: 65 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521361.518745:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1ef8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed855 expref: 64 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521361.518754:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:0.0:1788521361.518757:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788521361.518761:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42410400, rc 0) 00000100:00100000:0.0:1788521361.519138:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+64:12381:x1875400201425024:12345-192.168.203.41@tcp:101:cat.0 Request processed in 834us (1422us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1788521361.519147:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 182 00000100:00100000:0.0:1788521361.546143:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521361.546245:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201425152 00000100:00100000:2.0:1788521361.546259:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201425152 00000100:00100000:2.0:1788521361.546338:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 183 00000100:00100000:2.0:1788521361.546351:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+64:12382:x1875400201425152:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:2.0:1788521361.546391:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521361.546418:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1f06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed85c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521361.546507:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1f0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521361.546525:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1f0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521361.546539:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1f0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521361.546606:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788521361.546617:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788521361.546641:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1f0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521361.546671:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1f06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed85c expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521361.546718:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1f0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed85c expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521361.546729:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:2.0:1788521361.546732:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788521361.546737:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7200, rc 0) 00000100:00100000:2.0:1788521361.546816:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+65:12382:x1875400201425152:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 468us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521361.546824:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 183 00000100:00100000:2.0:1788521361.549260:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43dca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222461952:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788521361.549355:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521361.549777:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222461952 00000100:00100000:1.0:1788521361.549789:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222461952 00000100:00100000:1.0:1788521361.549857:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788521361.549918:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222461952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788521361.550099:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788521361.550210:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222461952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 295us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521361.550226:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788521361.551110:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222462080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521361.551171:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521361.551293:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222462080 00000100:00100000:0.0:1788521361.551302:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222462080 00000100:00100000:0.0:1788521361.551363:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788521361.551373:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222462080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788521361.551400:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788521361.551442:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222462080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521361.551448:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788521361.551791:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222462080:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788521361.551818:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788521361.552738:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521361.552837:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201425536 00000100:00100000:0.0:1788521361.552847:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201425536 00000100:00100000:0.0:1788521361.552932:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 48 00000100:00100000:0.0:1788521361.552943:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+65:12382:x1875400201425536:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:0.0:1788521361.553341:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+66:12382:x1875400201425536:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 399us (608us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1788521361.553348:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 48 00000100:00100000:1.0:1788521361.553468:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43dc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222462208:0@lo:400:kworker.0 00000100:00100000:0.0:1788521361.553502:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43dc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222462592:0@lo:400:kworker.0 00000100:00100000:1.0:1788521361.553523:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521361.553533:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521361.553556:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43dcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875400222462720:0@lo:400:kworker.0 00000100:00100000:0.0:1788521361.553556:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222463104:0@lo:400:kworker.0 00000100:00100000:0.0:1788521361.553581:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521361.553582:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521361.553617:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222463104 00000100:00100000:1.0:1788521361.553620:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f075180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875400222463232:0@lo:400:kworker.0 00000100:00100000:0.0:1788521361.553621:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222463104 00000100:00100000:1.0:1788521361.553644:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521361.553679:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43dc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222462336:0@lo:400:kworker.0 00000100:00100000:1.0:1788521361.553704:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521361.553722:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222462848:0@lo:400:kworker.0 00000100:00100000:1.0:1788521361.553740:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521361.553756:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4358ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875400222463360:0@lo:400:kworker.0 00000100:00100000:1.0:1788521361.553776:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521361.553793:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788521361.553798:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43dc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875400222462464:0@lo:400:kworker.0 00000100:00100000:1.0:1788521361.553820:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521361.553830:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222462976:0@lo:400:kworker.0 00000100:00100000:1.0:1788521361.553849:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521361.553878:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4358f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222463488:0@lo:400:kworker.0 00000100:00100000:1.0:1788521361.553922:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521361.554211:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222462976 00000100:00100000:0.0:1788521361.554394:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222463488 00000100:00100000:0.0:1788521361.554400:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222463488 00000100:00100000:0.0:1788521361.554423:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788521361.554431:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1875400222463104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521361.554452:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222462976 00000100:00100000:1.0:1788521361.554475:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788521361.554488:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1875400222463104:12345-0@lo:400:kworker.0 Request processed in 58us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521361.554503:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788521361.554519:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788521361.554524:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222462976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521361.554559:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222462976:12345-0@lo:400:kworker.0 Request processed in 35us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521361.554566:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788521361.554616:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222463104:0@lo:400:kworker.0 00000100:00100000:0.0:1788521361.554651:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222462976:0@lo:400:kworker.0 00000100:00100000:0.0:1788521361.554711:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222462720 00000100:00100000:0.0:1788521361.554715:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222462720 00000100:00100000:0.0:1788521361.554740:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222463232 00000100:00100000:0.0:1788521361.554743:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222463232 00000100:00100000:0.0:1788521361.554755:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222462336 00000100:00100000:0.0:1788521361.554757:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222462336 00000100:00100000:0.0:1788521361.554767:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222462848 00000100:00100000:0.0:1788521361.554770:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222462848 00000100:00100000:0.0:1788521361.554782:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222463360 00000100:00100000:0.0:1788521361.554784:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222463360 00000100:00100000:0.0:1788521361.554794:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222462464 00000100:00100000:0.0:1788521361.554797:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222462464 00000100:00100000:0.0:1788521361.554811:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1788521361.554817:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6e4bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875400222462720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521361.554858:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6e4bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875400222462720:12345-0@lo:400:kworker.0 Request processed in 42us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521361.554865:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1788521361.554877:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1788521361.554900:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6e4bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875400222463232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521361.554940:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6e4bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875400222463232:12345-0@lo:400:kworker.0 Request processed in 58us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521361.554946:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1788521361.554958:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1788521361.554963:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6e4bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222462336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521361.555005:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6e4bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222462336:12345-0@lo:400:kworker.0 Request processed in 42us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521361.555011:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1788521361.555022:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788521361.555028:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6e4be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222462848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521361.555056:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6e4be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222462848:12345-0@lo:400:kworker.0 Request processed in 29us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521361.555061:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788521361.555088:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788521361.555089:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222463488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521361.555094:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4351b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875400222463360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521361.555122:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222463488:12345-0@lo:400:kworker.0 Request processed in 641us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521361.555122:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4351b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875400222463360:12345-0@lo:400:kworker.0 Request processed in 28us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521361.555128:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788521361.555129:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788521361.555139:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788521361.555145:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875400222462464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521361.555161:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43dcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875400222462720:0@lo:400:kworker.0 00000100:00100000:0.0:1788521361.555171:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875400222462464:12345-0@lo:400:kworker.0 Request processed in 27us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521361.555172:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f075180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3646:1875400222463232:0@lo:400:kworker.0 00000100:00100000:0.0:1788521361.555176:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788521361.555200:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43dc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875400222462464:0@lo:400:kworker.0 00000100:00100000:0.0:1788521361.555237:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4358f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222463488:0@lo:400:kworker.0 00000100:00100000:0.0:1788521361.555248:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43dc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222462336:0@lo:400:kworker.0 00010000:00080000:0.0:1788521361.555260:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43df2680 x1875400222462848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521361.555271:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222462848:0@lo:400:kworker.0 00010000:00080000:0.0:1788521361.555281:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4358ea00 x1875400222463360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521361.555289:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4358ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875400222463360:0@lo:400:kworker.0 00000100:00100000:3.0:1788521361.555459:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222462208 00000100:00100000:3.0:1788521361.555485:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222462208 00000100:00100000:3.0:1788521361.555541:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1788521361.555551:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3646:x1875400222462208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521361.555605:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3646:x1875400222462208:12345-0@lo:400:kworker.0 Request processed in 57us (2081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521361.555612:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00080000:3.0:1788521361.555649:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788521361.555664:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788521361.555667:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788521361.555669:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521361.555682:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222462592 00000100:00100000:3.0:1788521361.555686:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222462592 00000100:00100000:3.0:1788521361.555721:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788521361.555729:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222462592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521361.555777:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222462592:12345-0@lo:400:kworker.0 Request processed in 49us (2242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521361.555801:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788521361.555808:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43dc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222462592:0@lo:400:kworker.0 00000100:00100000:2.0:1788521361.555939:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43dca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222461952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788521361.556292:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43dc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222462208:0@lo:400:kworker.0 00000100:00100000:0.0:1788521361.557427:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521361.557526:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201425664 00000100:00100000:2.0:1788521361.557597:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201425664 00000100:00100000:2.0:1788521361.557707:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 16 00000100:00100000:2.0:1788521361.558281:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+66:12382:x1875400201425664:12345-192.168.203.41@tcp:103:lfs.0 00010000:00010000:2.0:1788521361.558302:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788521361.558336:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d1e9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed840 expref: 66 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521361.558362:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1ef8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed855 expref: 65 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521361.558377:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d1d9a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7fa expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521361.558408:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:2.0:1788521361.558415:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521361.558499:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+63:12382:x1875400201425664:12345-192.168.203.41@tcp:103:lfs.0 Request processed in 226us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521361.558507:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 16 00000100:00100000:0.0:1788521361.565725:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521361.566296:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201425792 00000100:00100000:3.0:1788521361.566310:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201425792 00000100:00100000:3.0:1788521361.566385:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 184 00000100:00100000:3.0:1788521361.566397:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4358ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+63:12382:x1875400201425792:12345-192.168.203.41@tcp:58:lfs.0 00010000:00010000:3.0:1788521361.566618:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d1f14 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521361.566641:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d1f14 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521361.566655:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d1f14 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788521361.566780:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788521361.567200:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4358ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+63:12382:x1875400201425792:12345-192.168.203.41@tcp:58:lfs.0 Request processed in 801us (1485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521361.567212:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 184 00000100:00100000:3.0:1788521361.589291:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521361.589492:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201425920 00000100:00100000:1.0:1788521361.589506:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201425920 00000100:00100000:1.0:1788521361.589716:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 185 00000100:00100000:1.0:1788521361.589729:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+63:12384:x1875400201425920:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:1.0:1788521361.589756:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521361.589782:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1f1b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed863 expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.589878:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1f22 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.589949:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1f22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.589962:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1f22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.589977:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1f29 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.590018:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1f29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.590026:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1f29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.590123:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1f30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.590133:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1f30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.590139:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1f30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521361.590193:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788521361.590198:0:12956:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788521361.590230:0:12956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1f30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.590245:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1f30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.590254:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1f22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.590260:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1f22 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.590267:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1f22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.590278:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521361.590283:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1f22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.590289:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1f22 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.590301:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:1.0:1788521361.590303:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521361.590307:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1f22 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.590312:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d1f22 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.590336:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1f29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.590339:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1f29 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.590343:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1f29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.590346:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521361.590348:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1f29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.590351:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1f29 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.590368:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8fef76505000) 00010000:00010000:1.0:1788521361.590370:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521361.590372:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1f29 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.590376:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d1f29 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.590400:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d1f1b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed863 expref: 65 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.590409:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1f30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed863 expref: 64 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521361.590414:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:1.0:1788521361.590415:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788521361.590417:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434aa200, rc 0) 00000100:00100000:1.0:1788521361.590477:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+64:12384:x1875400201425920:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 753us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521361.590482:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 185 00010000:00010000:3.0:1788521361.613698:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521362.061294:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4358f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222463616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788521362.061399:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521362.061564:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222463616 00000100:00100000:0.0:1788521362.061577:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222463616 00000100:00100000:0.0:1788521362.061651:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788521362.061663:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222463616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788521362.061876:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788521362.062026:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222463616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 365us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521362.062035:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788521362.062092:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4358f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222463616:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788521362.067204:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222463744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788521362.067334:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521362.067688:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222463744 00000100:00100000:1.0:1788521362.067699:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222463744 00000100:00100000:1.0:1788521362.067836:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788521362.067849:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4358f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222463744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788521362.067915:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788521362.068056:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4358f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222463744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 209us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521362.068065:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788521362.068124:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222463744:0@lo:13:osp-pre-1-1.0 00000040:00080000:3.0:1788521362.317173:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788521362.317185:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788521362.317237:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788521362.317245:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788521362.317436:0:13799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef50f4ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1875400222463872:192.168.203.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788521362.318154:0:13799:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef553363c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521362.327243:0:13799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef50f4ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1875400222463872:192.168.203.41@tcp:107:hsm_cdtr.0 00000001:00080000:0.0:1788521362.330087:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000004:00080000:0.0:1788521362.330140:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788521362.330161:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8fef4853ccc0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1788521362.330167:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fee4348d600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8fef4853c240 00000020:00080000:0.0:1788521362.330170:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fee4348d100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8fee43dd8800 00010000:00010000:0.0:1788521362.330251:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1cdd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330264:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1cdd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330273:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1cdd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330279:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cb600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521362.330285:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1cdd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330293:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1cdd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330316:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8fef76505400) 00010000:00010000:0.0:1788521362.330320:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521362.330325:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1cdd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330332:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb600/0x411dd0ee4d2d1cdd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330367:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1ce4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330373:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1ce4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330378:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1ce4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330383:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749cbc00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521362.330386:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1ce4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330392:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1ce4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330400:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:0.0:1788521362.330403:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521362.330406:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1ce4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330411:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbc00/0x411dd0ee4d2d1ce4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330427:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d1d23 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330433:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d1d23 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330439:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d1d23 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330449:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40030e00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521362.330452:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d1d23 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330458:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d1d23 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330467:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8fef76505000) 00010000:00010000:0.0:1788521362.330469:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521362.330472:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d1d23 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330478:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d1d23 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330495:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1e26 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330501:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1e26 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330507:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1e26 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330513:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aac00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521362.330516:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1e26 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330523:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1e26 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330543:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:0.0:1788521362.330545:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521362.330549:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1e26 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330555:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d1e26 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330567:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1e49 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330573:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1e49 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330579:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1e49 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330584:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42411c00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521362.330587:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1e49 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330593:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1e49 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330601:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:0.0:1788521362.330603:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521362.330606:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1e49 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330611:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d1e49 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330633:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1e8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330639:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1e8f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330645:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1e8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330649:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410000 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521362.330652:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1e8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.330658:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1e8f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.332579:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:0.0:1788521362.332585:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521362.332593:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1e8f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.332603:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d1e8f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788521362.332836:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1788521362.332934:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788521362.333424:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521362.333510:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f075180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222464000:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788521362.333591:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521362.333659:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222464000 00000100:00100000:0.0:1788521362.333712:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222464000 00000100:00100000:0.0:1788521362.333778:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788521362.333790:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f076680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875400222464000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788521362.333829:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:0.0:1788521362.333872:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9aab8e, atime: 0x6a9aab8f, ctime: 0x6a9aab8e, blocks: 0x8 00010000:00010000:0.0:1788521362.333956:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d1f37 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521362.340013:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201426048 00000100:00100000:1.0:1788521362.340042:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201426048 00000100:00100000:1.0:1788521362.340120:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 186 00000100:00100000:1.0:1788521362.340131:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+17:12395:x1875400201426048:12345-192.168.203.41@tcp:53:lhsmtool_posix.0 00010000:00010000:0.0:1788521362.340253:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=412s v=(0 0) 00010000:00010000:0.0:1788521362.340261:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521362.340274:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d1f37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.340301:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d1f37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.340315:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d1f37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.340323:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d1f37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.340349:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00000080:1.0:1788521362.340353:0:9815:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788521362.340509:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+17:12395:x1875400201426048:12345-192.168.203.41@tcp:53:lhsmtool_posix.0 Request processed in 379us (7092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521362.340517:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 186 00000100:00100000:0.0:1788521362.340584:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f076680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3643:x1875400222464000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6796us (6991us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788521362.340592:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:0.0:1788521362.340639:0:13735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521362.340654:0:13735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d1f37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.340674:0:13735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42411800 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:0.0:1788521362.340679:0:13735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d1f37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.340691:0:13735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d1f37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.340709:0:13735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d1f37 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.340717:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d1f37 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.340740:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521362.340742:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521362.340743:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788521362.340789:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fef7f075180/2, rc 0, transno 4294967308 00000100:00100000:0.0:1788521362.340797:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f075180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222464000:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788521362.345950:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521362.346082:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201426176 00000100:00100000:0.0:1788521362.346095:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201426176 00000100:00100000:0.0:1788521362.346172:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 187 00000100:00100000:0.0:1788521362.346185:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+17:12395:x1875400201426176:12345-192.168.203.41@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788521362.346442:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1f3e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.346488:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1f3e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.346504:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1f3e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.347249:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1f45 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.347273:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1f45 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.347286:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1f45 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.347327:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1f4c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.347336:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1f4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.347343:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1f4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521362.347400:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788521362.347404:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788521362.347418:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1f4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.347429:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1f3e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.347455:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1f3e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.347461:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1f3e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.347467:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410400 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521362.347472:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1f3e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.347480:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1f3e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.347492:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fee410f5900) 00010000:00010000:0.0:1788521362.347495:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521362.347500:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1f3e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.347507:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d1f3e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.347524:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1f45 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.347530:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1f45 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.347536:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1f45 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.347541:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521362.347551:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1f45 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.347557:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1f45 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.347564:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8fef74a77b00) 00010000:00010000:0.0:1788521362.347566:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521362.347569:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1f45 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.347574:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1f45 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.347590:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1f4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.347596:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1f4c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.347601:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1f4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.347605:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42411e00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521362.347607:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1f4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.347612:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1f4c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.347618:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:0.0:1788521362.347621:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521362.347630:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1f4c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.347636:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1f4c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521362.357035:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+17:12395:x1875400201426176:12345-192.168.203.41@tcp:34:lhsmtool_posix.0 Request processed in 10842us (11088us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521362.357049:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 187 00000100:00100000:1.0:1788521362.367206:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521362.367980:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201426432 00000100:00100000:3.0:1788521362.367991:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201426432 00000100:00100000:3.0:1788521362.368150:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 188 00000100:00100000:3.0:1788521362.368162:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+17:12395:x1875400201426432:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521362.368183:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521362.368203:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1f53 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed86a expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.368326:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d1f5a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.368340:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d1f5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.368352:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d1f5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521362.368363:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788521362.368440:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d1f5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.368448:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d1f5a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.368454:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d1f5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.368459:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef413fde00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521362.368463:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d1f5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.368470:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d1f5a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.368493:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:3.0:1788521362.368496:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788521362.368500:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d1f5a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.368506:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d1f5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.368550:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1f53 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed86a expref: 19 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.368561:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fee410f5900) 00010000:00010000:3.0:1788521362.368563:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788521362.368567:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1f53 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed86a expref: 19 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.368576:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fce00, rc 0) 00000100:00100000:3.0:1788521362.368641:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+18:12395:x1875400201426432:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 481us (1443us total) trans 4294967459 rc 301/301 00000100:00100000:3.0:1788521362.368650:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 188 00000100:00100000:0.0:1788521362.380371:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521362.381528:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201426560 00000100:00100000:2.0:1788521362.381551:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201426560 00000100:00100000:2.0:1788521362.381720:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 189 00000100:00100000:2.0:1788521362.381734:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+18:12395:x1875400201426560:12345-192.168.203.41@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788521362.381783:0:6520:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788521362.381991:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+18:12395:x1875400201426560:12345-192.168.203.41@tcp:53:lhsmtool_posix.0 Request processed in 259us (1637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521362.382000:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 189 00000100:00100000:2.0:1788521362.387584:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521362.390061:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201426816 00000100:00100000:0.0:1788521362.390132:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201426816 00000100:00100000:0.0:1788521362.390411:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 190 00000100:00100000:0.0:1788521362.390424:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+18:12395:x1875400201426816:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788521362.390451:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521362.390455:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788521362.390614:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1f0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed85c expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.390636:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:0.0:1788521362.390643:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521362.390662:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1f68 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed871 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788521362.391651:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788521362.391847:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1f6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.391866:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1f6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.391913:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1f6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.391986:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1f68 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed871 expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.392003:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1f6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed871 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.392013:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8fef74a77b00) 00010000:00010000:0.0:1788521362.392016:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788521362.392019:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42410600, rc 0) 00000100:00100000:0.0:1788521362.392439:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+19:12395:x1875400201426816:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 2016us (4867us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788521362.392449:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 190 00000100:00100000:3.0:1788521362.397765:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521362.397800:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201427072 00000100:00100000:3.0:1788521362.397808:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201427072 00000100:00100000:3.0:1788521362.397875:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 191 00000100:00100000:3.0:1788521362.397925:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef50f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+19:12395:x1875400201427072:12345-192.168.203.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788521362.397983:0:12956:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521362.398014:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d1f6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed871 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.398048:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8fef74a77b00) 00010000:00010000:3.0:1788521362.398058:0:12956:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788521362.398082:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1f7d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.398096:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1f7d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.398106:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1f7d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.398167:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d1f84 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x46a1f7d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.398176:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d1f84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x46a1f7d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.398184:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d1f84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x46a1f7d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.398241:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1f7d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.398249:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1f7d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.398256:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1f7d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.398263:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef413fce00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521362.398267:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1f7d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.398282:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1f7d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.398295:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:3.0:1788521362.398298:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521362.398303:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1f7d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.398309:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1f7d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.398329:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d1f84 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x46a1f7d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.398336:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d1f84 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x46a1f7d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.398343:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d1f84 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x46a1f7d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.398349:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef413fde00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521362.398352:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d1f84 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x46a1f7d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.398437:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d1f84 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x46a1f7d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.398450:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x46a1f7d6 (ffff8fef76505600) 00010000:00010000:3.0:1788521362.398454:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521362.398458:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d1f84 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x46a1f7d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.398477:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d1f84 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x46a1f7d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521362.398564:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef50f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+18:12395:x1875400201427072:12345-192.168.203.41@tcp:36:lhsmtool_posix.0 Request processed in 679us (807us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788521362.398572:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 191 00000100:00100000:0.0:1788521362.406414:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521362.407793:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201427200 00000100:00100000:3.0:1788521362.407811:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201427200 00000100:00100000:3.0:1788521362.407998:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 192 00000100:00100000:3.0:1788521362.408009:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+18:12395:x1875400201427200:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521362.408029:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521362.408051:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d1f8b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed878 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.408085:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc800/0x411dd0ee4d2d1f92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.408098:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc800/0x411dd0ee4d2d1f92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.408110:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc800/0x411dd0ee4d2d1f92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.408226:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d1f8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed878 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.408247:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc800/0x411dd0ee4d2d1f92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed878 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.408268:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8fef76505a00) 00010000:00010000:3.0:1788521362.408271:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788521362.408275:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fc800, rc 0) 00000100:00100000:3.0:1788521362.408346:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+19:12395:x1875400201427200:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 339us (1946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521362.408353:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 192 00000100:00100000:3.0:1788521362.420274:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521362.420379:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201427456 00000100:00100000:1.0:1788521362.420389:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201427456 00000100:00100000:1.0:1788521362.420446:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 193 00000100:00100000:1.0:1788521362.420456:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+19:12395:x1875400201427456:12345-192.168.203.41@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788521362.420536:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1f99 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521362.420553:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1f99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521362.420564:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1f99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788521362.420725:0:9815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1788521362.420734:0:9815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 412486849541ns, next at 413486846886ns, rc = 0 00000004:00010000:1.0:1788521362.420798:0:9815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003653b0b7 reply state 0000000099471216 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1f99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521362.420812:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1f99 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521362.420820:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8fef76505a00) 00010000:00010000:1.0:1788521362.420822:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788521362.420826:0:9815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788521362.420962:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+21:12395:x1875400201427456:12345-192.168.203.41@tcp:36:lhsmtool_posix.0 Request processed in 507us (698us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788521362.420970:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 193 00000100:00100000:3.0:1788521362.423366:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521362.424353:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201427584 00000100:00100000:0.0:1788521362.424367:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201427584 00000100:00100000:0.0:1788521362.424454:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 194 00000100:00100000:0.0:1788521362.424466:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee437c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+21:12395:x1875400201427584:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788521362.424508:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521362.424537:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1fa0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed87f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.424625:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1fa0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed87f expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.424663:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1fa0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed87f expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.424687:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8fef76505a00) 00010000:00010000:0.0:1788521362.424690:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788521362.424694:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411e00, rc 0) 00000100:00100000:0.0:1788521362.424774:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee437c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+22:12395:x1875400201427584:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 311us (1422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521362.424781:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 194 00000100:00100000:0.0:1788521362.429774:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521362.429989:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201427712 00000100:00100000:1.0:1788521362.430003:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201427712 00000100:00100000:1.0:1788521362.430078:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 59 00000100:00100000:1.0:1788521362.430090:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+6:2396:x1875400201427712:12345-192.168.203.41@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788521362.430341:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+7:2396:x1875400201427712:12345-192.168.203.41@tcp:2:lhsmtool_posix.0 Request processed in 253us (581us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788521362.430348:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 59 00000100:00100000:1.0:1788521362.437726:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521362.438164:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201427968 00000100:00100000:0.0:1788521362.438176:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201427968 00000100:00100000:0.0:1788521362.438256:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 49 00000100:00100000:0.0:1788521362.438269:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43dca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+22:12395:x1875400201427968:12345-192.168.203.41@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788521362.438535:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43dca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+23:12395:x1875400201427968:12345-192.168.203.41@tcp:35:lhsmtool_posix.0 Request processed in 267us (817us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1788521362.438544:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 49 00000100:00100000:1.0:1788521362.442113:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521362.442293:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201428224 00000100:00100000:0.0:1788521362.442436:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201428224 00000100:00100000:0.0:1788521362.442553:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 195 00000100:00100000:0.0:1788521362.442565:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43dc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+23:12395:x1875400201428224:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788521362.442763:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43dc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+23:12395:x1875400201428224:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 Request processed in 200us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521362.442771:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 195 00000100:00100000:3.0:1788521362.445982:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521362.446038:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201428352 00000100:00100000:3.0:1788521362.446050:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201428352 00000100:00100000:3.0:1788521362.446122:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 196 00000100:00100000:3.0:1788521362.446136:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4325a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+23:12395:x1875400201428352:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521362.446173:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521362.446202:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d1fa7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed886 expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.446322:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d1fae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.446341:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d1fae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.446356:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d1fae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521362.446414:0:12956:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788521362.446453:0:12956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d1fae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.446488:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d1fa7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed886 expref: 25 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.446510:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d1fae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed886 expref: 24 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.446521:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8fef76505a00) 00010000:00010000:3.0:1788521362.446524:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788521362.447778:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fde00, rc 0) 00000100:00100000:3.0:1788521362.447874:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4325a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+24:12395:x1875400201428352:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 1737us (1912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521362.447909:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 196 00000100:00100000:3.0:1788521362.451435:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521362.451509:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201428480 00000100:00100000:2.0:1788521362.451526:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201428480 00000100:00100000:2.0:1788521362.451593:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 60 00000100:00100000:2.0:1788521362.451608:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+7:2395:x1875400201428480:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521362.451628:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521362.451651:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9c3dae5/0x411dd0ee4d2d1fb5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed88d expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788521362.451676:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9aab91, blocks: 0x0 00010000:00010000:2.0:1788521362.451696:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1788521362.451708:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521362.451719:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9c3dae5/0x411dd0ee4d2d1fb5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed88d expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.451743:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a9c3dae5/0x411dd0ee4d2d1fb5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed88d expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.451755:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b6e00, rc 0) 00000100:00100000:2.0:1788521362.451845:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+8:2395:x1875400201428480:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 227us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521362.451855:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 60 00000100:00100000:1.0:1788521362.459564:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521362.459702:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201428736 00000100:00100000:0.0:1788521362.459717:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201428736 00000100:00100000:0.0:1788521362.459795:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 197 00000100:00100000:0.0:1788521362.459806:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43dc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+24:12395:x1875400201428736:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788521362.459969:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43dc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+24:12395:x1875400201428736:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 Request processed in 164us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521362.459977:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 197 00000100:00100000:3.0:1788521362.466288:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521362.466527:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201428864 00000100:00100000:1.0:1788521362.466539:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201428864 00000100:00100000:1.0:1788521362.466610:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 61 00000100:00100000:1.0:1788521362.466623:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+8:12395:x1875400201428864:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788521362.466648:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521362.466682:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7f19744/0x411dd0ee4d2d1fbc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed894 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521362.466722:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9c3dae5/0x411dd0ee4d2d1fb5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed88d expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521362.466732:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521362.466736:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521362.466742:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7f19744/0x411dd0ee4d2d1fbc lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed894 expref: 9 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521362.466783:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a9c3dae5/0x411dd0ee4d2d1fb5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed88d expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521362.466797:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a9c3dae5/0x411dd0ee4d2d1fb5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed88d expref: 9 pid: 8436 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521362.466813:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43dc9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8434:1875400222464128:192.168.203.41@tcp:104: 00000100:00100000:1.0:1788521362.466945:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef51dce480 going to sleep for 11 seconds 00000100:00100000:1.0:1788521362.470605:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43dc9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8434:1875400222464128:192.168.203.41@tcp:104: 00010000:00010000:1.0:1788521362.470659:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c7f19744/0x411dd0ee4d2d1fbc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed894 expref: 9 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521362.470687:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434aa600, rc 0) 00000100:00100000:1.0:1788521362.470765:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+9:12395:x1875400201428864:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 4144us (4492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521362.470789:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 61 00000100:00100000:1.0:1788521362.473820:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521362.473934:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201428992 00000100:00100000:3.0:1788521362.473948:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201428992 00010000:00010000:3.0:1788521362.474000:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a9c3dae5/0x411dd0ee4d2d1fb5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed88d expref: 9 pid: 8436 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521362.474049:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 86 00000100:00100000:3.0:1788521362.474060:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+9:2395:x1875400201428992:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521362.474079:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521362.474108:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a9c3dae5/0x411dd0ee4d2d1fb5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed88d expref: 9 pid: 8436 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.474136:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a9c3dae5/0x411dd0ee4d2d1fb5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed88d expref: 9 pid: 8436 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.474433:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9c3dae5/0x411dd0ee4d2d1fb5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed88d expref: 9 pid: 8436 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.474454:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521362.474459:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521362.474468:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7f19744/0x411dd0ee4d2d1fbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed894 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.474479:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7f19744/0x411dd0ee4d2d1fbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed894 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.474526:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c7f19744/0x411dd0ee4d2d1fbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed894 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521362.474544:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d20000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6505:1875400222464256:192.168.203.41@tcp:105: 00000100:00100000:3.0:1788521362.474686:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef553363c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521362.484310:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d20000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6505:1875400222464256:192.168.203.41@tcp:105: 00010000:00010000:1.0:1788521362.484349:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521362.484428:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+8:2395:x1875400201428992:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 10367us (10621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521362.484441:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 86 00000100:00100000:0.0:1788521362.490366:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521362.494671:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201429120 00000100:00100000:2.0:1788521362.494692:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201429120 00002000:00100000:3.0:1788521362.495420:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8fef7f070000 x1875400201429120/t0(0) o4->fc75e887-507e-4861-8203-e266d82f5177@192.168.203.41@tcp:363/0 lens 504/0 e 0 to 0 dl 1788521373 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788521362.495433:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fef7f070000 with x1875400201429120 ext(0->8) 00002000:00010000:3.0:1788521362.495440:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fef7f070000 00000100:00100000:3.0:1788521362.495524:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 4 00000100:00100000:3.0:1788521362.495555:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc75e887-507e-4861-8203-e266d82f5177+8:2396:x1875400201429120:12345-192.168.203.41@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788521362.502532:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc75e887-507e-4861-8203-e266d82f5177+10:2396:x1875400201429120:12345-192.168.203.41@tcp:4:lhsmtool_posix.0 Request processed in 6969us (12172us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788521362.502546:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 4 00002000:00100000:3.0:1788521362.502560:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8fef7f070000 x1875400201429120/t4294967315(0) o4->fc75e887-507e-4861-8203-e266d82f5177@192.168.203.41@tcp:363/0 lens 504/448 e 0 to 0 dl 1788521373 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788521362.502570:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fef7f070000 with x1875400201429120 ext(0->8) 00002000:00010000:3.0:1788521362.502576:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fef7f070000 00000040:00080000:1.0:1788521362.510022:0:14661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788521362.510035:0:14661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788521362.510064:0:14661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788521362.510072:0:14661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788521362.510764:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521362.510811:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201429248 00000100:00100000:0.0:1788521362.510823:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201429248 00000100:00100000:0.0:1788521362.510900:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 198 00000100:00100000:0.0:1788521362.510912:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+24:12395:x1875400201429248:12345-192.168.203.41@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788521362.517383:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1788521362.517406:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:2.0:1788521362.517422:0:6498:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00010000:00010000:2.0:1788521362.517466:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1f99 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.517478:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1f99 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.517487:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1f99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.517493:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434abe00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521362.517498:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1f99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.517507:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1f99 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.517660:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8fef76505a00) 00010000:00010000:2.0:1788521362.517663:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788521362.517670:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1f99 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.517678:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1f99 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521362.517850:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef44fc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222464384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788521362.517971:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788521362.518295:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1788521362.518308:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788521362.518454:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+19:12395:x1875400201429248:12345-192.168.203.41@tcp:44:lhsmtool_posix.0 Request processed in 7540us (7693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521362.518465:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 198 00000100:00100000:2.0:1788521362.518508:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222464384 00000100:00100000:2.0:1788521362.518517:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222464384 00000100:00100000:2.0:1788521362.519745:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788521362.519759:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222464384:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788521362.519962:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788521362.519966:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788521361 00002000:00010000:2.0:1788521362.519970:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788521362.519972:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788521361 -> 1788521361 00002000:00010000:2.0:1788521362.519975:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788521362.520060:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875400222464384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 304us (2089us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788521362.520068:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:1.0:1788521362.520103:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fef44fc8a80/2, rc 0, transno 4294967316 00000100:00100000:1.0:1788521362.520111:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef44fc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222464384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788521362.520426:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521362.526003:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201429376 00000100:00100000:0.0:1788521362.526026:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201429376 00000100:00100000:0.0:1788521362.526119:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 63 00000100:00100000:0.0:1788521362.526132:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc75e887-507e-4861-8203-e266d82f5177+10:2395:x1875400201429376:12345-192.168.203.41@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788521362.528206:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:0.0:1788521362.528231:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:0.0:1788521362.528371:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc75e887-507e-4861-8203-e266d82f5177+7:2395:x1875400201429376:12345-192.168.203.41@tcp:16:lhsmtool_posix.0 Request processed in 2237us (7943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521362.528383:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 63 00000100:00100000:1.0:1788521362.535967:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521362.536023:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201429632 00000100:00100000:1.0:1788521362.536037:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201429632 00000100:00100000:1.0:1788521362.536111:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 199 00000100:00100000:1.0:1788521362.536124:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+19:12395:x1875400201429632:12345-192.168.203.41@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788521362.536199:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521362.536245:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d1fae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed886 expref: 19 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521362.536281:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8fef76505a00) 00010000:00010000:1.0:1788521362.536288:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788521362.536329:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1fc3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521362.536346:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1fc3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521362.538545:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1fc3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788521362.538858:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000059c84ebd reply state 00000000b0ffeca6 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1fc3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521362.538881:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1fc3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521362.538907:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8fef76505a00) 00010000:00010000:1.0:1788521362.538910:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788521362.538915:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788521362.539069:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+20:12395:x1875400201429632:12345-192.168.203.41@tcp:36:lhsmtool_posix.0 Request processed in 2943us (3114us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1788521362.539079:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 199 00000100:00100000:0.0:1788521362.551830:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521362.551912:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201429760 00000100:00100000:1.0:1788521362.551926:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201429760 00000100:00100000:1.0:1788521362.552007:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 64 00000100:00100000:1.0:1788521362.552020:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc75e887-507e-4861-8203-e266d82f5177+7:2396:x1875400201429760:12345-192.168.203.41@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788521362.552246:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788521362.552264:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788521361 -> 1788521360 00002000:00010000:1.0:1788521362.552266:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788521359 00002000:00010000:1.0:1788521362.552268:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788521361 -> 1788521360 00002000:00010000:1.0:1788521362.552271:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788521362.552364:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc75e887-507e-4861-8203-e266d82f5177+8:2396:x1875400201429760:12345-192.168.203.41@tcp:2:lhsmtool_posix.0 Request processed in 336us (540us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788521362.552373:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 64 00000100:00100000:1.0:1788521362.568474:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521362.568560:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201430016 00000100:00100000:1.0:1788521362.568584:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201430016 00000100:00100000:1.0:1788521362.568652:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 200 00000100:00100000:1.0:1788521362.568662:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+20:12395:x1875400201430016:12345-192.168.203.41@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788521362.568772:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1fca lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521362.568789:0:9815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc800/0x411dd0ee4d2d1f92 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed878 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521362.568799:0:9815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1fca lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521362.568832:0:9815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc800/0x411dd0ee4d2d1f92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed878 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521362.568847:0:9815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc800/0x411dd0ee4d2d1f92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed878 expref: 20 pid: 6520 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521362.568861:0:9815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4359b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9815:1875400222464512:192.168.203.41@tcp:104: 00000100:00100000:1.0:1788521362.568974:0:9815:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef51dce900 going to sleep for 11 seconds 00000100:00100000:3.0:1788521362.575426:0:9815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4359b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9815:1875400222464512:192.168.203.41@tcp:104: 00010000:00010000:3.0:1788521362.575526:0:9815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1fca lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521362.583420:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521362.583762:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201430144 00000100:00100000:0.0:1788521362.583771:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201430144 00010000:00010000:0.0:1788521362.583810:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc800/0x411dd0ee4d2d1f92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed878 expref: 21 pid: 6520 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521362.583865:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 87 00000100:00100000:0.0:1788521362.583874:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4e7e1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+21:2396:x1875400201430144:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521362.583914:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521362.583922:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc800/0x411dd0ee4d2d1f92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed878 expref: 21 pid: 6520 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.583936:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc800/0x411dd0ee4d2d1f92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed878 expref: 21 pid: 6520 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.583959:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc800/0x411dd0ee4d2d1f92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed878 expref: 21 pid: 6520 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.583976:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8fef76505a00) 00010000:00010000:0.0:1788521362.583982:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1fca lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.583992:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1fca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.584000:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1fca lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.584026:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521362.584071:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4e7e1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+20:2396:x1875400201430144:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 198us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521362.584079:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 87 00010000:00010000:0.0:1788521362.584129:0:9815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1fca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.584143:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1fca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.584179:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1fca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.584187:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1fca lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.584194:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1fca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.584199:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434abe00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521362.584204:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1fca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.584224:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1fca lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.584234:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8fef76505a00) 00010000:00010000:0.0:1788521362.584236:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788521362.584240:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1fca lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.584246:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1fca lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521362.584282:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+19:12395:x1875400201430016:12345-192.168.203.41@tcp:55:lhsmtool_posix.0 Request processed in 15621us (15833us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788521362.584290:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 200 00000100:00100000:2.0:1788521362.596150:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521362.596245:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201430272 00000100:00100000:1.0:1788521362.596256:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201430272 00000100:00100000:1.0:1788521362.596324:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 65 00000100:00100000:1.0:1788521362.596343:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+8:2394:x1875400201430272:12345-192.168.203.41@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788521362.596406:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a77e722f/0x411dd0ee4d2d1fd1 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521362.596425:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7f19744/0x411dd0ee4d2d1fbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed894 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521362.596439:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521362.596447:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788521362.596455:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a77e722f/0x411dd0ee4d2d1fd1 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521362.596504:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c7f19744/0x411dd0ee4d2d1fbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed894 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521362.596517:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c7f19744/0x411dd0ee4d2d1fbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed894 expref: 8 pid: 8434 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521362.596531:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4359b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1875400222464640:192.168.203.41@tcp:104: 00000100:00100000:1.0:1788521362.596612:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef51dce6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521362.602201:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521362.602288:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201430400 00000100:00100000:2.0:1788521362.602302:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201430400 00010000:00010000:2.0:1788521362.602339:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c7f19744/0x411dd0ee4d2d1fbc lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed894 expref: 9 pid: 8434 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521362.602381:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 88 00000100:00100000:2.0:1788521362.602391:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43255880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+9:2393:x1875400201430400:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521362.602405:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521362.602424:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c7f19744/0x411dd0ee4d2d1fbc lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed894 expref: 9 pid: 8434 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.602438:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c7f19744/0x411dd0ee4d2d1fbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed894 expref: 9 pid: 8434 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.602462:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788521362.602466:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788521362.602473:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a77e722f/0x411dd0ee4d2d1fd1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.602483:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a77e722f/0x411dd0ee4d2d1fd1 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.602503:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521362.602552:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43255880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+9:2393:x1875400201430400:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 162us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521362.602560:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 88 00010000:00010000:3.0:1788521362.603188:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7f19744/0x411dd0ee4d2d1fbc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed894 expref: 8 pid: 8434 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521362.603204:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4359b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1875400222464640:192.168.203.41@tcp:104: 00010000:00010000:3.0:1788521362.603234:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a77e722f/0x411dd0ee4d2d1fd1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.603244:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a77e722f/0x411dd0ee4d2d1fd1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.603251:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a77e722f/0x411dd0ee4d2d1fd1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.603286:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a77e722f/0x411dd0ee4d2d1fd1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.603295:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a77e722f/0x411dd0ee4d2d1fd1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.603304:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a77e722f/0x411dd0ee4d2d1fd1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.603312:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aac00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:3.0:1788521362.603316:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a77e722f/0x411dd0ee4d2d1fd1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.603325:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a77e722f/0x411dd0ee4d2d1fd1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.603339:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a77e722f/0x411dd0ee4d2d1fd1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.603347:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a77e722f/0x411dd0ee4d2d1fd1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521362.603416:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+7:2394:x1875400201430272:12345-192.168.203.41@tcp:1:lhsmtool_posix.0 Request processed in 7079us (7274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521362.603424:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 65 00000100:00100000:1.0:1788521362.607230:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521362.607301:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201430656 00000100:00100000:3.0:1788521362.607310:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201430656 00000100:00100000:3.0:1788521362.608496:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 201 00000100:00100000:3.0:1788521362.608513:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+19:12395:x1875400201430656:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788521362.608594:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d1fd8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.608612:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1e1f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed81d expref: 19 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.608622:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d1fd8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.608657:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1e1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed81d expref: 19 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.608672:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1e1f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed81d expref: 19 pid: 9815 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521362.608685:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d22300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1875400222464768:192.168.203.41@tcp:104: 00000100:00100000:3.0:1788521362.608777:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef553363c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521362.617584:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521362.618179:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201430784 00000100:00100000:0.0:1788521362.618189:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201430784 00010000:00010000:0.0:1788521362.618240:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1e1f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed81d expref: 20 pid: 9815 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521362.618285:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 89 00000100:00100000:0.0:1788521362.618295:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef41325180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+20:2396:x1875400201430784:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521362.618311:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521362.618318:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1e1f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed81d expref: 20 pid: 9815 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.618332:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1e1f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed81d expref: 20 pid: 9815 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.618353:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:0.0:1788521362.618358:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d1fd8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.618368:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d1fd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.618376:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d1fd8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.618393:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521362.618445:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef41325180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+20:2396:x1875400201430784:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 151us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521362.618453:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 89 00010000:00010000:3.0:1788521362.619328:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d1e1f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed81d expref: 19 pid: 9815 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521362.619348:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d22300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1875400222464768:192.168.203.41@tcp:104: 00010000:00010000:3.0:1788521362.619370:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d1fd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.619399:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d1fd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.619405:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d1fd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.619663:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1fdf lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.619677:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1fa0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed87f expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.619686:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1fdf lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.619716:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1fa0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed87f expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521362.619730:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1fa0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed87f expref: 19 pid: 6521 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521362.619744:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d22300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1875400222464896:192.168.203.41@tcp:104: 00000100:00100000:3.0:1788521362.619818:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef42ec6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788521362.622398:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d22300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1875400222464896:192.168.203.41@tcp:104: 00010000:00010000:3.0:1788521362.622423:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1fdf lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521362.629029:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521362.629626:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201430912 00000100:00100000:0.0:1788521362.629645:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201430912 00010000:00010000:0.0:1788521362.629685:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1fa0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed87f expref: 20 pid: 6521 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521362.629737:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 90 00000100:00100000:0.0:1788521362.629747:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71521880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+20:2395:x1875400201430912:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521362.629761:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521362.629768:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1fa0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed87f expref: 20 pid: 6521 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.629781:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1fa0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed87f expref: 20 pid: 6521 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.629802:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d1fa0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed87f expref: 20 pid: 6521 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.629817:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8fef76505a00) 00010000:00010000:0.0:1788521362.629823:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1fdf lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.629833:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1fdf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.629841:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1fdf lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.629874:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521362.629947:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71521880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+19:2395:x1875400201430912:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 201us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521362.629963:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 90 00010000:00010000:2.0:1788521362.630062:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1fdf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.630081:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1fdf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521362.630181:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1788521362.630300:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1788521362.630335:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1788521362.630406:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef44fcb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6519:1875400222465024:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788521362.630468:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521362.630498:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4853cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788521362.630518:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222465024 00000100:00100000:2.0:1788521362.630523:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222465024 00000100:00100000:2.0:1788521362.630567:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788521362.630574:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6519:x1875400222465024:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788521362.630641:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6519:x1875400222465024:12345-0@lo:1000:mdt00_000.0 Request processed in 67us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521362.630648:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788521362.630678:0:6519:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1788521362.630683:0:6519:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fef44fc8a80, transno 4294967316 00000100:00100000:2.0:1788521362.630695:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef44fcb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6519:1875400222465024:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788521362.630800:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1788521362.630837:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e81500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6519:1875400222465152:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788521362.630865:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521362.630908:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4853c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521362.630997:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222465152 00000100:00100000:2.0:1788521362.631001:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222465152 00000100:00100000:2.0:1788521362.631023:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788521362.631030:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6519:x1875400222465152:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788521362.631122:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6519:x1875400222465152:12345-0@lo:1000:mdt00_000.0 Request processed in 92us (256us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788521362.631129:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788521362.631158:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e81500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6519:1875400222465152:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788521362.631188:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1fdf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.631196:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1fdf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.631203:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1fdf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.631218:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef413fce00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521362.631222:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1fdf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.631230:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1fdf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.631242:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8fef76505a00) 00010000:00010000:2.0:1788521362.631245:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788521362.631249:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1fdf lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.631255:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d1fdf lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.631276:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d1f14 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.631293:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d1f14 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.631298:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d1f14 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.631303:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef413fc600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521362.631307:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d1f14 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.631313:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d1f14 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.631322:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:2.0:1788521362.631324:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788521362.631328:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d1f14 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.631334:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d1f14 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.631357:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1fe6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.631369:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1f30 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed863 expref: 23 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.631377:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1fe6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.631400:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1f30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed863 expref: 23 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.631417:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1f30 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed863 expref: 23 pid: 12956 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521362.631428:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e80380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1875400222465280:192.168.203.41@tcp:104: 00000100:00100000:2.0:1788521362.631474:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4853c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521362.637328:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521362.637567:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e80380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1875400222465280:192.168.203.41@tcp:104: 00010000:00010000:2.0:1788521362.637594:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1fe6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521362.638042:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521362.645106:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201431040 00000100:00100000:0.0:1788521362.645119:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201431040 00010000:00010000:0.0:1788521362.645161:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1f30 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed863 expref: 23 pid: 12956 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521362.645203:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 91 00000100:00100000:0.0:1788521362.645223:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+23:2396:x1875400201431040:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521362.645239:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521362.645247:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1f30 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed863 expref: 23 pid: 12956 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.645260:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1f30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed863 expref: 23 pid: 12956 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.645281:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d1f30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed863 expref: 23 pid: 12956 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.645296:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:0.0:1788521362.645301:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1fe6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.645312:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1fe6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.645320:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1fe6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.645365:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521362.645416:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+22:2396:x1875400201431040:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 195us (8097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521362.645424:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 91 00010000:00010000:0.0:1788521362.645453:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1fe6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.645461:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1fe6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.645473:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1fe6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.645481:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1fe6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.645489:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1fe6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.645494:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521362.645499:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1fe6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.645506:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1fe6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.645515:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:0.0:1788521362.645518:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521362.645521:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1fe6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.645537:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d1fe6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.645549:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d1fd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.645555:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d1fd8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.645561:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d1fd8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.645566:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef413fda00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521362.645569:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d1fd8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.645576:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d1fd8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.645584:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71ec0200) 00010000:00010000:0.0:1788521362.645586:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788521362.645589:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d1fd8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521362.645595:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d1fd8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521362.645719:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+21:12395:x1875400201430656:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 Request processed in 37213us (38510us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1788521362.645727:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 201 00000020:00080000:0.0:1788521362.645737:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788521362.645818:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788521362.645822:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788521362.646472:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788521362.646483:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788521362.651800:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521362.653185:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201431296 00000100:00100000:1.0:1788521362.653198:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201431296 00000100:00100000:1.0:1788521362.653263:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 50 00000100:00100000:1.0:1788521362.653273:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6d4a8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+21:12395:x1875400201431296:12345-192.168.203.41@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788521362.653547:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788521362.653583:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:1.0:1788521362.653614:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1fed lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521362.653629:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1fed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521362.653640:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1fed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521362.653649:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1fed lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521362.653655:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1fed lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521362.653661:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1fed lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521362.653689:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788521362.653777:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6d4a8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+23:12395:x1875400201431296:12345-192.168.203.41@tcp:35:lhsmtool_posix.0 Request processed in 505us (1992us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1788521362.653797:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 50 00000020:00080000:1.0:1788521362.653802:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788521362.655649:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521362.655662:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1fed lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.655671:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434abe00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:2.0:1788521362.655676:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1fed lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.655686:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1fed lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.655701:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8fef76505a00) 00010000:00010000:2.0:1788521362.655704:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788521362.655708:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1fed lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.655714:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d1fed lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521362.655747:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521362.655749:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521362.655751:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521363.662387:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521364.109066:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222465408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788521364.109133:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521364.110904:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222465408 00000100:00100000:0.0:1788521364.110915:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222465408 00000100:00100000:0.0:1788521364.111207:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788521364.111221:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222465408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788521364.111253:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521364.111331:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222465408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (2198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521364.111338:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:0.0:1788521364.111360:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521364.111406:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222465408:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788521364.113068:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222465536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521364.113122:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521364.113238:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222465536 00000100:00100000:2.0:1788521364.113245:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222465536 00000100:00100000:2.0:1788521364.113294:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788521364.113302:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875400222465536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788521364.113322:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521364.113360:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875400222465536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521364.113366:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1788521364.113411:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521364.113440:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222465536:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788521364.337976:0:14712:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788521364.337986:0:14712:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788521364.338022:0:14712:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788521364.338029:0:14712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788521364.517718:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521364.519238:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201431552 00000100:00100000:2.0:1788521364.519253:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201431552 00000100:00080000:0.0:1788521364.519317:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521364.519341:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 202 00000100:00100000:2.0:1788521364.519353:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+23:12413:x1875400201431552:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:2.0:1788521364.519377:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521364.519397:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1ff4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed89b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.519502:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1ffb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.519526:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1ffb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.519540:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1ffb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521364.519553:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788521364.519657:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d1ff4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed89b expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.519675:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1ffb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed89b expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.519685:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:2.0:1788521364.519688:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788521364.519691:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7200, rc 0) 00000100:00100000:2.0:1788521364.519878:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+25:12413:x1875400201431552:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 410us (2048us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788521364.519910:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 202 00000100:00100000:0.0:1788521364.525972:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521364.526920:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201431680 00000100:00100000:3.0:1788521364.526940:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201431680 00000100:00100000:3.0:1788521364.527068:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 203 00000100:00100000:3.0:1788521364.527078:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+25:12413:x1875400201431680:12345-192.168.203.41@tcp:34:lfs.0 00010000:00010000:3.0:1788521364.527154:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd200/0x411dd0ee4d2d2009 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.527173:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd200/0x411dd0ee4d2d2009 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.527185:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd200/0x411dd0ee4d2d2009 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.527210:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd800/0x411dd0ee4d2d2010 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.527218:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd800/0x411dd0ee4d2d2010 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.527225:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd800/0x411dd0ee4d2d2010 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.527301:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d2017 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.527309:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d2017 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.527316:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d2017 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788521364.527360:0:9815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d2017 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.527383:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd200/0x411dd0ee4d2d2009 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.527389:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd200/0x411dd0ee4d2d2009 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.527396:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd200/0x411dd0ee4d2d2009 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.527401:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef413fd200 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521364.527405:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd200/0x411dd0ee4d2d2009 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.527411:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd200/0x411dd0ee4d2d2009 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.527424:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:3.0:1788521364.527427:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521364.527431:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd200/0x411dd0ee4d2d2009 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.527437:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd200/0x411dd0ee4d2d2009 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.527448:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd800/0x411dd0ee4d2d2010 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.527454:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd800/0x411dd0ee4d2d2010 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.527459:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd800/0x411dd0ee4d2d2010 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.527469:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef413fd800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521364.527472:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd800/0x411dd0ee4d2d2010 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.527478:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd800/0x411dd0ee4d2d2010 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.527485:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8fef76505600) 00010000:00010000:3.0:1788521364.527487:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521364.527490:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd800/0x411dd0ee4d2d2010 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.527495:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd800/0x411dd0ee4d2d2010 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.527509:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d2017 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.527516:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d2017 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.527522:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d2017 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.527527:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef413fda00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521364.527530:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d2017 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.527536:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d2017 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.527553:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef76505c00) 00010000:00010000:3.0:1788521364.527555:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521364.527557:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d2017 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.527562:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d2017 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521364.527633:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+25:12413:x1875400201431680:12345-192.168.203.41@tcp:34:lfs.0 Request processed in 556us (1679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521364.527640:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 203 00000100:00100000:0.0:1788521364.633169:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521364.633376:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201431936 00000100:00100000:2.0:1788521364.633386:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201431936 00000100:00100000:2.0:1788521364.633449:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 204 00000100:00100000:2.0:1788521364.633459:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+25:12416:x1875400201431936:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:2.0:1788521364.633480:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521364.633500:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d201e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed8a2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.633591:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d2025 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.633606:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d2025 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.633617:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d2025 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.633633:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d202c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.633640:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d202c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.633646:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d202c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.633754:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2033 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.633763:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2033 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.633771:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2033 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521364.633781:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788521364.633853:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d2025 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.633861:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d2025 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.633874:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d2025 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.634023:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521364.634029:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d2025 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.634037:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d2025 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.634049:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:2.0:1788521364.634052:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521364.634056:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d2025 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.634063:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d2025 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.634076:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d202c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.634082:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d202c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.634086:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d202c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.634092:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521364.634094:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d202c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.634176:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d202c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.634185:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8fef71591a00) 00010000:00010000:2.0:1788521364.634187:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521364.634191:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d202c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.634205:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d202c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.634499:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d201e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8a2 expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.634517:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2033 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8a2 expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.634524:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71591d00) 00010000:00010000:3.0:1788521364.634527:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521364.634529:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7000, rc 0) 00000100:00100000:3.0:1788521364.635430:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+27:12416:x1875400201431936:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 1966us (2265us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788521364.635439:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 204 00000100:00100000:0.0:1788521364.644304:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521364.645554:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201432064 00000100:00100000:2.0:1788521364.645566:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201432064 00000100:00100000:2.0:1788521364.645631:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 205 00000100:00100000:2.0:1788521364.645642:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+27:12416:x1875400201432064:12345-192.168.203.41@tcp:54:lfs.0 00010000:00010000:2.0:1788521364.645706:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2041 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.645723:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2041 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.645736:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2041 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.645772:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2041 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.645779:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2041 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.645814:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2041 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.645820:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521364.645824:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2041 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.645831:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2041 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.645843:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71591d00) 00010000:00010000:2.0:1788521364.645846:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521364.645851:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2041 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.645857:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2041 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521364.645960:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+27:12416:x1875400201432064:12345-192.168.203.41@tcp:54:lfs.0 Request processed in 319us (1665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521364.645968:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 205 00000100:00100000:0.0:1788521364.651701:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521364.651799:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201432320 00000100:00100000:1.0:1788521364.651809:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201432320 00000100:00100000:1.0:1788521364.651866:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 51 00000100:00100000:1.0:1788521364.651877:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+27:12416:x1875400201432320:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:1.0:1788521364.652124:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+28:12416:x1875400201432320:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 248us (432us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1788521364.652131:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 51 00010000:00010000:3.0:1788521364.686642:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521364.696279:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521364.697868:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201432576 00000100:00100000:1.0:1788521364.697895:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201432576 00000100:00100000:1.0:1788521364.698951:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 206 00000100:00100000:1.0:1788521364.698978:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43dca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+28:11940:x1875400201432576:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:1.0:1788521364.699002:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521364.699024:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d2048 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed8a9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.699130:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d204f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.699146:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2033 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8a2 expref: 29 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.699157:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d204f lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.699203:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2033 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8a2 expref: 29 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.699232:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2033 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8a2 expref: 29 pid: 6519 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521364.699248:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1875400222465664:192.168.203.41@tcp:104: 00000100:00100000:1.0:1788521364.700108:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef51dce3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521364.708513:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef766f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1875400222465664:192.168.203.41@tcp:104: 00010000:00010000:1.0:1788521364.708546:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d204f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521364.721555:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521364.723632:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201432704 00000100:00100000:1.0:1788521364.723646:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201432704 00010000:00010000:1.0:1788521364.723698:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2033 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8a2 expref: 30 pid: 6519 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521364.723745:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 92 00000100:00100000:1.0:1788521364.723755:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+30:2395:x1875400201432704:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521364.723771:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521364.723778:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2033 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8a2 expref: 30 pid: 6519 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.723791:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2033 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8a2 expref: 30 pid: 6519 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.723812:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2033 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8a2 expref: 30 pid: 6519 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.723851:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71591d00) 00010000:00010000:1.0:1788521364.723857:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d204f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.723866:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d204f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.723874:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d204f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.723952:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521364.724023:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+29:2395:x1875400201432704:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 268us (2477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521364.724030:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 92 00010000:00010000:1.0:1788521364.724153:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d204f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.724162:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d204f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521364.724181:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788521364.724328:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d2048 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8a9 expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.724618:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d204f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8a9 expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.724630:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71591d00) 00010000:00010000:1.0:1788521364.724647:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788521364.724650:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434aa600, rc 0) 00000100:00100000:1.0:1788521364.724689:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43dca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+29:11940:x1875400201432576:12345-192.168.203.41@tcp:101:bash.0 Request processed in 25721us (28420us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1788521364.724697:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 206 00000100:00100000:0.0:1788521364.730684:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521364.731463:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201432832 00000100:00100000:3.0:1788521364.731474:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201432832 00000100:00100000:3.0:1788521364.731535:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 207 00000100:00100000:3.0:1788521364.731546:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+29:11940:x1875400201432832:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:3.0:1788521364.731580:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521364.731599:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d205d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed8b0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.731632:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd800/0x411dd0ee4d2d2064 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.731647:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd800/0x411dd0ee4d2d2064 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.731659:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd800/0x411dd0ee4d2d2064 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.731772:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d205d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8b0 expref: 31 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.731793:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd800/0x411dd0ee4d2d2064 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8b0 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.731803:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71591d00) 00010000:00010000:3.0:1788521364.731807:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788521364.731810:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fd800, rc 0) 00000100:00100000:3.0:1788521364.733133:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+30:11940:x1875400201432832:12345-192.168.203.41@tcp:101:bash.0 Request processed in 1580us (2450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521364.733143:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 207 00000100:00100000:2.0:1788521364.742804:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521364.742960:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201433088 00000100:00100000:1.0:1788521364.742970:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201433088 00000100:00100000:1.0:1788521364.743046:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 208 00000100:00100000:1.0:1788521364.743058:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+30:11940:x1875400201433088:12345-192.168.203.41@tcp:36:bash.0 00010000:00010000:1.0:1788521364.743291:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d206b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.743310:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d206b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.743322:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d206b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788521364.743379:0:12956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:1.0:1788521364.743401:0:12956:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be4dbf89 reply state 000000004a9e63ac transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d206b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.743414:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d206b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.743421:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71591d00) 00010000:00010000:1.0:1788521364.743425:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788521364.743428:0:12956:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788521364.743466:0:12956:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:1.0:1788521364.743806:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+34:11940:x1875400201433088:12345-192.168.203.41@tcp:36:bash.0 Request processed in 749us (1011us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788521364.743832:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 208 00000020:00080000:1.0:1788521364.743837:0:12956:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788521364.757781:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521364.757933:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201433216 00000100:00100000:2.0:1788521364.757943:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201433216 00000100:00100000:2.0:1788521364.758019:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 209 00000100:00100000:2.0:1788521364.758029:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef766f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+34:11940:x1875400201433216:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:2.0:1788521364.758051:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521364.758071:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2072 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed8b7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.758148:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2072 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8b7 expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.758161:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2072 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8b7 expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521364.758181:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71591d00) 00010000:00010000:2.0:1788521364.758184:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788521364.758188:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7800, rc 0) 00000100:00100000:2.0:1788521364.758258:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef766f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+35:11940:x1875400201433216:12345-192.168.203.41@tcp:101:bash.0 Request processed in 230us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521364.758265:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 209 00000100:00100000:2.0:1788521364.773080:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521364.778174:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201433344 00000100:00100000:0.0:1788521364.778190:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201433344 00000100:00100000:0.0:1788521364.778272:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 66 00000100:00100000:0.0:1788521364.778284:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+7:11940:x1875400201433344:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:0.0:1788521364.778301:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521364.778322:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d2079 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed8be expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788521364.778357:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9aab90, atime: 0x6a9aab8f, ctime: 0x6a9aab90, blocks: 0x8 00010000:00010000:0.0:1788521364.778381:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=414s v=(0 0) 00010000:00010000:0.0:1788521364.778385:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521364.778393:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d2079 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8be expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.778409:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d2079 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8be expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.778423:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411800, rc 0) 00000100:00080000:3.0:1788521364.778589:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788521364.778692:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+8:11940:x1875400201433344:12345-192.168.203.41@tcp:101:bash.0 Request processed in 401us (5807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521364.778699:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 66 00000100:00100000:3.0:1788521364.785857:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521364.789655:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201433472 00000100:00100000:1.0:1788521364.789668:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201433472 00002000:00010000:1.0:1788521364.789765:0:8442:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:1.0:1788521364.789770:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fee43d22300 with x1875400201433472 ext(0->18446744073709551615) 00002000:00010000:1.0:1788521364.789782:0:8442:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fee43d22300. 00000100:00100000:1.0:1788521364.789824:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 5 00000100:00100000:1.0:1788521364.789834:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc75e887-507e-4861-8203-e266d82f5177+8:2395:x1875400201433472:12345-192.168.203.41@tcp:10:bash.0 00002000:00010000:1.0:1788521364.792066:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788521364.792076:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788521360 -> 1788521364 00002000:00010000:1.0:1788521364.792079:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1788521359 -> 1788521359 00002000:00010000:1.0:1788521364.792081:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788521360 -> 1788521364 00002000:00010000:1.0:1788521364.792084:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1788521364.792176:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc75e887-507e-4861-8203-e266d82f5177+9:2395:x1875400201433472:12345-192.168.203.41@tcp:10:bash.0 Request processed in 2339us (6324us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788521364.792188:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 5 00002000:00010000:1.0:1788521364.792201:0:8442:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:1.0:1788521364.792205:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fee43d22300 with x1875400201433472 ext(0->18446744073709551615) 00002000:00010000:1.0:1788521364.792213:0:8442:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fee43d22300. 00000100:00100000:2.0:1788521364.924878:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521364.925078:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201433600 00000100:00100000:0.0:1788521364.925089:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201433600 00000100:00100000:0.0:1788521364.925150:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 210 00000100:00100000:0.0:1788521364.925160:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+35:12430:x1875400201433600:12345-192.168.203.41@tcp:34:lfs.0 00010000:00010000:0.0:1788521364.925262:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d2080 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.925278:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d2080 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.925289:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d2080 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.925302:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d2087 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.925309:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d2087 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.925315:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d2087 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.925396:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d208e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.925405:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d208e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.925412:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d208e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788521364.925457:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d208e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.925467:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d2080 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.925482:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d2080 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.925488:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d2080 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.925494:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410400 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521364.925499:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d2080 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.925506:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d2080 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.925532:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:0.0:1788521364.925535:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521364.925540:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d2080 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.925546:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d2080 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.925560:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d2087 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.925566:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d2087 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.925571:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d2087 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.925576:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42411e00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521364.925585:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d2087 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.925593:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d2087 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.925601:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8fef74a77f00) 00010000:00010000:0.0:1788521364.925604:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521364.925607:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d2087 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.925613:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d2087 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.925628:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d208e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.925634:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d208e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.925640:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d208e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.925644:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521364.925647:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d208e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.925652:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d208e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.925660:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71591d00) 00010000:00010000:0.0:1788521364.925662:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521364.925671:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d208e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.925676:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d208e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521364.925752:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+35:12430:x1875400201433600:12345-192.168.203.41@tcp:34:lfs.0 Request processed in 593us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521364.925760:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 210 00000100:00100000:0.0:1788521364.973441:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521364.973543:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201433856 00000100:00100000:1.0:1788521364.973553:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201433856 00000100:00100000:1.0:1788521364.973615:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 211 00000100:00100000:1.0:1788521364.973625:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+35:12433:x1875400201433856:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:1.0:1788521364.973665:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521364.973684:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d2095 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed8c5 expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.973755:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d209c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.973770:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d209c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.973784:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d209c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.973799:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d20a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.973806:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d20a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.973813:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d20a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.973969:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d20aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.973978:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d20aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.973985:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d20aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521364.973996:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788521364.974078:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d209c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.974086:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d209c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.974092:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d209c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.974097:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434abe00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521364.974102:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d209c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.974110:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d209c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.974123:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:1.0:1788521364.974126:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521364.974130:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d209c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.974135:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d209c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.974148:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d20a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.974154:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d20a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.974159:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d20a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.974174:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434ab600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521364.974178:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d20a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.974184:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d20a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.974201:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8fef71ec0600) 00010000:00010000:1.0:1788521364.974204:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521364.974207:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d20a3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.974213:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d20a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.974253:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d2095 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8c5 expref: 38 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.974266:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d20aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8c5 expref: 37 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521364.974272:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71591d00) 00010000:00010000:1.0:1788521364.974274:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788521364.974277:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434aaa00, rc 0) 00000100:00100000:1.0:1788521364.974345:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+37:12433:x1875400201433856:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 720us (912us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1788521364.974353:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 211 00000100:00100000:3.0:1788521364.977016:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521364.977297:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201433984 00000100:00100000:0.0:1788521364.977307:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201433984 00000100:00100000:0.0:1788521364.977370:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 212 00000100:00100000:0.0:1788521364.977380:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+37:12433:x1875400201433984:12345-192.168.203.41@tcp:54:lfs.0 00010000:00010000:0.0:1788521364.977455:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d20b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.977473:0:9815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d204f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8a9 expref: 37 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.977483:0:9815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d20b8 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.977516:0:9815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d204f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8a9 expref: 37 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.977530:0:9815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d204f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8a9 expref: 37 pid: 6520 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521364.977544:0:9815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e28a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9815:1875400222465792:192.168.203.41@tcp:104: 00000100:00100000:0.0:1788521364.977643:0:9815:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef74a80240 going to sleep for 11 seconds 00000100:00100000:3.0:1788521364.982109:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521364.982248:0:9815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e28a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9815:1875400222465792:192.168.203.41@tcp:104: 00010000:00010000:0.0:1788521364.982277:0:9815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d20b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521364.988170:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201434240 00000100:00100000:1.0:1788521364.988214:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201434240 00000100:00100000:1.0:1788521364.988291:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 52 00000100:00100000:1.0:1788521364.988302:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+38:9947:x1875400201434240:12345-192.168.203.41@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788521364.990516:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+39:9947:x1875400201434240:12345-192.168.203.41@tcp:35:ldlm_bl.0 Request processed in 2206us (8407us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788521364.990529:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 52 00000100:00100000:1.0:1788521364.993693:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521364.993989:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201434368 00000100:00100000:0.0:1788521364.994000:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201434368 00010000:00010000:0.0:1788521364.994043:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d204f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8a9 expref: 39 pid: 6520 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521364.994085:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 93 00000100:00100000:0.0:1788521364.994095:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58341180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+39:2396:x1875400201434368:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521364.994113:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521364.994120:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d204f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8a9 expref: 39 pid: 6520 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.994134:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d204f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8a9 expref: 39 pid: 6520 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.994156:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d204f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8a9 expref: 39 pid: 6520 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.994174:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71591d00) 00010000:00010000:0.0:1788521364.994179:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d20b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.994189:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d20b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.994227:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d20b8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521364.994408:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521364.994477:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58341180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+38:2396:x1875400201434368:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 383us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521364.994485:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 93 00010000:00010000:3.0:1788521364.995629:0:9815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d20b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.995641:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d20b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.995680:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d20b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.995687:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d20b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.995694:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d20b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.995700:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521364.995704:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d20b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.995711:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d20b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.995723:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71591d00) 00010000:00010000:3.0:1788521364.995726:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788521364.995729:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d20b8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521364.995736:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d20b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521364.995816:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+37:12433:x1875400201433984:12345-192.168.203.41@tcp:54:lfs.0 Request processed in 18436us (18808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521364.995825:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 212 00000100:00100000:1.0:1788521365.003206:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521365.003284:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201434624 00000100:00100000:0.0:1788521365.003293:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201434624 00000100:00100000:0.0:1788521365.003344:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 53 00000100:00100000:0.0:1788521365.003353:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58342d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+37:12433:x1875400201434624:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:0.0:1788521365.003558:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58342d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+38:12433:x1875400201434624:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 205us (370us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788521365.003566:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 53 00000100:00100000:2.0:1788521365.125282:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521365.125386:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201434880 00000100:00100000:1.0:1788521365.125395:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201434880 00000100:00100000:1.0:1788521365.125460:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 213 00000100:00100000:1.0:1788521365.125470:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+38:12444:x1875400201434880:12345-192.168.203.41@tcp:101:cat.0 00010000:00010000:1.0:1788521365.125493:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521365.125512:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d20bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed8cc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.125588:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d20c6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.125604:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d20c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.125615:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d20c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.125630:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d20cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.125638:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d20cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.125658:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d20cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.125776:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d20d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.125785:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d20d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.125793:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d20d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521365.125803:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788521365.125872:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d20c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.125880:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d20c6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.125925:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d20c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.125931:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434ab600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521365.125935:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d20c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.125942:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d20c6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.125954:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:1.0:1788521365.126335:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521365.126349:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d20c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.126357:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d20c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.126370:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d20cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.126377:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d20cd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.126384:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d20cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.126390:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434abe00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521365.126394:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d20cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.126400:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d20cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.126409:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8fef71ec0600) 00010000:00010000:1.0:1788521365.126412:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521365.126415:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d20cd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.126421:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d20cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.126476:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d20bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8cc expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.126502:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d20d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8cc expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.126510:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71591d00) 00010000:00010000:1.0:1788521365.126513:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521365.126516:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434aa600, rc 0) 00000100:00100000:1.0:1788521365.126582:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+40:12444:x1875400201434880:12345-192.168.203.41@tcp:101:cat.0 Request processed in 1112us (1307us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1788521365.126590:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 213 00000100:00100000:2.0:1788521365.136269:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521365.136384:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201435136 00000100:00100000:0.0:1788521365.136395:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201435136 00000100:00100000:0.0:1788521365.136456:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 54 00000100:00100000:0.0:1788521365.136466:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+40:12444:x1875400201435136:12345-192.168.203.41@tcp:35:cat.0 00000100:00100000:0.0:1788521365.136740:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+41:12444:x1875400201435136:12345-192.168.203.41@tcp:35:cat.0 Request processed in 274us (478us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788521365.136747:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 54 00000100:00100000:0.0:1788521365.176693:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521365.176824:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201435392 00000100:00100000:2.0:1788521365.176834:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201435392 00000100:00100000:2.0:1788521365.176915:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 214 00000100:00100000:2.0:1788521365.176925:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+41:12445:x1875400201435392:12345-192.168.203.41@tcp:36:rm.0 00010000:00010000:2.0:1788521365.176991:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1788521365.177019:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2072 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8b7 expref: 41 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.177040:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa600/0x411dd0ee4d2d20d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8cc expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.177075:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aaa00/0x411dd0ee4d2d20aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8c5 expref: 39 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.177087:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd800/0x411dd0ee4d2d2064 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8b0 expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.177099:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71591d00) 00010000:00010000:2.0:1788521365.177104:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521365.177126:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d20e2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.177138:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d20e2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.177147:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d20e2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.177161:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d20e9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.177167:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d20e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.177173:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d20e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.177459:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d20f0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.177469:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d20f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.177485:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d20f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788521365.177696:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1788521365.177706:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 415243821866ns, next at 416243819592ns, rc = 0 00010000:00010000:2.0:1788521365.178112:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d20f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.178123:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d20f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.178133:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d20f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.178140:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d20f7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.178147:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d20f7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.178154:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d20f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.178177:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521365.178207:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d20f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.178214:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d20f0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.178221:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d20f0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.178235:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7000 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521365.178240:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d20f0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.178248:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d20f0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.178259:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71591d00) 00010000:00010000:2.0:1788521365.178262:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788521365.178266:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d20f0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.178272:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d20f0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.178290:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d20e2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.178296:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d20e2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.178302:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d20e2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.178307:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521365.178310:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d20e2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.178316:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d20e2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.178333:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:2.0:1788521365.178336:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521365.178339:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d20e2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.178345:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d20e2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788521365.178354:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a356e140 reply state 000000005d5f7151 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d20e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.178364:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d20e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.178371:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8fef71591a00) 00010000:00010000:2.0:1788521365.178373:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788521365.178376:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788521365.178610:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+39:12445:x1875400201435392:12345-192.168.203.41@tcp:36:rm.0 Request processed in 1682us (1922us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788521365.178619:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 214 00010000:00010000:1.0:1788521365.178703:0:13735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521365.178710:0:13735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d20f7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.178717:0:13735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6e00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:1.0:1788521365.178720:0:13735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d20f7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.178727:0:13735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d20f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.178737:0:13735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71591d00) 00010000:00010000:1.0:1788521365.178740:0:13735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788521365.178743:0:13735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d20f7 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.178748:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d20f7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.178758:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521365.178767:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521365.178769:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521365.226159:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521365.226536:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201435648 00000100:00100000:3.0:1788521365.226549:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201435648 00000100:00100000:3.0:1788521365.226624:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 215 00000100:00100000:3.0:1788521365.226636:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+39:12451:x1875400201435648:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:3.0:1788521365.226676:0:9815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521365.226877:0:9815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d20fe lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed8d3 expref: -99 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.227137:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd200/0x411dd0ee4d2d2105 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.227154:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd200/0x411dd0ee4d2d2105 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.227167:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd200/0x411dd0ee4d2d2105 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.227178:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d210c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.227185:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d210c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.227213:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d210c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788521365.228022:0:9815:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788521365.228359:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d2113 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.228374:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d2113 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.228469:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d2113 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.228511:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd200/0x411dd0ee4d2d2105 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.228519:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd200/0x411dd0ee4d2d2105 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.228526:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd200/0x411dd0ee4d2d2105 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.228532:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef413fd200 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521365.228537:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd200/0x411dd0ee4d2d2105 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.228545:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd200/0x411dd0ee4d2d2105 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.228560:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:3.0:1788521365.228563:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521365.228569:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd200/0x411dd0ee4d2d2105 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.228576:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd200/0x411dd0ee4d2d2105 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788521365.228595:0:9815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd0e291f reply state 00000000a3e0bf07 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d210c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.228606:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d210c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.228620:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8fef71591a00) 00010000:00010000:3.0:1788521365.228622:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788521365.228626:0:9815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788521365.228663:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d20fe lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8d3 expref: 42 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.228678:0:9815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d2113 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8d3 expref: 41 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.228877:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef76505c00) 00010000:00010000:3.0:1788521365.228880:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521365.228947:0:9815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fce00, rc 0) 00000100:00100000:3.0:1788521365.229165:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+42:12451:x1875400201435648:12345-192.168.203.41@tcp:101:bash.0 Request processed in 2529us (3019us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788521365.229253:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 215 00000100:00100000:0.0:1788521365.238952:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521365.239240:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201435776 00000100:00100000:2.0:1788521365.239252:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201435776 00000100:00100000:2.0:1788521365.239325:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 67 00000100:00100000:2.0:1788521365.239336:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+7:2396:x1875400201435776:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:2.0:1788521365.239354:0:8875:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521365.239372:0:8875:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003663fef7/0x411dd0ee4d2d2121 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed8da expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788521365.239416:0:8875:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788521365.239435:0:8875:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=415s v=(0 0) 00010000:00010000:2.0:1788521365.239440:0:8875:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521365.239449:0:8875:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003663fef7/0x411dd0ee4d2d2121 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8da expref: 8 pid: 8875 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.239469:0:8875:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003663fef7/0x411dd0ee4d2d2121 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8da expref: 8 pid: 8875 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.239483:0:8875:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7600, rc 0) 00000100:00100000:2.0:1788521365.239542:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+8:2396:x1875400201435776:12345-192.168.203.41@tcp:101:bash.0 Request processed in 208us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521365.239550:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 67 00000100:00080000:3.0:1788521365.240141:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521365.243066:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521365.243213:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201435904 00000100:00100000:1.0:1788521365.243222:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201435904 00000100:00100000:1.0:1788521365.243280:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 68 00000100:00100000:1.0:1788521365.243290:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+8:12451:x1875400201435904:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:1.0:1788521365.243308:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521365.243325:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000101ea398/0x411dd0ee4d2d2128 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed8e1 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.243354:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003663fef7/0x411dd0ee4d2d2121 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8da expref: 9 pid: 8875 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.243364:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521365.243369:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521365.243375:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000101ea398/0x411dd0ee4d2d2128 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8e1 expref: 9 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.243406:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003663fef7/0x411dd0ee4d2d2121 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8da expref: 9 pid: 8875 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.243421:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003663fef7/0x411dd0ee4d2d2121 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8da expref: 9 pid: 8875 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521365.243435:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58340380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8434:1875400222465920:192.168.203.41@tcp:104: 00000100:00100000:1.0:1788521365.243528:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef51dce900 going to sleep for 11 seconds 00000100:00100000:1.0:1788521365.251150:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58340380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8434:1875400222465920:192.168.203.41@tcp:104: 00010000:00010000:1.0:1788521365.251211:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000101ea398/0x411dd0ee4d2d2128 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8e1 expref: 9 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.251233:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434aa200, rc 0) 00000100:00100000:1.0:1788521365.251293:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+9:12451:x1875400201435904:12345-192.168.203.41@tcp:101:bash.0 Request processed in 8004us (8236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521365.251301:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 68 00000100:00100000:0.0:1788521365.252719:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521365.253230:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201436032 00000100:00100000:1.0:1788521365.253239:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201436032 00010000:00010000:1.0:1788521365.253277:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003663fef7/0x411dd0ee4d2d2121 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8da expref: 9 pid: 8875 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521365.253316:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 94 00000100:00100000:1.0:1788521365.253325:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4e7e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+9:2396:x1875400201436032:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521365.253340:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521365.253362:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003663fef7/0x411dd0ee4d2d2121 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8da expref: 9 pid: 8875 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.253377:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003663fef7/0x411dd0ee4d2d2121 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8da expref: 9 pid: 8875 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.253399:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003663fef7/0x411dd0ee4d2d2121 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8da expref: 9 pid: 8875 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.253415:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521365.253433:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521365.253442:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000101ea398/0x411dd0ee4d2d2128 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8e1 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.253453:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000101ea398/0x411dd0ee4d2d2128 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8e1 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.253492:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000101ea398/0x411dd0ee4d2d2128 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8e1 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521365.253506:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58340380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6505:1875400222466048:192.168.203.41@tcp:105: 00000100:00100000:1.0:1788521365.253595:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef51dce900 going to sleep for 11 seconds 00000100:00100000:0.0:1788521365.259163:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521365.259265:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201436288 00000100:00100000:3.0:1788521365.259275:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201436288 00000100:00100000:3.0:1788521365.259330:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 55 00000100:00100000:3.0:1788521365.259341:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+42:12451:x1875400201436288:12345-192.168.203.41@tcp:35:bash.0 00000100:00100000:3.0:1788521365.259635:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+43:12451:x1875400201436288:12345-192.168.203.41@tcp:35:bash.0 Request processed in 295us (480us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788521365.259643:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 55 00000100:00100000:1.0:1788521365.259771:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58340380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6505:1875400222466048:192.168.203.41@tcp:105: 00010000:00010000:1.0:1788521365.259792:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521365.259813:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4e7e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+8:2396:x1875400201436032:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 6489us (7102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521365.259822:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 94 00000100:00100000:2.0:1788521365.447590:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521365.447694:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201436416 00000100:00100000:1.0:1788521365.447704:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201436416 00000100:00100000:1.0:1788521365.447766:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 216 00000100:00100000:1.0:1788521365.447777:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+43:12467:x1875400201436416:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:1.0:1788521365.447806:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521365.447825:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d212f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed8e8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.447931:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d2136 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.447971:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d2136 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.447983:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d2136 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521365.448031:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788521365.448035:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788521365.448058:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d2136 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.448081:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d212f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8e8 expref: 45 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.448101:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d2136 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8e8 expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.448110:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:1.0:1788521365.448113:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788521365.448117:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434ab600, rc 0) 00000100:00100000:1.0:1788521365.448182:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+44:12467:x1875400201436416:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 407us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521365.448197:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 216 00000100:00100000:0.0:1788521365.451248:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521365.452104:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201436672 00000100:00100000:2.0:1788521365.452115:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201436672 00000100:00100000:2.0:1788521365.452177:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 217 00000100:00100000:2.0:1788521365.452195:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+44:12467:x1875400201436672:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:2.0:1788521365.452215:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521365.452236:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d213d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed8ef expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.452340:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2144 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.452370:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2144 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.452381:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2144 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521365.452394:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788521365.452501:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d213d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8ef expref: 47 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.452519:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2144 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8ef expref: 46 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.452528:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef76505c00) 00010000:00010000:2.0:1788521365.452531:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521365.452534:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7600, rc 0) 00000100:00100000:2.0:1788521365.452603:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+46:12467:x1875400201436672:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 417us (1364us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1788521365.452610:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 217 00000100:00100000:2.0:1788521365.456994:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521365.457069:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521365.457150:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201436928 00000100:00100000:3.0:1788521365.457162:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201436928 00000100:00100000:3.0:1788521365.457221:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 218 00000100:00100000:3.0:1788521365.457232:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+46:12467:x1875400201436928:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:3.0:1788521365.457273:0:9815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521365.457295:0:9815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d2152 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed8f6 expref: -99 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.457400:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd200/0x411dd0ee4d2d2159 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.457416:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd200/0x411dd0ee4d2d2159 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.457429:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd200/0x411dd0ee4d2d2159 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521365.457441:0:9815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788521365.457545:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d2152 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8f6 expref: 49 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.457563:0:9815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd200/0x411dd0ee4d2d2159 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8f6 expref: 48 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.457570:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef76505c00) 00010000:00010000:3.0:1788521365.457573:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788521365.457576:0:9815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fd200, rc 0) 00000100:00100000:3.0:1788521365.457643:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+48:12467:x1875400201436928:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 413us (574us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1788521365.457650:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 218 00000100:00100000:0.0:1788521365.459358:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201437056 00000100:00100000:0.0:1788521365.459369:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201437056 00000100:00100000:0.0:1788521365.460097:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 17 00000100:00100000:0.0:1788521365.460111:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+48:2393:x1875400201437056:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521365.460126:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521365.460151:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2144 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8ef expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.460169:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef76505c00) 00010000:00010000:0.0:1788521365.460174:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521365.460242:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+47:2393:x1875400201437056:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 135us (3257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521365.460249:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 17 00000100:00100000:2.0:1788521365.466236:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521365.466447:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201437184 00000100:00100000:3.0:1788521365.466457:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201437184 00000100:00100000:3.0:1788521365.466515:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 69 00000100:00100000:3.0:1788521365.466539:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+8:2396:x1875400201437184:12345-192.168.203.41@tcp:1:lfs.0 00010000:00010000:3.0:1788521365.466585:0:8875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d315ae95/0x411dd0ee4d2d2167 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.466605:0:8875:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000101ea398/0x411dd0ee4d2d2128 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8e1 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.466614:0:8875:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521365.466618:0:8875:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521365.466623:0:8875:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d315ae95/0x411dd0ee4d2d2167 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.466660:0:8875:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000101ea398/0x411dd0ee4d2d2128 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8e1 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.466674:0:8875:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000101ea398/0x411dd0ee4d2d2128 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8e1 expref: 8 pid: 8434 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521365.466688:0:8875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c66300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8875:1875400222466176:192.168.203.41@tcp:104: 00000100:00100000:3.0:1788521365.466781:0:8875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788521365.481749:0:8875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c66300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8875:1875400222466176:192.168.203.41@tcp:104: 00010000:00010000:3.0:1788521365.481782:0:8875:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d315ae95/0x411dd0ee4d2d2167 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521365.482031:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521365.482347:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201437312 00000100:00100000:3.0:1788521365.482355:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201437312 00002000:00100000:3.0:1788521365.482412:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8fee43e80a80 x1875400201437312/t0(0) o4->fc75e887-507e-4861-8203-e266d82f5177@192.168.203.41@tcp:366/0 lens 504/0 e 0 to 0 dl 1788521376 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788521365.482422:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fee43e80a80 with x1875400201437312 ext(0->8) 00010000:00010000:3.0:1788521365.482430:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000101ea398/0x411dd0ee4d2d2128 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8e1 expref: 9 pid: 8434 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.482445:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000101ea398/0x411dd0ee4d2d2128 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8e1 expref: 9 pid: 8434 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788521365.482452:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8fee43e80a80 00000100:00100000:3.0:1788521365.482488:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 3 00000100:00100000:3.0:1788521365.482498:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc75e887-507e-4861-8203-e266d82f5177+9:2395:x1875400201437312:12345-192.168.203.41@tcp:4:lfs.0 00000001:00080000:1.0:1788521365.486049:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:3.0:1788521365.486052:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc75e887-507e-4861-8203-e266d82f5177+11:2395:x1875400201437312:12345-192.168.203.41@tcp:4:lfs.0 Request processed in 3536us (4002us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788521365.486076:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 3 00000001:00080000:1.0:1788521365.486077:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00002000:00100000:3.0:1788521365.486099:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8fee43e80a80 x1875400201437312/t4294967309(0) o4->fc75e887-507e-4861-8203-e266d82f5177@192.168.203.41@tcp:366/0 lens 504/448 e 0 to 0 dl 1788521376 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788521365.486112:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fee43e80a80 with x1875400201437312 ext(0->8) 00010000:00010000:3.0:1788521365.486126:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000101ea398/0x411dd0ee4d2d2128 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8e1 expref: 7 pid: 8434 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.486151:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000101ea398/0x411dd0ee4d2d2128 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8e1 expref: 7 pid: 8434 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788521365.486161:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8fee43e80a80 00000100:00100000:2.0:1788521365.497336:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521365.498780:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201437440 00000100:00100000:1.0:1788521365.498801:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201437440 00010000:00010000:1.0:1788521365.498869:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000101ea398/0x411dd0ee4d2d2128 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8e1 expref: 7 pid: 8434 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521365.499120:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 95 00000100:00100000:1.0:1788521365.499133:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+7:2396:x1875400201437440:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521365.499153:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788521365.499177:0:6505:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788521365.499181:0:6505:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788521364 00002000:00010000:1.0:1788521365.499184:0:6505:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788521364 00002000:00010000:1.0:1788521365.499197:0:6505:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788521364 00002000:00010000:1.0:1788521365.499200:0:6505:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788521365.499208:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000101ea398/0x411dd0ee4d2d2128 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8e1 expref: 7 pid: 8434 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.499226:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000101ea398/0x411dd0ee4d2d2128 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8e1 expref: 7 pid: 8434 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.499255:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000101ea398/0x411dd0ee4d2d2128 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8e1 expref: 7 pid: 8434 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.499279:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788521365.499284:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788521365.499292:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d315ae95/0x411dd0ee4d2d2167 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.499303:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d315ae95/0x411dd0ee4d2d2167 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.499361:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788521365.499418:0:8875:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d315ae95/0x411dd0ee4d2d2167 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.499429:0:8875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d315ae95/0x411dd0ee4d2d2167 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.499456:0:8875:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d315ae95/0x411dd0ee4d2d2167 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.499465:0:8875:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d315ae95/0x411dd0ee4d2d2167 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.499473:0:8875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d315ae95/0x411dd0ee4d2d2167 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.499482:0:8875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef413fda00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:3.0:1788521365.499487:0:8875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d315ae95/0x411dd0ee4d2d2167 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.499498:0:8875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d315ae95/0x411dd0ee4d2d2167 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.499512:0:8875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d315ae95/0x411dd0ee4d2d2167 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.499521:0:8875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d315ae95/0x411dd0ee4d2d2167 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521365.499661:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+6:2396:x1875400201437184:12345-192.168.203.41@tcp:1:lfs.0 Request processed in 33123us (33434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521365.499674:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 69 00000100:00100000:1.0:1788521365.500870:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2396:x1875400201437440:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1732us (3542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521365.500930:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 95 00000100:00100000:2.0:1788521365.516567:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521365.516929:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201437696 00000100:00100000:0.0:1788521365.516942:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201437696 00000100:00100000:0.0:1788521365.517211:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 56 00000100:00100000:0.0:1788521365.517224:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6d4a9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+47:12467:x1875400201437696:12345-192.168.203.41@tcp:35:lfs.0 00000004:00010000:0.0:1788521365.517307:0:6523:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd200/0x411dd0ee4d2d2159 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8f6 expref: 47 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788521365.517621:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1788521365.517657:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788521365.523381:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:0.0:1788521365.524773:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d216e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.524803:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d2113 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8d3 expref: 51 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.524833:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d216e lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.524904:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d2113 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8d3 expref: 51 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.524925:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d2113 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8d3 expref: 51 pid: 9815 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521365.524944:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e28380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1875400222466304:192.168.203.41@tcp:104: 00000100:00100000:0.0:1788521365.525071:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef74a803c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521365.527749:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521365.528110:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201437824 00000100:00100000:1.0:1788521365.528121:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201437824 00010000:00010000:1.0:1788521365.528173:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d2113 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8d3 expref: 52 pid: 9815 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521365.528241:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 96 00000100:00100000:1.0:1788521365.528253:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+52:2395:x1875400201437824:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521365.528273:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521365.528281:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d2113 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8d3 expref: 52 pid: 9815 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.528297:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d2113 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8d3 expref: 52 pid: 9815 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.528325:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef76505c00) 00010000:00010000:1.0:1788521365.528333:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d216e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.528345:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d216e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.528354:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d216e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.528398:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521365.528476:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+52:2395:x1875400201437824:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 224us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521365.528484:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 96 00010000:00010000:0.0:1788521365.530277:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fce00/0x411dd0ee4d2d2113 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8d3 expref: 51 pid: 9815 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521365.530309:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e28380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1875400222466304:192.168.203.41@tcp:104: 00010000:00010000:0.0:1788521365.530339:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d216e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.530351:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d216e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.530357:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d216e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788521365.530506:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:0.0:1788521365.530655:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1788521365.530776:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e28380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1875400222466432:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788521365.530877:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521365.531248:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222466432 00000100:00100000:2.0:1788521365.531258:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222466432 00000100:00100000:2.0:1788521365.531332:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788521365.531352:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6523:x1875400222466432:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788521365.531454:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6523:x1875400222466432:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 105us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521365.531462:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788521365.532219:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef74a80f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788521365.532253:0:6523:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:0.0:1788521365.532260:0:6523:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:0.0:1788521365.532284:0:6523:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fef7f075180, transno 4294967308 00000100:00100000:0.0:1788521365.532311:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e28380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1875400222466432:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788521365.532506:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:0.0:1788521365.532593:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e28380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1875400222466560:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788521365.532656:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521365.532680:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef74a80240 going to sleep for 11 seconds 00000100:00100000:2.0:1788521365.533286:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222466560 00000100:00100000:2.0:1788521365.533296:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222466560 00000100:00100000:2.0:1788521365.533359:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788521365.533369:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1875400222466560:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788521365.533561:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6523:x1875400222466560:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 193us (904us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788521365.533569:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788521365.534270:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e28380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1875400222466560:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788521365.534353:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:0.0:1788521365.534407:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d216e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.534418:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d216e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.534425:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d216e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.534431:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410000 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521365.534437:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d216e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.534446:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d216e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.534466:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef76505c00) 00010000:00010000:0.0:1788521365.534486:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788521365.534493:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d216e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.534500:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d216e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788521365.534628:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788521365.534704:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1788521365.534716:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 415600832047ns, next at 416600829614ns, rc = 0 00000001:00080000:0.0:1788521365.534723:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:0.0:1788521365.534750:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef76505c00) 00010000:00010000:0.0:1788521365.534753:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788521365.534761:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fd200/0x411dd0ee4d2d2159 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8f6 expref: 55 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521365.534928:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6d4a9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+54:12467:x1875400201437696:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 17706us (18376us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1788521365.534939:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 56 00000020:00080000:0.0:1788521365.534944:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788521365.545555:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521365.546056:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201437952 00000100:00100000:0.0:1788521365.546069:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201437952 00000100:00100000:0.0:1788521365.546882:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 219 00000100:00100000:0.0:1788521365.546924:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+54:12467:x1875400201437952:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:0.0:1788521365.546968:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521365.547004:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d2175 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed8fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.547078:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d2175 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8fd expref: 55 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.547116:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d2175 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8fd expref: 55 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.547138:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:0.0:1788521365.547142:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788521365.547146:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42410000, rc 0) 00000100:00100000:0.0:1788521365.547246:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+55:12467:x1875400201437952:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 328us (1703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521365.547253:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 219 00000100:00100000:2.0:1788521365.551562:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521365.551698:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201438208 00000100:00100000:1.0:1788521365.551716:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201438208 00000100:00100000:1.0:1788521365.551790:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 57 00000100:00100000:1.0:1788521365.551802:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+55:12467:x1875400201438208:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:1.0:1788521365.552442:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+56:12467:x1875400201438208:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 638us (892us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788521365.552451:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 57 00000100:00100000:3.0:1788521365.705336:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521365.706790:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201438336 00000100:00100000:1.0:1788521365.706807:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201438336 00000100:00100000:1.0:1788521365.706964:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 220 00000100:00100000:1.0:1788521365.706978:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71d39050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+56:12477:x1875400201438336:12345-192.168.203.41@tcp:34:lfs.0 00010000:00010000:1.0:1788521365.707085:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d217c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.707106:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d217c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.707121:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d217c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.707134:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d2183 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.707141:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d2183 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.707168:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d2183 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.707281:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d218a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.707292:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d218a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.707299:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d218a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788521365.707360:0:12956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d218a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.707379:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d217c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.707388:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d217c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.707396:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d217c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.707402:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa200 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521365.707408:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d217c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.707417:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d217c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.707433:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:1.0:1788521365.707442:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521365.707448:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d217c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.707456:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa200/0x411dd0ee4d2d217c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.707472:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d2183 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.707477:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d2183 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.707483:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d2183 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.707487:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434abe00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521365.707490:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d2183 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.707496:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d2183 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.707503:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8fef71591a00) 00010000:00010000:1.0:1788521365.707505:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521365.707508:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d2183 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.707513:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d2183 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.707523:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d218a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.707535:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d218a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.707540:0:12956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d218a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.707544:0:12956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521365.707547:0:12956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d218a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.707552:0:12956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d218a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.707559:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:1.0:1788521365.707561:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521365.707564:0:12956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d218a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.707569:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d218a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521365.709202:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71d39050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+56:12477:x1875400201438336:12345-192.168.203.41@tcp:34:lfs.0 Request processed in 2208us (3862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521365.709218:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 220 00010000:00010000:2.0:1788521365.720040:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521365.780539:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521365.780648:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201438592 00000100:00100000:1.0:1788521365.780664:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201438592 00000100:00100000:2.0:1788521365.780923:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 221 00000100:00100000:2.0:1788521365.780936:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+56:12480:x1875400201438592:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:2.0:1788521365.780958:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521365.780979:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2191 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed904 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.781050:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2198 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.781065:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2198 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.781078:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2198 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.781107:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d219f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.781116:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d219f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.781124:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d219f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.781245:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d21a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.781254:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d21a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.781261:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d21a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521365.781272:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788521365.781345:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2198 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.781353:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2198 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.781426:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2198 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.781432:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521365.781437:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2198 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.781454:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2198 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.781466:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:2.0:1788521365.781469:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521365.781473:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2198 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.781480:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2198 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.781494:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d219f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.781501:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d219f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.781507:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d219f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.781512:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6e00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521365.781515:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d219f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.781521:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d219f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.781528:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8fef71591a00) 00010000:00010000:2.0:1788521365.781530:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521365.781533:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d219f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.781550:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d219f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.781588:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2191 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed904 expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.781602:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d21a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed904 expref: 58 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.781609:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:2.0:1788521365.781611:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521365.781614:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7000, rc 0) 00000100:00100000:2.0:1788521365.781802:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+58:12480:x1875400201438592:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 868us (1276us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788521365.781810:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 221 00000100:00100000:3.0:1788521365.786152:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521365.787090:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201438720 00000100:00100000:0.0:1788521365.787108:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201438720 00000100:00100000:0.0:1788521365.787220:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 222 00000100:00100000:0.0:1788521365.787233:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+58:12480:x1875400201438720:12345-192.168.203.41@tcp:54:lfs.0 00010000:00010000:0.0:1788521365.787330:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d21b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.787351:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d21b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.787366:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d21b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.787413:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d21b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.787421:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d21b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.787451:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d21b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.787458:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410400 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521365.787463:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d21b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.787472:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d21b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.787488:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:0.0:1788521365.787492:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788521365.787498:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d21b4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.787505:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d21b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521365.787605:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+58:12480:x1875400201438720:12345-192.168.203.41@tcp:54:lfs.0 Request processed in 374us (1462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521365.787624:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 222 00000100:00100000:3.0:1788521365.795290:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521365.795453:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201438976 00000100:00100000:1.0:1788521365.795466:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201438976 00000100:00100000:1.0:1788521365.795536:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 58 00000100:00100000:1.0:1788521365.795547:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+58:12480:x1875400201438976:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:1.0:1788521365.796032:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+59:12480:x1875400201438976:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 486us (757us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1788521365.796041:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 58 00000100:00100000:2.0:1788521365.880391:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521365.881362:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201439232 00000100:00100000:0.0:1788521365.881373:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201439232 00000100:00100000:0.0:1788521365.881438:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 223 00000100:00100000:0.0:1788521365.881448:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+59:12490:x1875400201439232:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:0.0:1788521365.881471:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521365.881474:0:12956:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788521365.881499:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d2136 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8e8 expref: 59 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.881537:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:0.0:1788521365.881543:0:12956:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521365.881557:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d21bb lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed90b expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.881661:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d21c2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.881676:0:12956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d21a6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed904 expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.881686:0:12956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d21c2 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.881717:0:12956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d21a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed904 expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.881731:0:12956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d21a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed904 expref: 59 pid: 6520 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521365.881745:0:12956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e29500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12956:1875400222466688:192.168.203.41@tcp:104: 00000100:00100000:0.0:1788521365.881847:0:12956:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef7a431a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521365.886467:0:12956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e29500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12956:1875400222466688:192.168.203.41@tcp:104: 00010000:00010000:0.0:1788521365.886496:0:12956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d21c2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521365.886719:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521365.886989:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201439360 00000100:00100000:1.0:1788521365.886997:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201439360 00010000:00010000:1.0:1788521365.887034:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d21a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed904 expref: 60 pid: 6520 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521365.887123:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 97 00000100:00100000:1.0:1788521365.887133:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+60:2396:x1875400201439360:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521365.887147:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521365.887154:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d21a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed904 expref: 60 pid: 6520 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.887180:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d21a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed904 expref: 60 pid: 6520 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.888329:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d21a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed904 expref: 60 pid: 6520 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.888348:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:1.0:1788521365.888355:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d21c2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.888365:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d21c2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.888373:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d21c2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521365.888412:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521365.888471:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+59:2396:x1875400201439360:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1338us (1752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521365.888481:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 97 00010000:00010000:2.0:1788521365.888544:0:12956:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d21c2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.888553:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d21c2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521365.888571:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788521365.888690:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d21bb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed90b expref: 60 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.888708:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d21c2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed90b expref: 59 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.888723:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:2.0:1788521365.888726:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788521365.888729:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411e00, rc 0) 00000100:00100000:2.0:1788521365.888755:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+59:12490:x1875400201439232:12345-192.168.203.41@tcp:101:bash.0 Request processed in 7309us (8374us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788521365.888763:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 223 00000100:00100000:3.0:1788521365.891907:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521365.892315:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201439488 00000100:00100000:2.0:1788521365.892328:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201439488 00000100:00100000:2.0:1788521365.892394:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 224 00000100:00100000:2.0:1788521365.892403:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+59:12490:x1875400201439488:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:2.0:1788521365.892426:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521365.892446:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef4167fa00/0x411dd0ee4d2d21d0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed912 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.892479:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef4167f800/0x411dd0ee4d2d21d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.892494:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef4167f800/0x411dd0ee4d2d21d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.892505:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef4167f800/0x411dd0ee4d2d21d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.892611:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef4167fa00/0x411dd0ee4d2d21d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed912 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.892630:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef4167f800/0x411dd0ee4d2d21d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed912 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.892644:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:2.0:1788521365.892648:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788521365.892651:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef4167f800, rc 0) 00000100:00100000:2.0:1788521365.892719:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+60:12490:x1875400201439488:12345-192.168.203.41@tcp:101:bash.0 Request processed in 316us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521365.892726:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 224 00000100:00100000:3.0:1788521365.897101:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521365.898569:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201439744 00000100:00100000:0.0:1788521365.898741:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201439744 00000100:00100000:0.0:1788521365.898822:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 225 00000100:00100000:0.0:1788521365.898834:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+60:12490:x1875400201439744:12345-192.168.203.41@tcp:36:bash.0 00010000:00010000:0.0:1788521365.899867:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d21de lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.899938:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d21de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.899954:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d21de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788521365.900023:0:9815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:0.0:1788521365.900049:0:9815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1599782 reply state 000000009fbca36d transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d21de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.900064:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d21de lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.900072:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:0.0:1788521365.900076:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788521365.900080:0:9815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788521365.900226:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+63:12490:x1875400201439744:12345-192.168.203.41@tcp:36:bash.0 Request processed in 1389us (3266us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788521365.900235:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 225 00000020:00080000:0.0:1788521365.900241:0:9815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788521365.902771:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521365.908178:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201439872 00000100:00100000:2.0:1788521365.908274:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201439872 00000100:00100000:2.0:1788521365.908648:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 226 00000100:00100000:2.0:1788521365.908662:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+63:12490:x1875400201439872:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:2.0:1788521365.908696:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521365.908729:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef4167fc00/0x411dd0ee4d2d21e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed919 expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.908855:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d21ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.908872:0:12956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d21c2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed90b expref: 64 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.908902:0:12956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d21ec lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.908948:0:12956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d21c2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed90b expref: 64 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.908964:0:12956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d21c2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed90b expref: 64 pid: 12956 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521365.909016:0:12956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12956:1875400222466816:192.168.203.41@tcp:104: 00000100:00100000:2.0:1788521365.909151:0:12956:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef5240f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521365.913392:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521365.913572:0:12956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12956:1875400222466816:192.168.203.41@tcp:104: 00010000:00010000:0.0:1788521365.913610:0:12956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d21ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521365.915255:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201440000 00000100:00100000:3.0:1788521365.915278:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201440000 00010000:00010000:3.0:1788521365.915523:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d21c2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed90b expref: 65 pid: 12956 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521365.916782:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 98 00000100:00100000:3.0:1788521365.916804:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+65:2396:x1875400201440000:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521365.916826:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521365.916836:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d21c2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed90b expref: 65 pid: 12956 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.916853:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d21c2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed90b expref: 65 pid: 12956 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.916908:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d21c2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed90b expref: 65 pid: 12956 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.916950:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:3.0:1788521365.916957:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d21ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.916968:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d21ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.916978:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d21ec lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521365.917030:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521365.917108:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+64:2396:x1875400201440000:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 315us (3820us total) trans 0 rc 0/0 00010000:00010000:2.0:1788521365.917115:0:12956:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d21ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521365.917116:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 98 00010000:00010000:2.0:1788521365.917124:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d21ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521365.917204:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788521365.917210:0:12956:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788521365.917236:0:12956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d21ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.917277:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef4167fc00/0x411dd0ee4d2d21e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed919 expref: 64 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.917294:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d21ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed919 expref: 63 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521365.917415:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:2.0:1788521365.917420:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521365.917423:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7600, rc 0) 00000100:00100000:2.0:1788521365.917456:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+63:12490:x1875400201439872:12345-192.168.203.41@tcp:101:bash.0 Request processed in 8798us (14700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521365.917464:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 226 00000100:00100000:0.0:1788521365.921708:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521365.921918:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201440256 00000100:00100000:1.0:1788521365.921933:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201440256 00000100:00100000:1.0:1788521365.922004:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 59 00000100:00100000:1.0:1788521365.922016:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+63:12490:x1875400201440256:12345-192.168.203.41@tcp:35:bash.0 00000100:00100000:1.0:1788521365.924091:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+64:12490:x1875400201440256:12345-192.168.203.41@tcp:35:bash.0 Request processed in 2064us (2384us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1788521365.924116:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 59 00000100:00100000:1.0:1788521365.989790:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521365.989908:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201440384 00000100:00100000:0.0:1788521365.989921:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201440384 00000100:00100000:0.0:1788521365.990005:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 227 00000100:00100000:0.0:1788521365.990017:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58342680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+64:12496:x1875400201440384:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:0.0:1788521365.990048:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521365.990085:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d21f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed920 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.990169:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d21fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.990197:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d21fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.990214:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d21fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521365.990271:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788521365.990275:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788521365.990298:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d21fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.990331:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411c00/0x411dd0ee4d2d21f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed920 expref: 66 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.990352:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d21fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed920 expref: 65 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.990361:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:0.0:1788521365.990364:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788521365.990385:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42410a00, rc 0) 00000100:00100000:0.0:1788521365.990466:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58342680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+65:12496:x1875400201440384:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 450us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521365.990473:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 227 00000100:00100000:2.0:1788521365.996258:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521365.996543:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201440512 00000100:00100000:0.0:1788521365.996558:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201440512 00000100:00100000:0.0:1788521365.996638:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 228 00000100:00100000:0.0:1788521365.996651:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+65:12496:x1875400201440512:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:0.0:1788521365.996680:0:9815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521365.996710:0:9815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d2201 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed927 expref: -99 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.996802:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d2208 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.996821:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d2208 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.996835:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d2208 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.996849:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d220f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.996858:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d220f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.996865:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d220f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.997026:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c000/0x411dd0ee4d2d2216 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.997042:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c000/0x411dd0ee4d2d2216 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.997051:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c000/0x411dd0ee4d2d2216 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521365.997461:0:9815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788521365.997466:0:9815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788521365.997493:0:9815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c000/0x411dd0ee4d2d2216 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.997508:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c000/0x411dd0ee4d2d2216 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.997518:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d2208 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.997526:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d2208 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.997533:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d2208 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.997539:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410400 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521365.997545:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d2208 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.997554:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d2208 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.997570:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:0.0:1788521365.997574:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521365.997591:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d2208 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.997598:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410400/0x411dd0ee4d2d2208 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.997613:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d220f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.997620:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d220f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.997627:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d220f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.997632:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40030e00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521365.997636:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d220f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.997641:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d220f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.997651:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8fef71591a00) 00010000:00010000:0.0:1788521365.997653:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521365.997657:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d220f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.997663:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d220f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.997700:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411e00/0x411dd0ee4d2d2201 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed927 expref: 67 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.997729:0:9815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c000/0x411dd0ee4d2d2216 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed927 expref: 66 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521365.997738:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:0.0:1788521365.997741:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788521365.997743:0:9815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef7f12c000, rc 0) 00000100:00100000:0.0:1788521365.997976:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+66:12496:x1875400201440512:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 1326us (1731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521365.997985:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 228 00000100:00100000:3.0:1788521366.003580:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521366.003754:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201440896 00000100:00100000:1.0:1788521366.003767:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201440896 00000100:00100000:1.0:1788521366.003873:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 18 00000100:00100000:1.0:1788521366.003917:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+66:2394:x1875400201440896:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521366.003939:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521366.004535:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c000/0x411dd0ee4d2d2216 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed927 expref: 66 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.004558:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:1.0:1788521366.004564:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521366.004645:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+65:2394:x1875400201440896:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 762us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521366.004654:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 18 00000100:00080000:3.0:1788521366.005820:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521366.007348:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521366.007453:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201440768 00000100:00100000:2.0:1788521366.007464:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201440768 00000100:00100000:2.0:1788521366.007548:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 229 00000100:00100000:2.0:1788521366.007560:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+65:12496:x1875400201440768:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:2.0:1788521366.007588:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521366.007618:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d221d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed92e expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.007765:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d2224 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.007784:0:12956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d21ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed919 expref: 66 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.007795:0:12956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d2224 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.007836:0:12956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d21ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed919 expref: 66 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.007852:0:12956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d21ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed919 expref: 66 pid: 12956 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521366.007869:0:12956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e81880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12956:1875400222466944:192.168.203.41@tcp:104: 00000100:00100000:2.0:1788521366.008022:0:12956:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef5240f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788521366.012726:0:12956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e81880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12956:1875400222466944:192.168.203.41@tcp:104: 00010000:00010000:0.0:1788521366.012766:0:12956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d2224 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521366.014098:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521366.014483:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201441024 00000100:00100000:0.0:1788521366.014495:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201441024 00010000:00010000:0.0:1788521366.014556:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d21ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed919 expref: 67 pid: 12956 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521366.014601:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 99 00000100:00100000:0.0:1788521366.014613:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4e7e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+67:2396:x1875400201441024:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521366.014632:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521366.014639:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d21ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed919 expref: 67 pid: 12956 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.014654:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d21ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed919 expref: 67 pid: 12956 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.014697:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d21ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed919 expref: 67 pid: 12956 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.014717:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:0.0:1788521366.014723:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d2224 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.014736:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d2224 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.014745:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d2224 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.014787:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521366.014868:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4e7e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+66:2396:x1875400201441024:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 256us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521366.014875:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 99 00010000:00010000:1.0:1788521366.015296:0:12956:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d2224 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.015307:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d2224 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521366.015331:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788521366.015510:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d221d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed92e expref: 67 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.015530:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d2224 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed92e expref: 66 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.015539:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:1.0:1788521366.015542:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788521366.015546:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b6e00, rc 0) 00000100:00100000:1.0:1788521366.015593:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+66:12496:x1875400201440768:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 8036us (8258us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788521366.015601:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 229 00000100:00100000:3.0:1788521366.019669:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521366.019771:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201441280 00000100:00100000:1.0:1788521366.019783:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201441280 00000100:00100000:1.0:1788521366.019864:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 19 00000100:00100000:1.0:1788521366.019877:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+66:12496:x1875400201441280:12345-192.168.203.41@tcp:103:lfs.0 00010000:00010000:1.0:1788521366.019945:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521366.019990:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410000/0x411dd0ee4d2d2175 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8fd expref: 66 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.020017:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:1.0:1788521366.020046:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521366.020130:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc75e887-507e-4861-8203-e266d82f5177+65:12496:x1875400201441280:12345-192.168.203.41@tcp:103:lfs.0 Request processed in 255us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521366.020138:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 19 00000100:00100000:3.0:1788521366.022416:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521366.022590:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201441408 00000100:00100000:2.0:1788521366.022603:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201441408 00000100:00100000:2.0:1788521366.022672:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 230 00000100:00100000:2.0:1788521366.022685:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+65:12496:x1875400201441408:12345-192.168.203.41@tcp:58:lfs.0 00010000:00010000:2.0:1788521366.022863:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2232 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.022920:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2232 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.022934:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2232 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788521366.023203:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1788521366.023492:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+65:12496:x1875400201441408:12345-192.168.203.41@tcp:58:lfs.0 Request processed in 807us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521366.023502:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 230 00000100:00100000:3.0:1788521366.026477:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521366.026594:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201441536 00000100:00100000:0.0:1788521366.026607:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201441536 00000100:00100000:0.0:1788521366.026681:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 231 00000100:00100000:0.0:1788521366.026692:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+65:12496:x1875400201441536:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:0.0:1788521366.026718:0:9815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521366.026744:0:9815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d600/0x411dd0ee4d2d2239 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed935 expref: -99 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.026811:0:9815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2232 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.026848:0:9815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d600/0x411dd0ee4d2d2239 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed935 expref: 66 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.026870:0:9815:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2232 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.026924:0:9815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d600/0x411dd0ee4d2d2239 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed935 expref: 66 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.026941:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:0.0:1788521366.026953:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788521366.026958:0:9815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d600/0x411dd0ee4d2d2239 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed935 expref: 66 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.026966:0:9815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef7f12d600, rc 0) 00000100:00100000:0.0:1788521366.027028:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+66:12496:x1875400201441536:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 338us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521366.027036:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 231 00000100:00100000:3.0:1788521366.632516:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521366.632582:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521366.632605:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201441664 00000100:00100000:1.0:1788521366.632620:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201441664 00000100:00100000:1.0:1788521366.632701:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 395 00000100:00100000:1.0:1788521366.632714:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2393:x1875400201441664:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521366.632815:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2393:x1875400201441664:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 103us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521366.632824:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 395 00000100:00100000:0.0:1788521366.633098:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201441792 00000100:00100000:0.0:1788521366.633105:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201441792 00000100:00100000:0.0:1788521366.633176:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 351 00000100:00100000:0.0:1788521366.633196:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+5:2393:x1875400201441792:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521366.633249:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+5:2393:x1875400201441792:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 56us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521366.633256:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 351 00000100:00080000:3.0:1788521366.634760:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788521366.634971:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521366.635014:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521366.635050:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521366.635086:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521366.635253:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201442048 00000100:00100000:3.0:1788521366.635262:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201442048 00000100:00100000:3.0:1788521366.635346:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201441920 00000100:00100000:3.0:1788521366.635350:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201441920 00000100:00100000:3.0:1788521366.635407:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 150 00000100:00100000:3.0:1788521366.635418:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58340700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+9:2394:x1875400201442048:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521366.635493:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58340700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+9:2394:x1875400201442048:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 77us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521366.635501:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 150 00000100:00100000:3.0:1788521366.635519:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 151 00000100:00100000:3.0:1788521366.635525:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a703850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+5:2394:x1875400201441920:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521366.635551:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a703850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+5:2394:x1875400201441920:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 27us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521366.635558:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 151 00000100:00100000:2.0:1788521366.636302:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201442304 00000100:00100000:2.0:1788521366.636310:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201442304 00000100:00100000:2.0:1788521366.636378:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201442176 00000100:00100000:2.0:1788521366.636383:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201442176 00000100:00100000:2.0:1788521366.636414:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 352 00000100:00100000:2.0:1788521366.636422:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58341c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2394:x1875400201442304:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521366.636471:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58341c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2394:x1875400201442304:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 50us (1456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521366.636478:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 352 00000100:00100000:2.0:1788521366.636493:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 353 00000100:00100000:2.0:1788521366.636499:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58340e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2394:x1875400201442176:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521366.636525:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58340e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2394:x1875400201442176:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 26us (1438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521366.636531:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 353 00000100:00080000:1.0:1788521366.636821:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788521366.636826:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788521366.636828:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788521366.669237:0:9967:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 416735349953ns, next at 417735346054ns, rc = 0 00000100:00100000:0.0:1788521366.669299:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788521366.669339:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222467072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521366.669437:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521366.669675:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222467072 00000100:00100000:3.0:1788521366.669687:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222467072 00000100:00100000:3.0:1788521366.669817:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788521366.669845:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875400222467072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788521366.669902:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788521366.669972:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875400222467072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521366.669981:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788521366.670055:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58343800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222467328:0@lo:400:kworker.0 00000100:00100000:0.0:1788521366.670101:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788521366.670127:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788521366.670131:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58341180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222467840:0@lo:400:kworker.0 00000100:00100000:1.0:1788521366.670148:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58341500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222467200:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788521366.670163:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521366.670203:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222468352:0@lo:400:kworker.0 00000100:00100000:1.0:1788521366.670208:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521366.670235:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58340000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222467712:0@lo:400:kworker.0 00000100:00100000:0.0:1788521366.670247:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521366.670275:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788521366.670276:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521366.670286:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58343100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222467456:0@lo:400:kworker.0 00000100:00100000:1.0:1788521366.670303:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58342d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222468224:0@lo:400:kworker.0 00000100:00100000:0.0:1788521366.670314:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521366.670339:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58340380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875400222467968:0@lo:400:kworker.0 00000100:00100000:1.0:1788521366.670340:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521366.670366:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222468736:0@lo:400:kworker.0 00000100:00100000:0.0:1788521366.670392:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521366.670414:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521366.670418:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875400222468480:0@lo:400:kworker.0 00000100:00100000:0.0:1788521366.670449:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521366.670473:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222467072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521366.670488:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222467328 00000100:00100000:1.0:1788521366.670495:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788521366.670505:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222467328 00000100:00100000:0.0:1788521366.670540:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1788521366.670548:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3645:x1875400222467328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521366.670594:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3645:x1875400222467328:12345-0@lo:400:kworker.0 Request processed in 47us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521366.670601:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1788521366.670632:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222467840 00000100:00100000:0.0:1788521366.670635:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222467840 00000100:00100000:0.0:1788521366.670669:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222467200 00000100:00100000:0.0:1788521366.670672:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222467200 00000100:00100000:0.0:1788521366.670687:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788521366.670693:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222467840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521366.670726:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222467840:12345-0@lo:400:kworker.0 Request processed in 34us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521366.670732:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788521366.670743:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788521366.670748:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6e536c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222467200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788521366.670772:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788521366.670804:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6e536c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222467200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521366.670811:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58340a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222467584:0@lo:400:kworker.0 00000100:00100000:0.0:1788521366.670812:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788521366.671255:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521366.671282:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222467584 00000100:00100000:0.0:1788521366.671290:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222467584 00000100:00100000:1.0:1788521366.671309:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58340700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875400222468096:0@lo:400:kworker.0 00000100:00100000:0.0:1788521366.671316:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788521366.671325:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222467584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521366.671362:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222467584:12345-0@lo:400:kworker.0 Request processed in 37us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521366.671367:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788521366.671408:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58343800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3645:1875400222467328:0@lo:400:kworker.0 00000100:00100000:0.0:1788521366.671421:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58341180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222467840:0@lo:400:kworker.0 00000100:00100000:0.0:1788521366.671448:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222467712 00000100:00100000:0.0:1788521366.671452:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222467712 00000100:00100000:0.0:1788521366.671481:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222467456 00000100:00100000:0.0:1788521366.671484:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222467456 00000100:00100000:0.0:1788521366.671507:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222467968 00000100:00100000:0.0:1788521366.671510:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222467968 00000100:00100000:0.0:1788521366.671534:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788521366.671541:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222467712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521366.671571:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222467712:12345-0@lo:400:kworker.0 Request processed in 31us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521366.671578:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788521366.671588:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222468480 00000100:00100000:0.0:1788521366.671591:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222468480 00000100:00100000:0.0:1788521366.671606:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788521366.671611:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222467456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521366.671642:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222467456:12345-0@lo:400:kworker.0 Request processed in 30us (1327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521366.671651:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788521366.671664:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1788521366.671671:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875400222467968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521366.671697:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521366.671727:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875400222468608:0@lo:400:kworker.0 00000100:00100000:0.0:1788521366.675132:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875400222467968:12345-0@lo:400:kworker.0 Request processed in 3446us (4725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521366.675151:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1788521366.675214:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222468096 00000100:00100000:0.0:1788521366.675226:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222468096 00000100:00100000:0.0:1788521366.675282:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788521366.675293:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875400222468480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521366.675394:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875400222468480:12345-0@lo:400:kworker.0 Request processed in 103us (4944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521366.675400:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788521366.675414:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788521366.675441:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875400222468096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521366.675477:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875400222468096:12345-0@lo:400:kworker.0 Request processed in 37us (3783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521366.675483:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788521366.677429:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58343100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222467456:0@lo:400:kworker.0 00000100:00100000:0.0:1788521366.677453:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58340380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875400222467968:0@lo:400:kworker.0 00000100:00100000:0.0:1788521366.677468:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875400222468480:0@lo:400:kworker.0 00000100:00100000:0.0:1788521366.677764:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222468352 00000100:00100000:0.0:1788521366.677773:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222468352 00000100:00100000:0.0:1788521366.678393:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222468224 00000100:00100000:0.0:1788521366.678399:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222468224 00000100:00080000:1.0:1788521366.678809:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788521366.678819:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788521366.678822:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521366.678863:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521366.678956:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58341500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222467200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788521366.678972:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58340000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222467712:0@lo:400:kworker.0 00000100:00100000:1.0:1788521366.678998:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58340a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222467584:0@lo:400:kworker.0 00000100:00100000:3.0:1788521366.679807:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222468608 00000100:00100000:3.0:1788521366.679821:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222468608 00000100:00100000:3.0:1788521366.679942:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788521366.679954:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875400222468608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521366.680067:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875400222468608:12345-0@lo:400:kworker.0 Request processed in 116us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521366.680075:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00010000:00080000:1.0:1788521366.683523:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef58340700 x1875400222468096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521366.683564:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58340700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875400222468096:0@lo:400:kworker.0 00000100:00080000:1.0:1788521366.683586:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788521366.683719:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee424e9c00 x1875400222468608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521366.683729:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875400222468608:0@lo:400:kworker.0 00000100:00100000:2.0:1788521366.686670:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222468736 00000100:00100000:2.0:1788521366.686692:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222468736 00000100:00100000:2.0:1788521366.686797:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788521366.686810:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1875400222468352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521366.687222:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1875400222468352:12345-0@lo:400:kworker.0 Request processed in 414us (16973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521366.687231:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788521366.687254:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788521366.687261:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222468224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521366.687303:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222468224:12345-0@lo:400:kworker.0 Request processed in 43us (16965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521366.687309:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788521366.687319:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788521366.687325:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222468736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521366.687353:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222468736:12345-0@lo:400:kworker.0 Request processed in 29us (16940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521366.687359:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788521366.687548:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222468352:0@lo:400:kworker.0 00000100:00080000:0.0:1788521366.687618:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788521366.687650:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58342d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222468224:0@lo:400:kworker.0 00000100:00100000:0.0:1788521366.687664:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222468736:0@lo:400:kworker.0 00000040:00080000:1.0:1788521366.733285:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788521366.733306:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788521366.733358:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1788521366.733368:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788521366.733510:0:13799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424e9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1875400222468864:192.168.203.41@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788521366.733597:0:13799:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef484bb180 going to sleep for 11 seconds 00010000:00010000:2.0:1788521366.734448:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521366.740378:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521366.740722:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201442432 00000100:00100000:2.0:1788521366.740735:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201442432 00000100:00100000:2.0:1788521366.740816:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 232 00000100:00100000:2.0:1788521366.740839:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+67:12498:x1875400201442432:12345-192.168.203.41@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788521366.740881:0:6520:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788521366.741067:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+67:12498:x1875400201442432:12345-192.168.203.41@tcp:53:lhsmtool_posix.0 Request processed in 229us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521366.741077:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 232 00000100:00100000:1.0:1788521366.745196:0:13799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424e9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1875400222468864:192.168.203.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788521366.750793:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521366.751161:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201442560 00000100:00100000:0.0:1788521366.751175:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201442560 00000100:00100000:0.0:1788521366.751259:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 233 00000100:00100000:0.0:1788521366.751270:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+66:12498:x1875400201442560:12345-192.168.203.41@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788521366.751343:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c600/0x411dd0ee4d2d2240 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.751361:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c600/0x411dd0ee4d2d2240 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.751373:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c600/0x411dd0ee4d2d2240 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.751404:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12ca00/0x411dd0ee4d2d2247 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.751412:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12ca00/0x411dd0ee4d2d2247 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.751418:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12ca00/0x411dd0ee4d2d2247 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.751440:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c400/0x411dd0ee4d2d224e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.751449:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c400/0x411dd0ee4d2d224e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.751455:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c400/0x411dd0ee4d2d224e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521366.751503:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788521366.751508:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788521366.751523:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c400/0x411dd0ee4d2d224e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.751534:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c600/0x411dd0ee4d2d2240 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.751541:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c600/0x411dd0ee4d2d2240 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.751548:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c600/0x411dd0ee4d2d2240 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.751563:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef7f12c600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521366.751567:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c600/0x411dd0ee4d2d2240 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.751575:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c600/0x411dd0ee4d2d2240 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.751587:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fee410f5900) 00010000:00010000:0.0:1788521366.751590:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521366.751595:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c600/0x411dd0ee4d2d2240 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.751601:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c600/0x411dd0ee4d2d2240 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.751614:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12ca00/0x411dd0ee4d2d2247 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.751620:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12ca00/0x411dd0ee4d2d2247 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.751626:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12ca00/0x411dd0ee4d2d2247 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.751632:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef7f12ca00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521366.751634:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12ca00/0x411dd0ee4d2d2247 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.751640:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12ca00/0x411dd0ee4d2d2247 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.751657:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8fef74a77300) 00010000:00010000:0.0:1788521366.751659:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521366.751662:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12ca00/0x411dd0ee4d2d2247 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.751668:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12ca00/0x411dd0ee4d2d2247 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.751683:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c400/0x411dd0ee4d2d224e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.751688:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c400/0x411dd0ee4d2d224e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.751693:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c400/0x411dd0ee4d2d224e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.751697:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef7f12c400 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521366.751700:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c400/0x411dd0ee4d2d224e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.751705:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c400/0x411dd0ee4d2d224e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.751712:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:0.0:1788521366.751714:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521366.751716:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c400/0x411dd0ee4d2d224e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.751721:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c400/0x411dd0ee4d2d224e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521366.751829:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+66:12498:x1875400201442560:12345-192.168.203.41@tcp:34:lhsmtool_posix.0 Request processed in 559us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521366.751837:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 233 00000100:00100000:0.0:1788521366.755413:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521366.755671:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201442816 00000100:00100000:1.0:1788521366.755688:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201442816 00000100:00100000:1.0:1788521366.755758:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 234 00000100:00100000:1.0:1788521366.755768:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+66:12498:x1875400201442816:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788521366.755789:0:9815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521366.755810:0:9815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d2255 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed93c expref: -99 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.755939:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d225c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.755966:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d225c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.755979:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d225c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521366.755990:0:9815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788521366.757267:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d225c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.757281:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d225c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.757305:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d225c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.757311:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434ab600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521366.757315:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d225c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.757323:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d225c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.757338:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:1.0:1788521366.757342:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788521366.757347:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d225c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.757353:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d225c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.757405:0:9815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d2255 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed93c expref: 68 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.757416:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fee410f5900) 00010000:00010000:1.0:1788521366.757419:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788521366.757423:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434abe00/0x411dd0ee4d2d2255 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed93c expref: 68 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.757432:0:9815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434abe00, rc 0) 00000100:00100000:1.0:1788521366.757508:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+67:12498:x1875400201442816:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 1740us (2116us total) trans 4294967505 rc 301/301 00000100:00100000:1.0:1788521366.757525:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 234 00000100:00100000:1.0:1788521366.766639:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521366.766855:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201442944 00000100:00100000:3.0:1788521366.766875:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201442944 00000100:00100000:3.0:1788521366.766996:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 235 00000100:00100000:3.0:1788521366.767010:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+67:12498:x1875400201442944:12345-192.168.203.41@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788521366.767059:0:12956:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788521366.767700:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+67:12498:x1875400201442944:12345-192.168.203.41@tcp:53:lhsmtool_posix.0 Request processed in 690us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521366.767710:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 235 00000100:00100000:3.0:1788521366.770238:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521366.770960:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201443200 00000100:00100000:2.0:1788521366.770975:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201443200 00000100:00100000:2.0:1788521366.771062:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 236 00000100:00100000:2.0:1788521366.771082:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+67:12498:x1875400201443200:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521366.771112:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521366.771116:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788521366.771164:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410a00/0x411dd0ee4d2d21fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed920 expref: 67 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.771199:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:2.0:1788521366.771206:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521366.771224:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d226a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed943 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788521366.771725:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:2.0:1788521366.772008:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2271 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.772027:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2271 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.772041:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2271 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.772114:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d226a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed943 expref: 69 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.772134:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2271 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed943 expref: 68 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.772172:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8fef71591800) 00010000:00010000:2.0:1788521366.772175:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521366.772189:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7800, rc 0) 00000100:00100000:2.0:1788521366.772274:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+68:12498:x1875400201443200:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 1192us (2048us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788521366.772283:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 236 00000100:00100000:0.0:1788521366.775620:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521366.776574:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201443456 00000100:00100000:1.0:1788521366.776589:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201443456 00000100:00100000:1.0:1788521366.776676:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 237 00000100:00100000:1.0:1788521366.776687:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+68:12498:x1875400201443456:12345-192.168.203.41@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788521366.776745:0:9815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521366.776771:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2271 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed943 expref: 68 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.776790:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8fef71591800) 00010000:00010000:1.0:1788521366.776800:0:9815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788521366.776819:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d227f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.776832:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d227f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.776842:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d227f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.776932:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d2286 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x475bcf26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.776940:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d2286 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x475bcf26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.776946:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d2286 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x475bcf26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.777002:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d227f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.777010:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d227f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.777016:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d227f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.778130:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434ab600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521366.778139:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d227f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.778149:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d227f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.778163:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:1.0:1788521366.778166:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521366.778171:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d227f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.778187:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434ab600/0x411dd0ee4d2d227f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.778202:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d2286 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x475bcf26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.778208:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d2286 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x475bcf26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.778215:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d2286 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x475bcf26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.778234:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521366.778238:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d2286 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x475bcf26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.778243:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d2286 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x475bcf26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.778251:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x475bcf26 (ffff8fef71ec0c00) 00010000:00010000:1.0:1788521366.778254:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521366.778257:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d2286 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x475bcf26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.778262:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa800/0x411dd0ee4d2d2286 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x475bcf26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521366.778671:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+67:12498:x1875400201443456:12345-192.168.203.41@tcp:36:lhsmtool_posix.0 Request processed in 1974us (3055us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788521366.778686:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 237 00000100:00100000:0.0:1788521366.783583:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521366.783994:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201443584 00000100:00100000:3.0:1788521366.784007:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201443584 00000100:00100000:3.0:1788521366.784072:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 238 00000100:00100000:3.0:1788521366.784087:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+67:12498:x1875400201443584:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521366.784129:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521366.784163:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc800/0x411dd0ee4d2d228d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed94a expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.784221:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d2294 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.784238:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d2294 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.784252:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d2294 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.784414:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc800/0x411dd0ee4d2d228d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed94a expref: 69 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.784447:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d2294 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed94a expref: 68 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.784458:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8fef76505600) 00010000:00010000:3.0:1788521366.784462:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788521366.784466:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fda00, rc 0) 00000100:00100000:3.0:1788521366.784566:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+68:12498:x1875400201443584:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 482us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521366.784574:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 238 00000100:00100000:1.0:1788521366.787140:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521366.787323:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201443840 00000100:00100000:0.0:1788521366.787333:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201443840 00000100:00100000:0.0:1788521366.787393:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 239 00000100:00100000:0.0:1788521366.787405:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+68:12498:x1875400201443840:12345-192.168.203.41@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788521366.787501:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c600/0x411dd0ee4d2d229b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.787519:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c600/0x411dd0ee4d2d229b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.787532:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c600/0x411dd0ee4d2d229b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788521366.787691:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:0.0:1788521366.787749:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001bfa4130 reply state 00000000eddc48ba transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c600/0x411dd0ee4d2d229b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.787762:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c600/0x411dd0ee4d2d229b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.787769:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8fef76505600) 00010000:00010000:0.0:1788521366.787772:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788521366.787788:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788521366.787924:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+70:12498:x1875400201443840:12345-192.168.203.41@tcp:36:lhsmtool_posix.0 Request processed in 521us (794us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788521366.787931:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 239 00000100:00100000:0.0:1788521366.797226:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521366.802606:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201443968 00000100:00100000:2.0:1788521366.802621:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201443968 00000100:00100000:2.0:1788521366.802707:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 240 00000100:00100000:2.0:1788521366.802719:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+70:12498:x1875400201443968:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521366.802752:0:9815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521366.802772:0:9815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d22a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed951 expref: -99 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.802832:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d22a2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed951 expref: 71 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.802848:0:9815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d22a2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed951 expref: 71 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.802867:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8fef76505600) 00010000:00010000:2.0:1788521366.802871:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788521366.802908:0:9815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7600, rc 0) 00000100:00100000:2.0:1788521366.803541:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+71:12498:x1875400201443968:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 822us (6322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521366.803549:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 240 00000100:00100000:1.0:1788521366.809568:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521366.809702:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201444096 00000100:00100000:0.0:1788521366.809716:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201444096 00000100:00100000:0.0:1788521366.809791:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 70 00000100:00100000:0.0:1788521366.809805:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+9:2395:x1875400201444096:12345-192.168.203.41@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788521366.810158:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+10:2395:x1875400201444096:12345-192.168.203.41@tcp:2:lhsmtool_posix.0 Request processed in 354us (604us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1788521366.810167:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 70 00000100:00100000:1.0:1788521366.823143:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521366.823278:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201444352 00000100:00100000:0.0:1788521366.823292:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201444352 00000100:00100000:0.0:1788521366.823377:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 60 00000100:00100000:0.0:1788521366.823390:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+71:12498:x1875400201444352:12345-192.168.203.41@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788521366.823694:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+72:12498:x1875400201444352:12345-192.168.203.41@tcp:35:lhsmtool_posix.0 Request processed in 305us (565us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1788521366.823703:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 60 00000100:00100000:2.0:1788521366.832879:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521366.833063:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201444608 00000100:00100000:3.0:1788521366.833072:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201444608 00000100:00100000:3.0:1788521366.835341:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 241 00000100:00100000:3.0:1788521366.835364:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+72:12498:x1875400201444608:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788521366.835493:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+72:12498:x1875400201444608:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 Request processed in 139us (2623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521366.835501:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 241 00000100:00100000:2.0:1788521366.838789:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521366.838900:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201444736 00000100:00100000:3.0:1788521366.838910:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201444736 00000100:00100000:3.0:1788521366.838993:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 242 00000100:00100000:3.0:1788521366.839002:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+72:12498:x1875400201444736:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521366.839022:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521366.839042:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc800/0x411dd0ee4d2d22a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed958 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.839106:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d22b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.839142:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d22b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.839153:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d22b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521366.839206:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788521366.839226:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d22b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.839254:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc800/0x411dd0ee4d2d22a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed958 expref: 74 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.839271:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d22b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed958 expref: 73 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.839279:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8fef76505600) 00010000:00010000:3.0:1788521366.839282:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788521366.839286:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fde00, rc 0) 00000100:00100000:3.0:1788521366.839460:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+73:12498:x1875400201444736:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 458us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521366.839467:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 242 00000100:00100000:1.0:1788521366.845267:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521366.845410:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201444864 00000100:00100000:2.0:1788521366.845423:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201444864 00000100:00100000:2.0:1788521366.845505:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 71 00000100:00100000:2.0:1788521366.845519:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+10:2396:x1875400201444864:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521366.845547:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521366.845577:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d22b7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed95f expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788521366.845609:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9aab96, blocks: 0x0 00010000:00010000:2.0:1788521366.845637:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=416s v=(0 0) 00010000:00010000:2.0:1788521366.845642:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521366.845654:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d22b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed95f expref: 11 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.845677:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d22b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed95f expref: 11 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.845694:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7800, rc 0) 00000100:00100000:2.0:1788521366.845784:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+11:2396:x1875400201444864:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 268us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521366.845792:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 71 00000100:00100000:0.0:1788521366.851939:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521366.852094:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201445120 00000100:00100000:2.0:1788521366.852103:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201445120 00000100:00100000:2.0:1788521366.852187:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 243 00000100:00100000:2.0:1788521366.852196:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+73:12498:x1875400201445120:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788521366.852587:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+73:12498:x1875400201445120:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 Request processed in 111us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521366.852596:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 243 00000100:00100000:3.0:1788521366.871862:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521366.874338:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201445248 00000100:00100000:0.0:1788521366.874353:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201445248 00000100:00100000:2.0:1788521366.881760:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 72 00000100:00100000:2.0:1788521366.881776:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+11:12498:x1875400201445248:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521366.881796:0:8875:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521366.881817:0:8875:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e41df99/0x411dd0ee4d2d22be lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed966 expref: -99 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.881854:0:8875:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d22b7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed95f expref: 12 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.881865:0:8875:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521366.881869:0:8875:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521366.881875:0:8875:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e41df99/0x411dd0ee4d2d22be lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed966 expref: 12 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.881930:0:8875:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d22b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed95f expref: 12 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.881944:0:8875:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d22b7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed95f expref: 12 pid: 8436 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521366.881978:0:8875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e82d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8875:1875400222468992:192.168.203.41@tcp:104: 00000100:00100000:2.0:1788521366.882067:0:8875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef5240f780 going to sleep for 11 seconds 00000100:00100000:1.0:1788521366.892370:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521366.892599:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201445376 00000100:00100000:3.0:1788521366.892608:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201445376 00010000:00010000:3.0:1788521366.892649:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d22b7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed95f expref: 13 pid: 8436 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521366.892712:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 100 00000100:00100000:3.0:1788521366.892722:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+13:2396:x1875400201445376:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521366.892739:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521366.892760:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d22b7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed95f expref: 13 pid: 8436 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.892774:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d22b7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed95f expref: 13 pid: 8436 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.892799:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521366.892803:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521366.892812:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005e41df99/0x411dd0ee4d2d22be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed966 expref: 13 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.892821:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e41df99/0x411dd0ee4d2d22be lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed966 expref: 13 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.892859:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005e41df99/0x411dd0ee4d2d22be lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed966 expref: 13 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521366.892872:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c65180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6504:1875400222469120:192.168.203.41@tcp:105: 00000100:00100000:3.0:1788521366.892973:0:6504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a5a540 going to sleep for 11 seconds 00010000:00010000:2.0:1788521366.893704:0:8875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8b2af7d/0x411dd0ee4d2d22b7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed95f expref: 13 pid: 8436 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521366.893720:0:8875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e82d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8875:1875400222468992:192.168.203.41@tcp:104: 00010000:00010000:2.0:1788521366.893747:0:8875:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005e41df99/0x411dd0ee4d2d22be lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed966 expref: 12 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.893758:0:8875:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef4167fc00, rc 0) 00000100:00100000:2.0:1788521366.893806:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+12:12498:x1875400201445248:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 12033us (21952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521366.893814:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 72 00000100:00100000:3.0:1788521366.895295:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c65180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6504:1875400222469120:192.168.203.41@tcp:105: 00010000:00010000:3.0:1788521366.895353:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521366.895400:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+11:2396:x1875400201445376:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 2679us (3048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521366.895409:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 100 00000100:00100000:0.0:1788521366.900246:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521366.900353:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201445504 00000100:00100000:1.0:1788521366.900363:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201445504 00002000:00100000:1.0:1788521366.900426:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8fee43e29180 x1875400201445504/t0(0) o4->fc75e887-507e-4861-8203-e266d82f5177@192.168.203.41@tcp:367/0 lens 504/0 e 0 to 0 dl 1788521377 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788521366.900438:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fee43e29180 with x1875400201445504 ext(0->12) 00002000:00010000:1.0:1788521366.900444:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fee43e29180 00000100:00100000:1.0:1788521366.900477:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 6 00000100:00100000:1.0:1788521366.900486:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc75e887-507e-4861-8203-e266d82f5177+11:2396:x1875400201445504:12345-192.168.203.41@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788521366.903748:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fc75e887-507e-4861-8203-e266d82f5177+13:2396:x1875400201445504:12345-192.168.203.41@tcp:4:lhsmtool_posix.0 Request processed in 3252us (3501us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1788521366.903762:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 6 00002000:00100000:1.0:1788521366.903773:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8fee43e29180 x1875400201445504/t4294967321(0) o4->fc75e887-507e-4861-8203-e266d82f5177@192.168.203.41@tcp:367/0 lens 504/448 e 0 to 0 dl 1788521377 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788521366.903782:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fee43e29180 with x1875400201445504 ext(0->12) 00002000:00010000:1.0:1788521366.903789:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fee43e29180 00000100:00100000:2.0:1788521366.909004:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521366.909117:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201445632 00000100:00100000:3.0:1788521366.909126:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201445632 00000100:00100000:3.0:1788521366.909190:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 244 00000100:00100000:3.0:1788521366.909199:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+73:12498:x1875400201445632:12345-192.168.203.41@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788521366.912238:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:0.0:1788521366.912262:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:0.0:1788521366.912291:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1788521366.912311:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8fef74a80540 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1788521366.912328:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fef767bd100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8fef42ec6b40 00000020:00080000:0.0:1788521366.912340:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fef767bd300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8fee43ed1600 00000004:00080000:0.0:1788521366.912367:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:0.0:1788521366.912394:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8fef4853cb40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788521366.912398:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fee4348db00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8fef4853c480 00000020:00080000:0.0:1788521366.912400:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fee4348d600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8fef48177a00 00000020:00080000:0.0:1788521366.912434:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1788521366.912492:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788521366.912626:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+27:12498:x1875400201445632:12345-192.168.203.41@tcp:44:lhsmtool_posix.0 Request processed in 3424us (3628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521366.912636:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 244 00000100:00100000:3.0:1788521366.914451:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788521366.914472:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222469248:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788521366.914528:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521366.915431:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521366.915446:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222469376:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788521366.915487:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521366.915657:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222469248 00000100:00100000:1.0:1788521366.915665:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222469248 00000100:00100000:1.0:1788521366.915716:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222469376 00000100:00100000:1.0:1788521366.915720:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222469376 00000100:00100000:1.0:1788521366.915745:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788521366.915754:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1875400222469248:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788521366.915781:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:1.0:1788521366.915813:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9aab94, atime: 0x6a9aab94, ctime: 0x6a9aab94, blocks: 0x8 00010000:00010000:1.0:1788521366.915821:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d22c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.915837:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1788521366.915842:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521366.915848:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d22c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.915865:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d22c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.915918:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d22c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.915926:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d22c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.915955:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788521366.916091:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3646:x1875400222469248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 339us (1562us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788521366.916098:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788521366.916116:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788521366.916122:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875400222469376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788521366.916135:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:1.0:1788521366.916151:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007b49d87/0x411dd0ee4d2d22cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.916165:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d2079 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8be expref: 12 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.916173:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788521366.916185:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788521366.916189:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007b49d87/0x411dd0ee4d2d22cc lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.916215:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d2079 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8be expref: 12 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.916236:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d2079 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8be expref: 12 pid: 8434 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521366.916249:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1875400222469504:192.168.203.41@tcp:104: 00000100:00100000:1.0:1788521366.916314:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef44af0000 going to sleep for 11 seconds 00010000:00010000:1.0:1788521366.916328:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521366.916334:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d22c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.916342:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa600 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:1.0:1788521366.916346:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d22c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.916354:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d22c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.916369:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d22c5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.916377:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d22c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.916398:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521366.916400:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521366.916407:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788521366.921080:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fee43c65180/2, rc 0, transno 4294967311 00000100:00100000:3.0:1788521366.921095:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222469248:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788521366.922554:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521366.922649:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521366.922935:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201445760 00000100:00100000:3.0:1788521366.923048:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201445760 00010000:00010000:3.0:1788521366.923109:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d2079 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8be expref: 13 pid: 8434 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521366.923110:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1875400222469504:192.168.203.41@tcp:104: 00010000:00010000:1.0:1788521366.923148:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000007b49d87/0x411dd0ee4d2d22cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521366.923168:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 101 00000100:00100000:3.0:1788521366.923195:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+13:2395:x1875400201445760:12345-192.168.203.41@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788521366.923199:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201445888 00000100:00100000:1.0:1788521366.923208:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201445888 00010000:00010000:3.0:1788521366.923216:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521366.923226:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d2079 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8be expref: 14 pid: 8434 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.923244:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d2079 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8be expref: 14 pid: 8434 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521366.923270:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 75 00000100:00100000:1.0:1788521366.923291:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+14:2396:x1875400201445888:12345-192.168.203.41@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1788521366.923310:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000bdaa0e/0x411dd0ee4d2d2079 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed8be expref: 14 pid: 8434 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.923336:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521366.923342:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521366.923349:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000007b49d87/0x411dd0ee4d2d22cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.923360:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007b49d87/0x411dd0ee4d2d22cc lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.923397:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521366.924339:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+13:2395:x1875400201445760:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 1154us (1787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521366.924351:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 101 00010000:00010000:3.0:1788521366.924397:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000007b49d87/0x411dd0ee4d2d22cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.924410:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007b49d87/0x411dd0ee4d2d22cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.924424:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007b49d87/0x411dd0ee4d2d22cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.924433:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007b49d87/0x411dd0ee4d2d22cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.924473:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521366.925276:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1fc3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925294:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1fc3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925302:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1fc3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925309:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa000 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521366.925314:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1fc3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925340:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1fc3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925359:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8fef76505a00) 00010000:00010000:2.0:1788521366.925362:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521366.925368:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1fc3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925374:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aa000/0x411dd0ee4d2d1fc3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925408:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d206b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925414:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d206b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925421:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d206b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925426:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aac00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521366.925428:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d206b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925435:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d206b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925443:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8fef71591d00) 00010000:00010000:2.0:1788521366.925446:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521366.925449:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d206b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925466:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aac00/0x411dd0ee4d2d206b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925484:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d20e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925489:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d20e9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925495:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d20e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925499:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521366.925502:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d20e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925508:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d20e9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925516:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8fef71591a00) 00010000:00010000:2.0:1788521366.925518:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521366.925522:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d20e9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925527:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d20e9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925537:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d210c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925542:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d210c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925553:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d210c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925558:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef413fc600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521366.925560:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d210c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925565:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d210c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925584:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8fef71591a00) 00010000:00010000:2.0:1788521366.925586:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521366.925589:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d210c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925594:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc600/0x411dd0ee4d2d210c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925610:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d21de lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925615:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d21de lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925621:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d21de lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925625:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521366.925628:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d21de lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925644:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d21de lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925653:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:2.0:1788521366.925655:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521366.925658:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d21de lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925664:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d21de lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925676:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c600/0x411dd0ee4d2d229b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925680:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c600/0x411dd0ee4d2d229b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925686:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c600/0x411dd0ee4d2d229b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925690:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef7f12c600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521366.925692:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c600/0x411dd0ee4d2d229b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925696:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c600/0x411dd0ee4d2d229b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925702:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8fef76505600) 00010000:00010000:2.0:1788521366.925703:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788521366.925706:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c600/0x411dd0ee4d2d229b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.925719:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c600/0x411dd0ee4d2d229b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.925875:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521366.925905:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007b49d87/0x411dd0ee4d2d22cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.925914:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434ab600 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:1.0:1788521366.925918:0:7461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007b49d87/0x411dd0ee4d2d22cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.925925:0:7461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007b49d87/0x411dd0ee4d2d22cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.925937:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007b49d87/0x411dd0ee4d2d22cc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.925943:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007b49d87/0x411dd0ee4d2d22cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521366.925968:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521366.925969:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521366.925971:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521366.926535:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3645:x1875400222469376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10408us (11042us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788521366.926545:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:0.0:1788521366.926683:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fee424e9500/2, rc 0, transno 4294967322 00000100:00100000:0.0:1788521366.926703:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222469376:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1788521366.927360:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:0.0:1788521366.927385:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000100:00100000:1.0:1788521366.927556:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+7:2396:x1875400201445888:12345-192.168.203.41@tcp:16:lhsmtool_posix.0 Request processed in 4264us (4902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521366.927571:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 75 00000100:00100000:0.0:1788521366.933029:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521366.933140:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201446144 00000100:00100000:3.0:1788521366.933153:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201446144 00000100:00100000:3.0:1788521366.933238:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 245 00000100:00100000:3.0:1788521366.933250:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+21:12498:x1875400201446144:12345-192.168.203.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788521366.933324:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521366.933370:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fde00/0x411dd0ee4d2d22b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed958 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.933394:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8fef76505600) 00010000:00010000:3.0:1788521366.933400:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788521366.933441:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc800/0x411dd0ee4d2d22d3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.933460:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc800/0x411dd0ee4d2d22d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.933480:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc800/0x411dd0ee4d2d22d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788521366.933649:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a356e140 reply state 00000000c27abf4a transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc800/0x411dd0ee4d2d22d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.933664:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc800/0x411dd0ee4d2d22d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.933672:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8fef76505600) 00010000:00010000:3.0:1788521366.933675:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788521366.933696:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788521366.933847:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fc75e887-507e-4861-8203-e266d82f5177+22:12498:x1875400201446144:12345-192.168.203.41@tcp:36:lhsmtool_posix.0 Request processed in 598us (831us total) trans 4294967509 rc 0/0 00000100:00100000:3.0:1788521366.933856:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 245 00000100:00100000:3.0:1788521366.936849:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521366.940337:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201446272 00000100:00100000:1.0:1788521366.940357:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201446272 00000100:00100000:1.0:1788521366.940443:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 76 00000100:00100000:1.0:1788521366.940456:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+7:2396:x1875400201446272:12345-192.168.203.41@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788521366.940653:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788521366.940658:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788521365 00002000:00010000:1.0:1788521366.940660:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788521364 00002000:00010000:1.0:1788521366.940662:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788521366 -> 1788521365 00002000:00010000:1.0:1788521366.940665:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788521366.940757:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+8:2396:x1875400201446272:12345-192.168.203.41@tcp:2:lhsmtool_posix.0 Request processed in 302us (3924us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1788521366.940765:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 76 00000100:00100000:1.0:1788521366.944121:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521366.945149:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201446528 00000100:00100000:2.0:1788521366.945167:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201446528 00000100:00100000:2.0:1788521366.945785:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 246 00000100:00100000:2.0:1788521366.945800:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+22:12498:x1875400201446528:12345-192.168.203.41@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788521366.948109:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef4167fa00/0x411dd0ee4d2d22da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.948148:0:9815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d2294 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed94a expref: 22 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.948159:0:9815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef4167fa00/0x411dd0ee4d2d22da lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.948226:0:9815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d2294 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed94a expref: 22 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.948248:0:9815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d2294 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed94a expref: 22 pid: 12956 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521366.948268:0:9815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e83b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9815:1875400222469632:192.168.203.41@tcp:104: 00000100:00100000:2.0:1788521366.948420:0:9815:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef5240f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788521366.960366:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521366.960669:0:9815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e83b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9815:1875400222469632:192.168.203.41@tcp:104: 00010000:00010000:2.0:1788521366.960707:0:9815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fef4167fa00/0x411dd0ee4d2d22da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521366.960873:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201446656 00000100:00100000:3.0:1788521366.960899:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201446656 00010000:00010000:3.0:1788521366.960948:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d2294 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed94a expref: 23 pid: 12956 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521366.961289:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 102 00000100:00100000:3.0:1788521366.961303:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+23:2396:x1875400201446656:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521366.961332:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521366.961343:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d2294 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed94a expref: 23 pid: 12956 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.961357:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d2294 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed94a expref: 23 pid: 12956 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.961387:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d2294 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed94a expref: 23 pid: 12956 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.961408:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8fef76505600) 00010000:00010000:3.0:1788521366.961413:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef4167fa00/0x411dd0ee4d2d22da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.961425:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef4167fa00/0x411dd0ee4d2d22da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.961468:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef4167fa00/0x411dd0ee4d2d22da lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.961504:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521366.961577:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+22:2396:x1875400201446656:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 276us (1225us total) trans 0 rc 0/0 00010000:00010000:2.0:1788521366.961757:0:9815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fef4167fa00/0x411dd0ee4d2d22da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.961773:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef4167fa00/0x411dd0ee4d2d22da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.961824:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef4167fa00/0x411dd0ee4d2d22da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.961831:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef4167fa00/0x411dd0ee4d2d22da lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.961838:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef4167fa00/0x411dd0ee4d2d22da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.961844:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef4167fa00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521366.961849:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef4167fa00/0x411dd0ee4d2d22da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.961857:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef4167fa00/0x411dd0ee4d2d22da lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.961867:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8fef76505600) 00010000:00010000:2.0:1788521366.961870:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788521366.961874:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef4167fa00/0x411dd0ee4d2d22da lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.961880:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef4167fa00/0x411dd0ee4d2d22da lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521366.961961:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+22:12498:x1875400201446528:12345-192.168.203.41@tcp:55:lhsmtool_posix.0 Request processed in 16166us (17855us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788521366.961970:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 246 00000100:00100000:3.0:1788521366.963078:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 102 00000100:00100000:0.0:1788521366.968325:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521366.969189:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201446784 00000100:00100000:2.0:1788521366.969204:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201446784 00000100:00100000:2.0:1788521366.969388:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 77 00000100:00100000:2.0:1788521366.969401:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58342d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc75e887-507e-4861-8203-e266d82f5177+8:2396:x1875400201446784:12345-192.168.203.41@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788521366.969570:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003909eba3/0x411dd0ee4d2d22e1 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.969596:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005e41df99/0x411dd0ee4d2d22be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed966 expref: 8 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.969606:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788521366.969611:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788521366.969617:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003909eba3/0x411dd0ee4d2d22e1 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.969661:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005e41df99/0x411dd0ee4d2d22be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed966 expref: 8 pid: 8875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.969677:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005e41df99/0x411dd0ee4d2d22be lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed966 expref: 8 pid: 8875 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521366.969694:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1875400222469760:192.168.203.41@tcp:104: 00000100:00100000:2.0:1788521366.969863:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef5240f780 going to sleep for 11 seconds 00000100:00100000:1.0:1788521366.977683:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521366.977775:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201446912 00000100:00100000:3.0:1788521366.977787:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201446912 00010000:00010000:3.0:1788521366.977837:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005e41df99/0x411dd0ee4d2d22be lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed966 expref: 9 pid: 8875 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521366.977922:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 103 00000100:00100000:3.0:1788521366.977992:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+9:2395:x1875400201446912:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521366.978012:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521366.978042:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005e41df99/0x411dd0ee4d2d22be lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed966 expref: 9 pid: 8875 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.978061:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005e41df99/0x411dd0ee4d2d22be lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed966 expref: 9 pid: 8875 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.978104:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521366.978110:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521366.978118:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003909eba3/0x411dd0ee4d2d22e1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.978154:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003909eba3/0x411dd0ee4d2d22e1 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.978191:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521366.978268:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+9:2395:x1875400201446912:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 332us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521366.978277:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 103 00010000:00010000:2.0:1788521366.978715:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e41df99/0x411dd0ee4d2d22be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed966 expref: 8 pid: 8875 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521366.978737:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1875400222469760:192.168.203.41@tcp:104: 00010000:00010000:2.0:1788521366.978765:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003909eba3/0x411dd0ee4d2d22e1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.978779:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003909eba3/0x411dd0ee4d2d22e1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.978787:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003909eba3/0x411dd0ee4d2d22e1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.978814:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003909eba3/0x411dd0ee4d2d22e1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.978823:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003909eba3/0x411dd0ee4d2d22e1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.978833:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003909eba3/0x411dd0ee4d2d22e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.978841:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6800 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:2.0:1788521366.978846:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003909eba3/0x411dd0ee4d2d22e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.978871:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003909eba3/0x411dd0ee4d2d22e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.978938:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003909eba3/0x411dd0ee4d2d22e1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.979006:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003909eba3/0x411dd0ee4d2d22e1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521366.979076:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58342d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fc75e887-507e-4861-8203-e266d82f5177+7:2396:x1875400201446784:12345-192.168.203.41@tcp:1:lhsmtool_posix.0 Request processed in 9678us (10779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521366.979087:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 77 00000100:00100000:1.0:1788521366.987457:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521366.987569:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201447168 00000100:00100000:0.0:1788521366.987582:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201447168 00000100:00100000:0.0:1788521366.987658:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 247 00000100:00100000:0.0:1788521366.987692:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+21:12498:x1875400201447168:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788521366.987797:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d000/0x411dd0ee4d2d22e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.987819:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef4167f800/0x411dd0ee4d2d21d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed912 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.987830:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d000/0x411dd0ee4d2d22e8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.987877:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fef4167f800/0x411dd0ee4d2d21d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed912 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.987933:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef4167f800/0x411dd0ee4d2d21d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed912 expref: 21 pid: 6520 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521366.987959:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58340700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875400222469888:192.168.203.41@tcp:104: 00000100:00100000:0.0:1788521366.988062:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef7a431300 going to sleep for 11 seconds 00000100:00100000:1.0:1788521366.991201:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521366.991329:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58340700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875400222469888:192.168.203.41@tcp:104: 00010000:00010000:0.0:1788521366.991365:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d000/0x411dd0ee4d2d22e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521366.991863:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201447296 00000100:00100000:3.0:1788521366.991873:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201447296 00010000:00010000:3.0:1788521366.991963:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef4167f800/0x411dd0ee4d2d21d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed912 expref: 22 pid: 6520 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521366.992001:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 104 00000100:00100000:3.0:1788521366.992011:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+22:2396:x1875400201447296:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521366.992030:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521366.992038:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fef4167f800/0x411dd0ee4d2d21d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed912 expref: 22 pid: 6520 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.992051:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fef4167f800/0x411dd0ee4d2d21d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed912 expref: 22 pid: 6520 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.992804:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef4167f800/0x411dd0ee4d2d21d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed912 expref: 22 pid: 6520 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.992830:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:3.0:1788521366.992856:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d600/0x411dd0ee4d2d2239 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed935 expref: 21 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.992869:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d000/0x411dd0ee4d2d22e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.992880:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d000/0x411dd0ee4d2d22e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521366.993209:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d000/0x411dd0ee4d2d22e8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521366.994168:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521366.994273:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+21:2396:x1875400201447296:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 2257us (3088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521366.994286:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 104 00010000:00010000:0.0:1788521366.994384:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d000/0x411dd0ee4d2d22e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.994395:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d000/0x411dd0ee4d2d22e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.994640:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d400/0x411dd0ee4d2d22ef lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.994671:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d22a2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed951 expref: 21 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.994682:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d400/0x411dd0ee4d2d22ef lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.994724:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d22a2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed951 expref: 21 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521366.994740:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d22a2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed951 expref: 21 pid: 9815 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521366.994756:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58340700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875400222470016:192.168.203.41@tcp:104: 00000100:00100000:0.0:1788521366.994840:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef7a4310c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521366.999967:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58340700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875400222470016:192.168.203.41@tcp:104: 00010000:00010000:0.0:1788521367.000007:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d400/0x411dd0ee4d2d22ef lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521367.005218:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521367.008048:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201447424 00000100:00100000:0.0:1788521367.008069:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201447424 00010000:00010000:0.0:1788521367.008140:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d22a2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed951 expref: 22 pid: 9815 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521367.008264:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 105 00000100:00100000:0.0:1788521367.008276:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4e7e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+22:2395:x1875400201447424:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521367.008296:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521367.008322:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d22a2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed951 expref: 22 pid: 9815 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521367.008339:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d22a2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed951 expref: 22 pid: 9815 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521367.008425:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d22a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed951 expref: 22 pid: 9815 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521367.008762:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8fef76505600) 00010000:00010000:0.0:1788521367.008772:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d400/0x411dd0ee4d2d22ef lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521367.008785:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d400/0x411dd0ee4d2d22ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521367.008793:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d400/0x411dd0ee4d2d22ef lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521367.008849:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521367.009067:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4e7e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+21:2395:x1875400201447424:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 790us (3978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521367.009077:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 105 00010000:00010000:3.0:1788521367.009825:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d400/0x411dd0ee4d2d22ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521367.009840:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d400/0x411dd0ee4d2d22ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788521367.010020:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1788521367.010197:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1788521367.010300:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1788521367.010421:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e83b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6521:1875400222470144:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788521367.010740:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521367.010782:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef8147f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521367.010961:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222470144 00000100:00100000:3.0:1788521367.010970:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222470144 00000100:00100000:3.0:1788521367.011031:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788521367.011041:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6521:x1875400222470144:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788521367.011228:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6521:x1875400222470144:12345-0@lo:1000:mdt00_002.0 Request processed in 187us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521367.011236:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788521367.011488:0:6521:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:2.0:1788521367.011496:0:6521:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:2.0:1788521367.011526:0:6521:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8fee424e9500 x1875400222469376/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788521382 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521367.011539:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e83b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6521:1875400222470144:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788521367.011715:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1788521367.011787:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e83b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6521:1875400222470272:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788521367.011826:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521367.011935:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee435a1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521367.012333:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222470272 00000100:00100000:0.0:1788521367.012341:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222470272 00000100:00100000:0.0:1788521367.012385:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788521367.012394:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6521:x1875400222470272:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788521367.013129:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6521:x1875400222470272:12345-0@lo:1000:mdt00_002.0 Request processed in 732us (1297us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788521367.013155:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788521367.013200:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e83b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6521:1875400222470272:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788521367.013267:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d400/0x411dd0ee4d2d22ef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.013280:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d400/0x411dd0ee4d2d22ef lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.013290:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d400/0x411dd0ee4d2d22ef lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.013297:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef7f12d400 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521367.013306:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d400/0x411dd0ee4d2d22ef lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.013315:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d400/0x411dd0ee4d2d22ef lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.013336:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8fef76505600) 00010000:00010000:2.0:1788521367.013339:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788521367.013345:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d400/0x411dd0ee4d2d22ef lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.013351:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d400/0x411dd0ee4d2d22ef lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.013389:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2232 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.013404:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2232 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.013410:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2232 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.013415:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7000 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521367.013418:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2232 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.013424:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2232 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.013434:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:2.0:1788521367.013437:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788521367.013445:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d600/0x411dd0ee4d2d2239 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed935 expref: 24 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.013457:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d600/0x411dd0ee4d2d2239 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed935 expref: 24 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.013468:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d600/0x411dd0ee4d2d2239 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed935 expref: 24 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.013504:0:6521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d600/0x411dd0ee4d2d2239 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed935 expref: 24 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521367.013519:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e80e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875400222470400:192.168.203.41@tcp:105: 00000100:00100000:2.0:1788521367.013842:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee435a1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521367.027600:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521367.027754:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201447552 00000100:00100000:0.0:1788521367.027766:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201447552 00000100:00100000:0.0:1788521367.027850:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 61 00000100:00100000:0.0:1788521367.027862:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+25:12496:x1875400201447552:12345-192.168.203.41@tcp:49:lfs.0 00000100:00100000:0.0:1788521367.028068:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+25:12496:x1875400201447552:12345-192.168.203.41@tcp:49:lfs.0 Request processed in 208us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521367.028076:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 61 00000100:00100000:2.0:1788521367.029443:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e80e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875400222470400:192.168.203.41@tcp:105: 00010000:00010000:2.0:1788521367.029713:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2232 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.029728:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2232 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.029772:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d22f6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.029790:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d22f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.029804:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d22f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.029815:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d22f6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.029822:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d22f6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.029829:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d22f6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.029836:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521367.029840:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d22f6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.029848:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d22f6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.029929:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:2.0:1788521367.029934:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521367.029947:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d22f6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.029954:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d22f6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.029966:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d000/0x411dd0ee4d2d22e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.029972:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d000/0x411dd0ee4d2d22e8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.029979:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d000/0x411dd0ee4d2d22e8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.029984:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef7f12d000 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521367.029987:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d000/0x411dd0ee4d2d22e8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.029994:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d000/0x411dd0ee4d2d22e8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.030001:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:2.0:1788521367.030004:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788521367.030007:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d000/0x411dd0ee4d2d22e8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.030014:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d000/0x411dd0ee4d2d22e8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521367.030226:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+24:12498:x1875400201447168:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 Request processed in 42535us (42781us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1788521367.030238:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 247 00000020:00080000:2.0:1788521367.030245:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788521367.031113:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788521367.031121:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788521367.031143:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788521367.031152:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788521367.036300:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521367.036472:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201447808 00000100:00100000:0.0:1788521367.036486:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201447808 00000100:00100000:0.0:1788521367.036561:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 62 00000100:00100000:0.0:1788521367.036583:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71d3fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+24:12498:x1875400201447808:12345-192.168.203.41@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788521367.037108:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788521367.037154:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:0.0:1788521367.037211:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d400/0x411dd0ee4d2d22fd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521367.037234:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d400/0x411dd0ee4d2d22fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521367.037250:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d400/0x411dd0ee4d2d22fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521367.037260:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d400/0x411dd0ee4d2d22fd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521367.037284:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d400/0x411dd0ee4d2d22fd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521367.037291:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d400/0x411dd0ee4d2d22fd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521367.037322:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521367.037480:0:13735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521367.037489:0:13735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d400/0x411dd0ee4d2d22fd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.037498:0:13735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef7f12d400 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:2.0:1788521367.037502:0:13735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d400/0x411dd0ee4d2d22fd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.037511:0:13735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d400/0x411dd0ee4d2d22fd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.037526:0:13735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8fef76505600) 00010000:00010000:2.0:1788521367.037530:0:13735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788521367.037535:0:13735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d400/0x411dd0ee4d2d22fd lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.037541:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d400/0x411dd0ee4d2d22fd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.037557:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521367.037559:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521367.037560:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521367.037693:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71d3fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+26:12498:x1875400201447808:12345-192.168.203.41@tcp:35:lhsmtool_posix.0 Request processed in 1110us (1404us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1788521367.037703:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 62 00000020:00080000:0.0:1788521367.037709:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788521367.049265:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521367.050931:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201448064 00000100:00100000:0.0:1788521367.050949:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201448064 00000100:00100000:0.0:1788521367.051103:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 248 00000100:00100000:0.0:1788521367.051735:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+26:12496:x1875400201448064:12345-192.168.203.41@tcp:58:lfs.0 00000040:00080000:0.0:1788521367.052021:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788521367.052587:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+26:12496:x1875400201448064:12345-192.168.203.41@tcp:58:lfs.0 Request processed in 1469us (3335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521367.052599:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 248 00000100:00100000:3.0:1788521367.118839:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521367.119193:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201448192 00000100:00100000:2.0:1788521367.119206:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201448192 00000100:00100000:2.0:1788521367.119296:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 249 00000100:00100000:2.0:1788521367.119309:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+26:12500:x1875400201448192:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:2.0:1788521367.119359:0:9815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521367.119398:0:9815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2304 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed96d expref: -99 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.119597:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d230b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.119616:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d230b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.119630:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d230b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.119648:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d2312 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.119656:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d2312 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.119663:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d2312 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.119762:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2319 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.119774:0:9815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d2224 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed92e expref: 27 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.119784:0:9815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2319 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.119829:0:9815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d2224 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed92e expref: 27 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.119854:0:9815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d2224 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed92e expref: 27 pid: 12956 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521367.119872:0:9815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e80e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9815:1875400222470528:192.168.203.41@tcp:104: 00000100:00100000:2.0:1788521367.121748:0:9815:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee435a1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521367.126437:0:9815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e80e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9815:1875400222470528:192.168.203.41@tcp:104: 00010000:00010000:0.0:1788521367.126632:0:9815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2319 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521367.129640:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521367.129963:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201448448 00000100:00100000:1.0:1788521367.129977:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201448448 00000100:00100000:1.0:1788521367.130115:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 63 00000100:00100000:1.0:1788521367.130151:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+28:6166:x1875400201448448:12345-192.168.203.41@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788521367.130495:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+29:6166:x1875400201448448:12345-192.168.203.41@tcp:35:ldlm_bl.0 Request processed in 347us (869us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788521367.130504:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 63 00000100:00100000:2.0:1788521367.132829:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521367.133049:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201448576 00000100:00100000:0.0:1788521367.133062:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201448576 00010000:00010000:0.0:1788521367.133120:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d2224 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed92e expref: 29 pid: 12956 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521367.133241:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 106 00000100:00100000:0.0:1788521367.133254:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+29:2395:x1875400201448576:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521367.133286:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521367.133295:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d2224 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed92e expref: 29 pid: 12956 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521367.133311:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d2224 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed92e expref: 29 pid: 12956 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521367.133354:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6e00/0x411dd0ee4d2d2224 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed92e expref: 29 pid: 12956 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521367.133538:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:0.0:1788521367.133545:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2319 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521367.133557:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2319 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521367.133567:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2319 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521367.133651:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521367.133725:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fc75e887-507e-4861-8203-e266d82f5177+28:2395:x1875400201448576:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 473us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521367.133734:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 106 00010000:00010000:2.0:1788521367.136172:0:9815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2319 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.136204:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2319 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521367.136292:0:9815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788521367.136297:0:9815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788521367.136326:0:9815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2319 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.136346:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2319 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.136570:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d230b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.136580:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d230b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.136588:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d230b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.136595:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521367.136622:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d230b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.136632:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d230b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.136650:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:2.0:1788521367.136653:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521367.136658:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d230b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.136664:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d230b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.136685:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d2312 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.136692:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d2312 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.136698:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d2312 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.136703:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521367.136706:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d2312 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.136712:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d2312 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.136720:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8fef71591600) 00010000:00010000:2.0:1788521367.136722:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521367.136736:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d2312 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.136742:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d2312 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.136795:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2304 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed96d expref: 28 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.136811:0:9815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2319 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed96d expref: 27 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521367.136819:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:2.0:1788521367.136821:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521367.136824:0:9815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7600, rc 0) 00000100:00100000:2.0:1788521367.137036:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+27:12500:x1875400201448192:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 17728us (18210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521367.137045:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 249 00000100:00100000:0.0:1788521367.181431:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788521367.181483:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58340700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222470656:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788521367.181591:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521367.181646:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222470656 00000100:00100000:0.0:1788521367.181655:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222470656 00000100:00100000:0.0:1788521367.181717:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788521367.181728:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58340a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222470656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788521367.181757:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1788521367.181803:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58340a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222470656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521367.181810:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788521367.181878:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58340700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222470656:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788521367.182063:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788521367.182076:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222470784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788521367.182115:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521367.182151:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222470784 00000100:00100000:3.0:1788521367.182155:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222470784 00000100:00100000:3.0:1788521367.182199:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788521367.182206:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222470784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788521367.182238:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788521367.182277:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222470784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521367.182283:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788521367.182315:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222470784:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788521367.761764:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788521367.823712:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788521367.942017:0:14764:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788521367.942201:0:14764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788521367.942241:0:14764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788521367.942247:0:14764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788521368.079088:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788521368.079096:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788521368.079121:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788521368.079127:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788521368.079272:0:13799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee424eb480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1875400222470912:192.168.203.41@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788521368.079446:0:13799:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef484bbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788521368.085726:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521368.085756:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201448704 00000100:00100000:2.0:1788521368.085765:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201448704 00000100:00100000:2.0:1788521368.085825:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 250 00000100:00100000:2.0:1788521368.085835:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+28:12512:x1875400201448704:12345-192.168.203.41@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788521368.085871:0:6521:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788521368.085995:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+28:12512:x1875400201448704:12345-192.168.203.41@tcp:53:lhsmtool_posix.0 Request processed in 161us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521368.086002:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 250 00000100:00100000:3.0:1788521368.086164:0:13799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee424eb480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13799:1875400222470912:192.168.203.41@tcp:107:hsm_cdtr.0 00000100:00080000:0.0:1788521368.086437:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521368.090134:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521368.090247:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201448960 00000100:00100000:2.0:1788521368.090257:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201448960 00000100:00100000:2.0:1788521368.090319:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 251 00000100:00100000:2.0:1788521368.090329:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+27:12512:x1875400201448960:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521368.090350:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521368.090372:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2320 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed974 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521368.090476:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d2327 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521368.090491:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d2327 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521368.090506:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d2327 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521368.090517:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788521368.090626:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2320 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed974 expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521368.090642:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d2327 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed974 expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521368.090650:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:2.0:1788521368.090653:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521368.090657:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b6800, rc 0) 00000100:00100000:2.0:1788521368.090722:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+29:12512:x1875400201448960:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 395us (596us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788521368.090748:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 251 00000100:00100000:3.0:1788521368.096826:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521368.096943:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201449216 00000100:00100000:2.0:1788521368.096953:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201449216 00000100:00100000:2.0:1788521368.097007:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 252 00000100:00100000:2.0:1788521368.097017:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+29:12512:x1875400201449216:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788521368.097091:0:9815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2335 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521368.097108:0:9815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2335 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521368.097120:0:9815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2335 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521368.097272:0:9815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2335 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521368.097281:0:9815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2335 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521368.097288:0:9815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2335 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521368.097293:0:9815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7000 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521368.097298:0:9815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2335 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521368.097306:0:9815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2335 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521368.097334:0:9815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:2.0:1788521368.097337:0:9815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788521368.097342:0:9815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2335 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521368.097348:0:9815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d2335 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521368.097691:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+30:12512:x1875400201449216:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 Request processed in 674us (873us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788521368.097698:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 252 00000040:00080000:3.0:1788521368.104306:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788521368.104315:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1788521368.104396:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521368.104455:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201449344 00000100:00100000:0.0:1788521368.104464:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201449344 00000100:00100000:0.0:1788521368.104601:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 20 00000100:00100000:0.0:1788521368.104612:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+30:2395:x1875400201449344:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521368.104626:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521368.104648:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d2327 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed974 expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521368.104666:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:0.0:1788521368.104671:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521368.104744:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc75e887-507e-4861-8203-e266d82f5177+29:2395:x1875400201449344:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 134us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521368.104752:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 20 00000040:00080000:3.0:1788521368.104792:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788521368.104799:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788521368.107922:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521368.108075:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201449600 00000100:00100000:0.0:1788521368.108085:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201449600 00000100:00100000:0.0:1788521368.108140:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 64 00000100:00100000:0.0:1788521368.108150:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+29:12512:x1875400201449600:12345-192.168.203.41@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788521368.108371:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+30:12512:x1875400201449600:12345-192.168.203.41@tcp:35:lhsmtool_posix.0 Request processed in 222us (499us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1788521368.108380:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 64 00010000:00010000:2.0:1788521368.781543:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521369.229035:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58340000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222471040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521369.229114:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521369.230264:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222471168:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788521369.230302:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521369.230359:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222471040 00000100:00100000:3.0:1788521369.230366:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222471040 00000100:00100000:3.0:1788521369.230408:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222471168 00000100:00100000:3.0:1788521369.230411:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222471168 00000100:00100000:3.0:1788521369.230425:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788521369.230432:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58341500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875400222471040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788521369.230457:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788521369.230544:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58341500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875400222471040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521369.230551:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788521369.230566:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788521369.230572:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f077b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222471168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788521369.230580:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788521369.230601:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f077b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222471168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 30us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521369.230606:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:3.0:1788521369.230622:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521369.230651:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222471168:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788521369.230728:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58340000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222471040:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788521369.771420:0:14815:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788521369.771429:0:14815:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788521369.771462:0:14815:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788521369.771468:0:14815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788521369.805142:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521369.986333:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521369.986476:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201449856 00000100:00100000:3.0:1788521369.986485:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201449856 00000100:00100000:3.0:1788521369.986545:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 253 00000100:00100000:3.0:1788521369.986554:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+30:12532:x1875400201449856:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:3.0:1788521369.986577:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521369.986597:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d233c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed97b expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521369.986700:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fdc00/0x411dd0ee4d2d2343 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521369.986728:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fdc00/0x411dd0ee4d2d2343 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521369.986742:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fdc00/0x411dd0ee4d2d2343 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521369.986754:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788521369.986860:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fda00/0x411dd0ee4d2d233c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed97b expref: 33 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521369.986878:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fdc00/0x411dd0ee4d2d2343 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed97b expref: 32 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521369.986924:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:3.0:1788521369.986927:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788521369.986931:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fdc00, rc 0) 00000100:00100000:3.0:1788521369.986986:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+32:12532:x1875400201449856:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 433us (664us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788521369.986994:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 253 00000100:00100000:2.0:1788521369.991673:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521369.991773:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201449984 00000100:00100000:3.0:1788521369.991783:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201449984 00000100:00100000:0.0:1788521369.992064:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 254 00000100:00100000:0.0:1788521369.992080:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+32:12532:x1875400201449984:12345-192.168.203.41@tcp:54:lfs.0 00010000:00010000:0.0:1788521369.992151:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c400/0x411dd0ee4d2d2351 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521369.992179:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c400/0x411dd0ee4d2d2351 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521369.992197:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c400/0x411dd0ee4d2d2351 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521369.992234:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c400/0x411dd0ee4d2d2351 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521369.992242:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c400/0x411dd0ee4d2d2351 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521369.992250:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c400/0x411dd0ee4d2d2351 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521369.992273:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef7f12c400 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521369.992281:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c400/0x411dd0ee4d2d2351 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521369.992289:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c400/0x411dd0ee4d2d2351 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521369.992304:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:0.0:1788521369.992310:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788521369.992315:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c400/0x411dd0ee4d2d2351 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521369.992321:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c400/0x411dd0ee4d2d2351 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521369.992850:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+32:12532:x1875400201449984:12345-192.168.203.41@tcp:54:lfs.0 Request processed in 397us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521369.992863:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 254 00000100:00100000:2.0:1788521370.187581:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521370.188210:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201450112 00000100:00100000:1.0:1788521370.188220:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201450112 00000100:00100000:1.0:1788521370.188292:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 78 00000100:00100000:1.0:1788521370.188303:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+7:2393:x1875400201450112:12345-192.168.203.41@tcp:101:cat.0 00010000:00010000:1.0:1788521370.188320:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521370.188340:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000101ea398/0x411dd0ee4d2d2358 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed982 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788521370.188364:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9aab95, atime: 0x6a9aab94, ctime: 0x6a9aab95, blocks: 0x8 00010000:00010000:1.0:1788521370.188385:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=420s v=(0 0) 00010000:00010000:1.0:1788521370.188389:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521370.188399:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000101ea398/0x411dd0ee4d2d2358 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed982 expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521370.188417:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000101ea398/0x411dd0ee4d2d2358 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed982 expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521370.188447:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434aa200, rc 0) 00000100:00100000:1.0:1788521370.188510:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+8:2393:x1875400201450112:12345-192.168.203.41@tcp:101:cat.0 Request processed in 209us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521370.188518:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 78 00000100:00080000:3.0:1788521370.188741:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521370.196623:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521370.196776:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201450240 00000100:00100000:3.0:1788521370.196787:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201450240 00002000:00100000:3.0:1788521370.196838:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8fef44fc9880 x1875400201450240/t0(0) o3->fc75e887-507e-4861-8203-e266d82f5177@192.168.203.41@tcp:371/0 lens 488/0 e 0 to 0 dl 1788521381 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788521370.196850:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fef44fc9880 with x1875400201450240 ext(0->4095) 00002000:00010000:3.0:1788521370.196855:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fef44fc9880 00000100:00100000:3.0:1788521370.197045:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 7 00000100:00100000:3.0:1788521370.197056:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc75e887-507e-4861-8203-e266d82f5177+8:2394:x1875400201450240:12345-192.168.203.41@tcp:3:cat.0 00000100:00100000:3.0:1788521370.198532:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fc75e887-507e-4861-8203-e266d82f5177+8:2394:x1875400201450240:12345-192.168.203.41@tcp:3:cat.0 Request processed in 1471us (1911us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788521370.198543:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 7 00002000:00100000:3.0:1788521370.198553:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8fef44fc9880 x1875400201450240/t0(0) o3->fc75e887-507e-4861-8203-e266d82f5177@192.168.203.41@tcp:371/0 lens 488/4536 e 0 to 0 dl 1788521381 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788521370.198562:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fef44fc9880 with x1875400201450240 ext(0->4095) 00002000:00010000:3.0:1788521370.198568:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fef44fc9880 00000001:00080000:2.0:1788521370.771206:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:1.0:1788521370.829081:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521371.757575:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521371.757614:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521371.757651:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521371.757674:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521371.757691:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521371.757708:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521371.757740:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521371.757768:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201450880 00000100:00100000:0.0:1788521371.757777:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201450880 00000100:00100000:0.0:1788521371.757823:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201450752 00000100:00100000:0.0:1788521371.757827:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201450752 00000100:00100000:0.0:1788521371.757869:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 155 00000100:00100000:0.0:1788521371.757878:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58340380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+8:2395:x1875400201450880:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521371.757978:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58340380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+8:2395:x1875400201450880:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 101us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521371.757986:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 155 00000100:00100000:0.0:1788521371.758004:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 156 00000100:00100000:0.0:1788521371.758010:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58343800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201450752:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521371.758032:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58343800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201450752:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 22us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521371.758037:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 156 00000100:00100000:0.0:1788521371.758053:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201450624 00000100:00100000:0.0:1788521371.758057:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201450624 00000100:00100000:0.0:1788521371.758079:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201451136 00000100:00100000:0.0:1788521371.758082:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201451136 00000100:00100000:0.0:1788521371.758093:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201450496 00000100:00100000:0.0:1788521371.758095:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201450496 00000100:00100000:0.0:1788521371.758106:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201451008 00000100:00100000:0.0:1788521371.758108:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201451008 00000100:00100000:0.0:1788521371.758121:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 360 00000100:00100000:0.0:1788521371.758127:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201450624:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521371.758164:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201450624:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 38us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521371.758170:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 360 00000100:00100000:3.0:1788521371.758284:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 361 00000100:00100000:3.0:1788521371.758293:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58343100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201451136:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521371.758320:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58343100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201451136:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 29us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521371.758327:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 361 00000100:00100000:3.0:1788521371.758341:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 362 00000100:00100000:3.0:1788521371.758347:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58341180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+32:2395:x1875400201450496:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521371.758371:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58341180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+32:2395:x1875400201450496:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 25us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521371.758377:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 362 00000100:00100000:3.0:1788521371.758389:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 363 00000100:00100000:3.0:1788521371.758395:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58341f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201451008:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521371.758416:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58341f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2395:x1875400201451008:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 21us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521371.758432:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 363 00000100:00080000:3.0:1788521371.758451:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788521371.758455:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788521371.758457:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521371.763560:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201450368 00000100:00100000:2.0:1788521371.763575:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201450368 00000100:00100000:2.0:1788521371.763647:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 397 00000100:00100000:2.0:1788521371.763657:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2395:x1875400201450368:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521371.763724:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2395:x1875400201450368:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 69us (6160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521371.763740:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 397 00000100:00100000:3.0:1788521371.789632:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222471296:0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.789699:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521371.789741:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222471808:0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.789768:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521371.789786:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f075500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222472320:0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.789813:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521371.789830:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222472832:0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.789850:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521371.789873:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788521371.789880:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222471424:0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.790058:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521371.790078:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875400222471936:0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.790099:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521371.790114:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222472448:0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.790135:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521371.790176:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222471552:0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.790275:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521371.790294:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875400222472064:0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.790313:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521371.790329:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222472576:0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.790363:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521371.790382:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788521371.790389:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222471680:0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.790409:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521371.790420:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222472192:0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.790438:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521371.790454:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222472704:0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.790538:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521371.790574:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222471424 00000100:00100000:3.0:1788521371.790581:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222471424 00000100:00100000:3.0:1788521371.790617:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222471936 00000100:00100000:3.0:1788521371.790620:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222471936 00000100:00100000:3.0:1788521371.790642:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222472448 00000100:00100000:3.0:1788521371.790645:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222472448 00000100:00100000:3.0:1788521371.790658:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222472064 00000100:00100000:3.0:1788521371.790660:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222472064 00000100:00100000:3.0:1788521371.790672:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222472576 00000100:00100000:3.0:1788521371.790674:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222472576 00000100:00100000:3.0:1788521371.790685:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222471680 00000100:00100000:3.0:1788521371.790688:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222471680 00000100:00100000:3.0:1788521371.790702:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1788521371.790710:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222471424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.790761:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222471424:12345-0@lo:400:kworker.0 Request processed in 52us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521371.790768:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1788521371.790785:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1788521371.790792:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875400222471936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.790819:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875400222471936:12345-0@lo:400:kworker.0 Request processed in 28us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521371.790833:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1788521371.790846:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788521371.790852:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222472448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.790880:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222472448:12345-0@lo:400:kworker.0 Request processed in 30us (745us total) trans 0 rc 0/0 00000004:00080000:2.0:1788521371.791059:0:9967:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 421857173912ns, next at 422857170744ns, rc = 0 00000100:00100000:2.0:1788521371.791079:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef44fca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222472960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521371.791109:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521371.791141:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222472960 00000100:00100000:2.0:1788521371.791156:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222472960 00000100:00100000:2.0:1788521371.791195:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788521371.791203:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1875400222472960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788521371.791224:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788521371.791258:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1875400222472960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521371.791264:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788521371.791305:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef44fca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222472960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521371.791348:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1788521371.791355:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875400222472064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521371.791387:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875400222472064:12345-0@lo:400:kworker.0 Request processed in 33us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521371.791393:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1788521371.791405:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788521371.791411:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222472576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521371.791435:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222472576:12345-0@lo:400:kworker.0 Request processed in 25us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521371.791441:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788521371.791451:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1788521371.791596:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222471680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521371.791624:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222471680:12345-0@lo:400:kworker.0 Request processed in 161us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521371.791630:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1788521371.791650:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222471808 00000100:00100000:2.0:1788521371.791654:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222471808 00000100:00100000:2.0:1788521371.791677:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222471552 00000100:00100000:2.0:1788521371.791680:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222471552 00000100:00100000:2.0:1788521371.791692:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788521371.791698:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222471808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521371.791729:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222471808:12345-0@lo:400:kworker.0 Request processed in 31us (1960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521371.791736:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788521371.791746:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788521371.791752:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222471552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521371.791777:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222471552:12345-0@lo:400:kworker.0 Request processed in 25us (1501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521371.791783:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788521371.792008:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788521371.792028:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222472320 00000100:00100000:3.0:1788521371.792032:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222472320 00000100:00100000:3.0:1788521371.792052:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222472832 00000100:00100000:3.0:1788521371.792055:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222472832 00000100:00100000:3.0:1788521371.792064:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222472192 00000100:00100000:3.0:1788521371.792067:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222472192 00000100:00100000:3.0:1788521371.792077:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222472704 00000100:00100000:3.0:1788521371.792079:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222472704 00000100:00100000:3.0:1788521371.792090:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788521371.792096:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76716d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222472320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.792128:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76716d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222472320:12345-0@lo:400:kworker.0 Request processed in 32us (2314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521371.792133:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788521371.792153:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788521371.792160:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76716300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3643:x1875400222472832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.793020:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76716300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3643:x1875400222472832:12345-0@lo:400:kworker.0 Request processed in 859us (3167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521371.793028:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788521371.793045:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788521371.793053:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222472192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.793109:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222472192:12345-0@lo:400:kworker.0 Request processed in 59us (2670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521371.793115:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788521371.793125:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788521371.793131:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222472704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.793168:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222472704:12345-0@lo:400:kworker.0 Request processed in 38us (2630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521371.793174:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:3.0:1788521371.793367:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788521371.793371:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788521371.793374:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788521371.793376:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521371.793417:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222471680:0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.793429:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222472192:0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.793439:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222472704:0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.793449:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f074000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222471552:0@lo:400:kworker.0 00010000:00080000:3.0:1788521371.793531:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f074380 x1875400222472064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521371.793544:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875400222472064:0@lo:400:kworker.0 00010000:00080000:3.0:1788521371.793558:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f075c00 x1875400222472576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521371.793566:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222472576:0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.793615:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222471424:0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.793637:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875400222471936:0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.793647:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222472448:0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.793658:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222471808:0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.793666:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1788521371.793671:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:3.0:1788521371.793686:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fee43c65180, transno 4294967311 00000100:00100000:3.0:1788521371.793709:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f075500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222472320:0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.793722:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222472832:0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.794303:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222471296 00000100:00100000:3.0:1788521371.794310:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222471296 00000100:00100000:3.0:1788521371.794382:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1788521371.794391:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3643:x1875400222471296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521371.794443:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3643:x1875400222471296:12345-0@lo:400:kworker.0 Request processed in 54us (4745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521371.794450:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1788521371.796096:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788521371.796115:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58343b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222473088:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788521371.796191:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521371.796242:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222473088 00000100:00100000:0.0:1788521371.796249:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222473088 00000100:00100000:0.0:1788521371.796289:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788521371.796296:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222473088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788521371.796327:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788521371.796368:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222473088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521371.796375:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788521371.796418:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58343b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222473088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788521371.799959:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3643:1875400222471296:0@lo:400:kworker.0 00010000:00010000:1.0:1788521371.859327:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521372.303516:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788521372.303539:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222473216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788521372.303613:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521372.303693:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222473344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788521372.303718:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521372.303760:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222473344 00000100:00100000:0.0:1788521372.303768:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222473344 00000100:00100000:3.0:1788521372.303801:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222473216 00000100:00100000:3.0:1788521372.303805:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222473216 00000100:00100000:0.0:1788521372.303820:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788521372.303829:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222473344:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788521372.303831:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788521372.303836:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222473216:12345-0@lo:41:osp-pre-1-0.0 00002000:00000024:0.0:1788521372.303851:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000004:00000024:3.0:1788521372.303858:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788521372.303915:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222473216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521372.303922:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788521372.303970:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222473216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788521372.304131:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222473344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 302us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521372.304137:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788521372.304205:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222473344:0@lo:13:osp-pre-1-1.0 00000004:00080000:3.0:1788521372.816383:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000001:00080000:3.0:1788521372.818022:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:3.0:1788521372.818058:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8fef8147fcc0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788521372.818064:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fee4348d100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8fef8147f6c0 00000020:00080000:3.0:1788521372.818068:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fee4348da00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8fef460ed400 00000020:00080000:3.0:1788521372.818091:0:6498:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1788521372.818181:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000001:00080000:1.0:1788521372.819497:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1788521372.819519:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000100:00100000:1.0:1788521372.819840:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222473472:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788521372.819958:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521372.820051:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222473472 00000100:00100000:1.0:1788521372.820061:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222473472 00000100:00100000:1.0:1788521372.820157:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788521372.820168:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222473472:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788521372.820358:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788521372.820362:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1788521365 -> 1788521365 00002000:00010000:1.0:1788521372.820364:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 1788521364 -> 1788521364 00002000:00010000:1.0:1788521372.820366:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788521365 -> 1788521365 00002000:00010000:1.0:1788521372.820368:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788521372.820417:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1875400222473472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 251us (459us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788521372.820425:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788521372.820478:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1788521372.820494:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fee424e9500, transno 4294967322 00000004:00080000:1.0:1788521372.820506:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1788521372.820537:0:3644:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8fef76714e00 x1875400222473472/t4294967325(4294967325) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788521388 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788521372.820550:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fef76714e00/2, rc 0, transno 4294967325 00000100:00100000:1.0:1788521372.820557:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222473472:0@lo:2:osp-syn-1-0.0 00000020:00080000:3.0:1788521372.820675:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1788521372.820776:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc800/0x411dd0ee4d2d22d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521372.820801:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc800/0x411dd0ee4d2d22d3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521372.820810:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc800/0x411dd0ee4d2d22d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521372.820816:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef413fc800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521372.820821:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc800/0x411dd0ee4d2d22d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521372.820830:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc800/0x411dd0ee4d2d22d3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521372.820852:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8fef76505600) 00010000:00010000:2.0:1788521372.820855:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521372.820861:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc800/0x411dd0ee4d2d22d3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521372.820867:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fc800/0x411dd0ee4d2d22d3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521372.877729:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521373.901482:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521374.351321:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef44fc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222473600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788521374.351423:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521374.352122:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222473600 00000100:00100000:2.0:1788521374.352142:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222473600 00000100:00100000:2.0:1788521374.352213:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788521374.352224:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222473600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788521374.352260:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521374.352336:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222473600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521374.352363:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:2.0:1788521374.352391:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521374.352809:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58343b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222473728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521374.352851:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521374.352913:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222473728 00000100:00100000:0.0:1788521374.352918:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222473728 00000100:00100000:0.0:1788521374.352953:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788521374.352959:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58342a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222473728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788521374.352972:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521374.353003:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58342a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222473728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521374.353019:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788521374.353069:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58343b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222473728:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788521374.353091:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521374.353516:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef44fc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222473600:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788521374.933206:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521375.348269:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521375.348400:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201451264 00000100:00100000:3.0:1788521375.348413:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201451264 00000100:00100000:3.0:1788521375.348510:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 255 00000100:00100000:3.0:1788521375.348523:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+18:12177:x1875400201451264:12345-192.168.203.41@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788521375.348666:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+18:12177:x1875400201451264:12345-192.168.203.41@tcp:60:lhsmtool_posix.0 Request processed in 146us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521375.348673:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 255 00000100:00080000:0.0:1788521375.349102:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521375.350643:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521375.350732:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201451392 00000100:00100000:3.0:1788521375.350743:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201451392 00000100:00100000:3.0:1788521375.350844:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 256 00000100:00100000:3.0:1788521375.350857:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+5:12177:x1875400201451392:12345-192.168.203.41@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788521375.351026:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+5:12177:x1875400201451392:12345-192.168.203.41@tcp:60:lhsmtool_posix.0 Request processed in 172us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521375.351034:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 256 00000100:00080000:0.0:1788521375.351747:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788521375.354543:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521375.354757:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201451648 00000100:00100000:2.0:1788521375.354770:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201451648 00000100:00100000:2.0:1788521375.354843:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 65 00000100:00100000:2.0:1788521375.354856:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+18:12177:x1875400201451648:12345-192.168.203.41@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788521375.355226:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+19:12177:x1875400201451648:12345-192.168.203.41@tcp:35:lhsmtool_posix.0 Request processed in 372us (697us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788521375.355234:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 65 00000100:00100000:2.0:1788521375.697315:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521375.697431:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201451776 00000100:00100000:0.0:1788521375.697444:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201451776 00000100:00100000:0.0:1788521375.697540:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 257 00000100:00100000:0.0:1788521375.697552:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:12990:x1875400201451776:12345-192.168.203.41@tcp:101:lsof.0 00010000:00010000:0.0:1788521375.697592:0:12956:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521375.697623:0:12956:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12da00/0x411dd0ee4d2d235f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed989 expref: -99 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521375.697709:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c800/0x411dd0ee4d2d2366 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521375.697726:0:12956:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c800/0x411dd0ee4d2d2366 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521375.697742:0:12956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c800/0x411dd0ee4d2d2366 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521375.697802:0:12956:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788521375.697806:0:12956:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788521375.697833:0:12956:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c800/0x411dd0ee4d2d2366 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12956 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521375.697860:0:12956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12da00/0x411dd0ee4d2d235f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed989 expref: 7 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521375.697971:0:12956:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c800/0x411dd0ee4d2d2366 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed989 expref: 6 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521375.697980:0:12956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef76505500) 00010000:00010000:0.0:1788521375.697983:0:12956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788521375.697988:0:12956:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef7f12c800, rc 0) 00000100:00100000:0.0:1788521375.698056:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:12990:x1875400201451776:12345-192.168.203.41@tcp:101:lsof.0 Request processed in 506us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521375.698063:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 257 00000100:00080000:2.0:1788521375.698252:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788521375.949167:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521376.875179:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521376.875232:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521376.875263:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521376.875310:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521376.875335:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521376.875356:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521376.875385:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521376.875418:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201451904 00000100:00100000:2.0:1788521376.875430:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201451904 00000100:00100000:2.0:1788521376.875495:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 399 00000100:00100000:2.0:1788521376.875515:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2394:x1875400201451904:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521376.875616:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2394:x1875400201451904:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 105us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521376.875654:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 399 00000100:00100000:2.0:1788521376.875697:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201452288 00000100:00100000:2.0:1788521376.875701:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201452288 00000100:00100000:2.0:1788521376.875740:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201452416 00000100:00100000:2.0:1788521376.875743:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201452416 00000100:00100000:2.0:1788521376.875763:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 161 00000100:00100000:2.0:1788521376.875770:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2394:x1875400201452288:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521376.875803:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2394:x1875400201452288:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 34us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521376.875809:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 161 00000100:00100000:2.0:1788521376.875821:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 162 00000100:00100000:2.0:1788521376.875826:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+7:2394:x1875400201452416:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521376.875850:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+7:2394:x1875400201452416:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 24us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521376.875856:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 162 00000100:00100000:2.0:1788521376.875871:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201452032 00000100:00100000:2.0:1788521376.875875:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201452032 00000100:00100000:2.0:1788521376.875945:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201452544 00000100:00100000:2.0:1788521376.875948:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201452544 00000100:00100000:2.0:1788521376.875956:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201452160 00000100:00100000:2.0:1788521376.875959:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201452160 00000100:00100000:2.0:1788521376.875967:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201452672 00000100:00100000:2.0:1788521376.875969:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201452672 00000100:00100000:2.0:1788521376.875983:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 370 00000100:00100000:2.0:1788521376.875989:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+19:2394:x1875400201452032:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521376.876028:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+19:2394:x1875400201452032:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 40us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521376.876041:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 370 00000100:00100000:2.0:1788521376.876053:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 371 00000100:00100000:2.0:1788521376.876058:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:2394:x1875400201452544:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521376.876083:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:2394:x1875400201452544:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 24us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521376.876089:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 371 00000100:00100000:2.0:1788521376.876100:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 372 00000100:00100000:2.0:1788521376.876107:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+5:2394:x1875400201452160:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521376.876144:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fc75e887-507e-4861-8203-e266d82f5177+5:2394:x1875400201452160:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 38us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521376.876150:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 372 00000100:00100000:2.0:1788521376.876161:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 373 00000100:00100000:2.0:1788521376.876167:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2394:x1875400201452672:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521376.876189:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2394:x1875400201452672:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 23us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521376.876196:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 373 00000100:00080000:2.0:1788521376.876213:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788521376.876218:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521376.876220:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521376.909680:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58343b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222473856:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788521376.909797:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521376.909940:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222473856 00000100:00100000:3.0:1788521376.909952:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222473856 00000100:00100000:3.0:1788521376.910027:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788521376.910039:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222473856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788521376.910090:0:10099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788521376.910152:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222473856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521376.910160:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788521376.910219:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58343b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222473856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788521376.910613:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58343b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875400222474240:0@lo:400:kworker.0 00000100:00100000:0.0:1788521376.910656:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521376.910688:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222474752:0@lo:400:kworker.0 00000100:00100000:0.0:1788521376.910724:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521376.910743:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222475264:0@lo:400:kworker.0 00000100:00100000:0.0:1788521376.910766:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521376.910787:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788521376.910792:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58343480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875400222474112:0@lo:400:kworker.0 00000100:00100000:0.0:1788521376.910813:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521376.910828:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875400222474624:0@lo:400:kworker.0 00000100:00100000:0.0:1788521376.910847:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521376.910860:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875400222475136:0@lo:400:kworker.0 00000100:00100000:0.0:1788521376.910878:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521376.910935:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222474752 00000100:00100000:0.0:1788521376.910941:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222474752 00000100:00100000:0.0:1788521376.911009:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222475264 00000100:00100000:0.0:1788521376.911013:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222475264 00000100:00100000:0.0:1788521376.911034:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788521376.911042:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222474752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521376.911081:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222474752:12345-0@lo:400:kworker.0 Request processed in 40us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521376.911088:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788521376.911100:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788521376.911106:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222475264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521376.911141:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222475264:12345-0@lo:400:kworker.0 Request processed in 36us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521376.911148:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:0.0:1788521376.911164:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521376.911169:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521376.911194:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222474752:0@lo:400:kworker.0 00000100:00100000:0.0:1788521376.911204:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222475264:0@lo:400:kworker.0 00000100:00100000:0.0:1788521376.911229:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222474240 00000100:00100000:0.0:1788521376.911232:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222474240 00000100:00100000:0.0:1788521376.911255:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222474112 00000100:00100000:0.0:1788521376.911257:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222474112 00000100:00100000:0.0:1788521376.911266:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222474624 00000100:00100000:0.0:1788521376.911269:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222474624 00000100:00100000:0.0:1788521376.911286:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222475136 00000100:00100000:0.0:1788521376.911288:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222475136 00000100:00100000:0.0:1788521376.911302:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1788521376.911308:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875400222474240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521376.911343:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875400222474240:12345-0@lo:400:kworker.0 Request processed in 35us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521376.911360:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1788521376.911373:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1788521376.911379:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875400222474112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521376.911407:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875400222474112:12345-0@lo:400:kworker.0 Request processed in 29us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521376.911413:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1788521376.911424:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788521376.911429:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875400222474624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521376.911451:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875400222474624:12345-0@lo:400:kworker.0 Request processed in 23us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521376.911457:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788521376.911466:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1788521376.911472:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875400222475136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521376.911493:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875400222475136:12345-0@lo:400:kworker.0 Request processed in 22us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521376.911499:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00080000:0.0:1788521376.911514:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788521376.911531:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58343480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875400222474112:0@lo:400:kworker.0 00010000:00080000:0.0:1788521376.911545:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43e2b480 x1875400222474624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521376.911555:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875400222474624:0@lo:400:kworker.0 00010000:00080000:0.0:1788521376.911564:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43599f80 x1875400222475136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521376.911572:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3646:1875400222475136:0@lo:400:kworker.0 00000100:00100000:0.0:1788521376.911591:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58343b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875400222474240:0@lo:400:kworker.0 00000100:00100000:1.0:1788521376.912008:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58341880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222473984:0@lo:400:kworker.0 00000100:00100000:1.0:1788521376.912064:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521376.912097:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875400222474496:0@lo:400:kworker.0 00000100:00100000:1.0:1788521376.912135:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521376.912156:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4359bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875400222475008:0@lo:400:kworker.0 00000100:00100000:1.0:1788521376.912179:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521376.912199:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788521376.912207:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222474368:0@lo:400:kworker.0 00000100:00100000:1.0:1788521376.912231:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521376.912250:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222474880:0@lo:400:kworker.0 00000100:00100000:1.0:1788521376.912273:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521376.912292:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222475392:0@lo:400:kworker.0 00000100:00100000:1.0:1788521376.912313:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521376.912376:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222474368 00000100:00100000:1.0:1788521376.912384:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222474368 00000100:00100000:1.0:1788521376.912421:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788521376.912429:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222474368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521376.912474:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222474368:12345-0@lo:400:kworker.0 Request processed in 46us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521376.912480:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788521376.912675:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222474880 00000100:00100000:1.0:1788521376.912680:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222474880 00000100:00100000:1.0:1788521376.912712:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222475392 00000100:00100000:1.0:1788521376.912868:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222475392 00000100:00100000:1.0:1788521376.912924:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788521376.912931:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222474880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521376.912970:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222474880:12345-0@lo:400:kworker.0 Request processed in 40us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521376.912976:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788521376.913384:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222473984 00000100:00100000:0.0:1788521376.913390:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222473984 00000100:00100000:0.0:1788521376.913437:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1788521376.913445:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3644:x1875400222473984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521376.913487:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3644:x1875400222473984:12345-0@lo:400:kworker.0 Request processed in 43us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521376.913493:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1788521376.914098:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222474496 00000100:00100000:3.0:1788521376.914105:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222474496 00000100:00100000:3.0:1788521376.914152:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222475008 00000100:00100000:3.0:1788521376.914156:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222475008 00000100:00100000:3.0:1788521376.914172:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1788521376.914180:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875400222474496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521376.914245:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875400222474496:12345-0@lo:400:kworker.0 Request processed in 65us (2109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521376.914252:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1788521376.914267:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1788521376.914274:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875400222475008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521376.914302:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875400222475008:12345-0@lo:400:kworker.0 Request processed in 29us (2122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521376.914308:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1788521376.914340:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788521376.914357:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef44fc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222475520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521376.914402:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521376.914444:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222475520 00000100:00100000:3.0:1788521376.914465:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222475520 00000100:00100000:3.0:1788521376.914498:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788521376.914519:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875400222475520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788521376.914550:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788521376.914601:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875400222475520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521376.914608:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788521376.914666:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef44fc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222475520:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788521376.914852:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788521376.914859:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788521376.914861:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521376.914925:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788521376.914935:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875400222475392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521376.914973:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875400222475392:12345-0@lo:400:kworker.0 Request processed in 40us (2658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521376.914978:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788521376.930196:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222474368:0@lo:400:kworker.0 00000100:00100000:3.0:1788521376.930224:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222474880:0@lo:400:kworker.0 00000100:00100000:3.0:1788521376.930239:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222475392:0@lo:400:kworker.0 00000100:00100000:3.0:1788521376.930645:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58341880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222473984:0@lo:400:kworker.0 00000100:00100000:3.0:1788521376.930663:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875400222474496:0@lo:400:kworker.0 00000100:00100000:3.0:1788521376.930679:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4359bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875400222475008:0@lo:400:kworker.0 00010000:00010000:1.0:1788521376.973601:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788521377.037793:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788521377.358138:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788521377.358150:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788521377.358292:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1788521377.358302:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788521377.422065:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222475648:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788521377.422173:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521377.422344:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222475648 00000100:00100000:2.0:1788521377.422355:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222475648 00000100:00100000:2.0:1788521377.422424:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788521377.422435:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222475648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788521377.422480:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788521377.422564:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222475648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521377.422573:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788521377.422628:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222475648:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788521377.422833:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222475776:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788521377.422870:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521377.422985:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222475776 00000100:00100000:3.0:1788521377.422998:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222475776 00000100:00100000:3.0:1788521377.423043:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788521377.423051:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43599f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222475776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788521377.423069:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788521377.423121:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43599f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222475776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521377.423127:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788521377.423162:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76717480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222475776:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788521378.000619:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788521378.958714:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:0.0:1788521378.958732:0:6498:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1788521378.959700:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788521378.959720:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:2.0:1788521378.969455:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00010000:00010000:0.0:1788521379.021434:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788521379.315241:0:15013:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 07:29:37 (1788521377) 00000100:00100000:3.0:1788521379.471740:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222475904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521379.471849:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521379.472050:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222475904 00000100:00100000:0.0:1788521379.472061:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222475904 00000100:00100000:0.0:1788521379.472147:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788521379.472159:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222475904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788521379.472196:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521379.472258:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222475904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521379.472267:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:3.0:1788521379.472268:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521379.472338:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222475904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521379.474627:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521379.474665:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef44fca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222476032:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788521379.474751:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521379.474819:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222476032 00000100:00100000:2.0:1788521379.474827:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222476032 00000100:00100000:2.0:1788521379.474928:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788521379.474938:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222476032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788521379.474965:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521379.475015:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222476032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521379.475022:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:2.0:1788521379.475047:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521379.475112:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef44fca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222476032:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788521380.045168:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521381.071915:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521381.997182:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521381.997224:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521381.997282:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521381.997311:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521381.997329:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521381.997345:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521381.997366:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521381.997429:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201452800 00000100:00100000:2.0:1788521381.997439:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201452800 00000100:00100000:2.0:1788521381.997502:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 401 00000100:00100000:2.0:1788521381.997512:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2396:x1875400201452800:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521381.997581:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2396:x1875400201452800:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 71us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521381.997595:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 401 00000100:00100000:1.0:1788521381.997925:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201453184 00000100:00100000:1.0:1788521381.997930:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201453184 00000100:00100000:1.0:1788521381.997974:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201453312 00000100:00100000:1.0:1788521381.997977:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201453312 00000100:00100000:1.0:1788521381.997999:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 167 00000100:00100000:1.0:1788521381.998015:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201453184:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521381.998055:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2395:x1875400201453184:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 43us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521381.998062:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 167 00000100:00100000:1.0:1788521381.998087:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 168 00000100:00100000:1.0:1788521381.998095:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+7:2396:x1875400201453312:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521381.998118:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fc75e887-507e-4861-8203-e266d82f5177+7:2396:x1875400201453312:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 25us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521381.998124:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 168 00000100:00080000:2.0:1788521381.998193:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521381.998197:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521382.001987:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201452928 00000100:00100000:3.0:1788521382.002001:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201452928 00000100:00080000:2.0:1788521382.002149:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521382.002201:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201453440 00000100:00100000:3.0:1788521382.002204:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201453440 00000100:00080000:0.0:1788521382.003727:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521382.004391:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201453056 00000100:00100000:1.0:1788521382.004403:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201453056 00000100:00100000:2.0:1788521382.006082:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201453568 00000100:00100000:2.0:1788521382.006095:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201453568 00000100:00100000:2.0:1788521382.006155:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 380 00000100:00100000:2.0:1788521382.006166:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+18:2395:x1875400201452928:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521382.006256:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fc75e887-507e-4861-8203-e266d82f5177+18:2395:x1875400201452928:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 92us (9083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521382.006264:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 380 00000100:00100000:2.0:1788521382.006283:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 381 00000100:00100000:2.0:1788521382.006291:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:2395:x1875400201453440:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521382.006316:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:2395:x1875400201453440:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 26us (9004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521382.006322:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 381 00000100:00100000:2.0:1788521382.006334:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 382 00000100:00100000:2.0:1788521382.006340:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2396:x1875400201453568:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521382.006364:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2396:x1875400201453568:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 24us (8997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521382.006371:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 382 00000100:00080000:2.0:1788521382.006551:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788521382.006771:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 383 00000100:00100000:1.0:1788521382.006781:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+5:2396:x1875400201453056:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521382.006817:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+5:2396:x1875400201453056:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 39us (9487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521382.006824:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 383 00000100:00100000:1.0:1788521382.029182:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef44fca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222476160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521382.029253:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521382.029373:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222476160 00000100:00100000:2.0:1788521382.029381:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222476160 00000100:00100000:2.0:1788521382.029439:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00080000:1.0:1788521382.029546:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521382.029601:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222476160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788521382.029637:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788521382.029677:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222476160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521382.029722:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222476288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788521382.029755:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521382.029755:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222476672:0@lo:400:kworker.0 00000100:00100000:3.0:1788521382.029774:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875400222476800:0@lo:400:kworker.0 00000100:00100000:0.0:1788521382.029779:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521382.029794:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58343480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875400222477184:0@lo:400:kworker.0 00000100:00100000:3.0:1788521382.029795:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521382.029812:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521382.029818:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222477312:0@lo:400:kworker.0 00000100:00100000:0.0:1788521382.029824:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222477696:0@lo:400:kworker.0 00000100:00100000:3.0:1788521382.029838:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521382.029839:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521382.029852:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222477824:0@lo:400:kworker.0 00000100:00100000:0.0:1788521382.029866:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000100:00100000:3.0:1788521382.029869:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788521382.029870:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fef76714e00, transno 4294967325 00000100:00100000:0.0:1788521382.029900:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef44fca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222476160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521382.029909:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222476288 00000100:00100000:3.0:1788521382.029919:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222476288 00000100:00100000:0.0:1788521382.029929:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4359bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875400222476544:0@lo:400:kworker.0 00000100:00100000:3.0:1788521382.029945:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222476672 00000100:00100000:3.0:1788521382.029947:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222476672 00000100:00100000:0.0:1788521382.029953:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521382.029959:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788521382.029965:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1875400222476288:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788521382.029968:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58343b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875400222477056:0@lo:400:kworker.0 00000100:00100000:0.0:1788521382.029987:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:3.0:1788521382.029988:0:10099:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788521382.030005:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875400222477568:0@lo:400:kworker.0 00000100:00100000:3.0:1788521382.030020:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1875400222476288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521382.030024:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521382.030027:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788521382.030035:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788521382.030039:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4359b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222476416:0@lo:400:kworker.0 00000100:00100000:3.0:1788521382.030041:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788521382.030046:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222476672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521382.030064:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521382.033014:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222476672:12345-0@lo:400:kworker.0 Request processed in 2959us (3226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521382.033027:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788521382.033095:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222477312 00000100:00100000:3.0:1788521382.033104:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222477312 00000100:00100000:3.0:1788521382.033151:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222477824 00000100:00100000:3.0:1788521382.033155:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222477824 00000100:00100000:3.0:1788521382.033180:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788521382.033187:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f075500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222477312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521382.033231:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f075500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222477312:12345-0@lo:400:kworker.0 Request processed in 45us (3392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521382.033237:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788521382.033248:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788521382.033253:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f077100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222477824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521382.033280:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f077100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222477824:12345-0@lo:400:kworker.0 Request processed in 27us (3410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521382.033302:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788521382.033356:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222477312:0@lo:400:kworker.0 00000100:00100000:3.0:1788521382.033369:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222477824:0@lo:400:kworker.0 00000100:00100000:3.0:1788521382.033386:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222476288:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1788521382.039910:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788521382.039920:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521382.040103:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222476800 00000100:00100000:1.0:1788521382.040113:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222476800 00000100:00100000:1.0:1788521382.040147:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222477184 00000100:00100000:1.0:1788521382.040151:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222477184 00000100:00100000:1.0:1788521382.040176:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222477696 00000100:00100000:1.0:1788521382.040194:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222477696 00000100:00100000:1.0:1788521382.040210:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222476544 00000100:00100000:1.0:1788521382.040213:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222476544 00000100:00100000:1.0:1788521382.040223:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222477056 00000100:00100000:1.0:1788521382.040226:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222477056 00000100:00100000:1.0:1788521382.040238:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222477568 00000100:00100000:1.0:1788521382.040241:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222477568 00000100:00100000:1.0:1788521382.040259:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1788521382.040267:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875400222476800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521382.040351:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875400222476800:12345-0@lo:400:kworker.0 Request processed in 84us (10554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521382.040358:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1788521382.040375:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1788521382.040381:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875400222477184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521382.040409:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875400222477184:12345-0@lo:400:kworker.0 Request processed in 29us (10596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521382.040414:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1788521382.040425:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1788521382.040430:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222477696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521382.040807:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222477696:12345-0@lo:400:kworker.0 Request processed in 375us (10964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521382.040814:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1788521382.040829:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1788521382.040836:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875400222476544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521382.040867:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875400222476544:12345-0@lo:400:kworker.0 Request processed in 33us (10914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521382.040873:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1788521382.040923:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1788521382.040929:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875400222477056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521382.040970:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875400222477056:12345-0@lo:400:kworker.0 Request processed in 41us (10982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521382.040977:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1788521382.040989:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1788521382.040996:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875400222477568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521382.041021:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875400222477568:12345-0@lo:400:kworker.0 Request processed in 26us (10996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521382.041027:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00080000:1.0:1788521382.041044:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788521382.041048:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788521382.041095:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222476416 00000100:00100000:1.0:1788521382.041101:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222476416 00000100:00100000:1.0:1788521382.041139:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1788521382.041145:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3644:x1875400222476416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521382.041175:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3644:x1875400222476416:12345-0@lo:400:kworker.0 Request processed in 31us (11111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521382.041182:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1788521382.041756:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788521382.041834:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222476672:0@lo:400:kworker.0 00010000:00080000:2.0:1788521382.041852:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef58343480 x1875400222477184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521382.041863:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58343480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875400222477184:0@lo:400:kworker.0 00010000:00080000:2.0:1788521382.041876:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43e2ad80 x1875400222477696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521382.041900:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222477696:0@lo:400:kworker.0 00000100:00100000:2.0:1788521382.043116:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875400222476800:0@lo:400:kworker.0 00000100:00100000:1.0:1788521382.045261:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4359b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222476416:0@lo:400:kworker.0 00000100:00100000:1.0:1788521382.045276:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58341880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222476928:0@lo:400:kworker.0 00000100:00100000:1.0:1788521382.045335:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521382.045369:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222477440:0@lo:400:kworker.0 00000100:00100000:1.0:1788521382.045392:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521382.045430:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4359bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875400222476544:0@lo:400:kworker.0 00000100:00100000:1.0:1788521382.045471:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58343b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875400222477056:0@lo:400:kworker.0 00000100:00100000:1.0:1788521382.045484:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875400222477568:0@lo:400:kworker.0 00000100:00100000:3.0:1788521382.046354:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222476928 00000100:00100000:3.0:1788521382.046370:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222476928 00000100:00100000:3.0:1788521382.046426:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788521382.046435:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222476928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521382.046802:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222476928:12345-0@lo:400:kworker.0 Request processed in 368us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521382.046809:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788521382.047789:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222477440 00000100:00100000:0.0:1788521382.047814:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222477440 00000100:00100000:0.0:1788521382.047877:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788521382.047912:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222477440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521382.047972:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222477440:12345-0@lo:400:kworker.0 Request processed in 88us (2578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521382.047977:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:1.0:1788521382.048513:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521382.053252:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58341880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222476928:0@lo:400:kworker.0 00000100:00100000:2.0:1788521382.053273:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222477440:0@lo:400:kworker.0 00010000:00010000:1.0:1788521382.093249:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521382.545794:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788521382.545820:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222477952:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788521382.545926:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521382.547141:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222477952 00000100:00100000:1.0:1788521382.547152:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222477952 00000100:00100000:1.0:1788521382.547212:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788521382.547222:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222477952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788521382.547243:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788521382.547298:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222477952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (1372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521382.547304:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788521382.547401:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521382.547416:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222478080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788521382.547463:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521382.547602:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222478080 00000100:00100000:1.0:1788521382.547615:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222478080 00000100:00100000:1.0:1788521382.547648:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788521382.547656:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222478080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788521382.547681:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788521382.547722:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222478080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521382.547728:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788521382.547935:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222478080:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788521382.549011:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f074a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222477952:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788521383.117219:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521384.002828:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521384.003267:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201453824 00000100:00100000:0.0:1788521384.003277:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201453824 00000100:00100000:0.0:1788521384.003351:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 66 00000100:00100000:0.0:1788521384.003362:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+18:13214:x1875400201453824:12345-192.168.203.41@tcp:35:umount.0 00000100:00100000:0.0:1788521384.003640:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+19:13214:x1875400201453824:12345-192.168.203.41@tcp:35:umount.0 Request processed in 279us (818us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788521384.003648:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 66 00000100:00080000:1.0:1788521384.003952:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521384.013114:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521384.013442:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201454080 00000100:00100000:0.0:1788521384.013452:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201454080 00000100:00100000:0.0:1788521384.013511:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 67 00000100:00100000:0.0:1788521384.013523:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+19:13214:x1875400201454080:12345-192.168.203.41@tcp:35:umount.0 00000100:00100000:1.0:1788521384.017450:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fc75e887-507e-4861-8203-e266d82f5177+20:13214:x1875400201454080:12345-192.168.203.41@tcp:35:umount.0 Request processed in 3919us (4335us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1788521384.017464:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 67 00000100:00100000:3.0:1788521384.028523:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521384.029678:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201454336 00000100:00100000:2.0:1788521384.029690:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201454336 00000100:00100000:2.0:1788521384.029758:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 68 00000100:00100000:2.0:1788521384.029786:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71d3d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+20:13214:x1875400201454336:12345-192.168.203.41@tcp:35:umount.0 00000100:00100000:2.0:1788521384.030045:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71d3d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+21:13214:x1875400201454336:12345-192.168.203.41@tcp:35:umount.0 Request processed in 259us (1530us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788521384.030053:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 68 00000100:00100000:2.0:1788521384.036304:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521384.038970:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201454592 00000100:00100000:1.0:1788521384.039004:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201454592 00000100:00100000:1.0:1788521384.039152:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 69 00000100:00100000:1.0:1788521384.039164:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+21:13214:x1875400201454592:12345-192.168.203.41@tcp:35:umount.0 00000100:00100000:1.0:1788521384.039501:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fc75e887-507e-4861-8203-e266d82f5177+22:13214:x1875400201454592:12345-192.168.203.41@tcp:35:umount.0 Request processed in 339us (3207us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1788521384.039510:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 69 00000100:00100000:3.0:1788521384.049550:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521384.049588:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521384.049630:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521384.049687:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201454976 00000100:00100000:0.0:1788521384.049697:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201454976 00000100:00100000:1.0:1788521384.049699:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201454848 00000100:00100000:1.0:1788521384.049706:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201454848 00000100:00100000:0.0:1788521384.049749:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201454720 00000100:00100000:0.0:1788521384.049753:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201454720 00000100:00100000:1.0:1788521384.049757:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 21 00000100:00100000:1.0:1788521384.049770:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f075880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f234d90e-c25e-4162-a7b5-1cc50583b917+15:2395:x1875400201454976:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521384.049786:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521384.049806:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fee42410800/0x411dd0ee4d2d1590 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5b5 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521384.049824:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521384.049918:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f075880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f234d90e-c25e-4162-a7b5-1cc50583b917+14:2395:x1875400201454976:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 117us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521384.049925:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 21 00000100:00100000:1.0:1788521384.049945:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 22 00000100:00100000:1.0:1788521384.049952:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f075c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f234d90e-c25e-4162-a7b5-1cc50583b917+13:2393:x1875400201454848:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521384.049960:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521384.049969:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef4167f400/0x411dd0ee4d2d1280 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed49d expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521384.049979:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521384.049997:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f075c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f234d90e-c25e-4162-a7b5-1cc50583b917+12:2393:x1875400201454848:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 45us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521384.050017:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 22 00000100:00100000:1.0:1788521384.050034:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 23 00000100:00100000:1.0:1788521384.050040:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f074380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f234d90e-c25e-4162-a7b5-1cc50583b917+11:2393:x1875400201454720:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521384.050047:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521384.050056:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fee42410e00/0x411dd0ee4d2d133d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed4dc expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521384.050077:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521384.050096:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f074380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f234d90e-c25e-4162-a7b5-1cc50583b917+10:2393:x1875400201454720:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 56us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521384.050103:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 23 00000100:00100000:3.0:1788521384.053222:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521384.053908:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201455360 00000100:00100000:1.0:1788521384.053919:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201455360 00000100:00100000:1.0:1788521384.053999:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 80 00000100:00100000:1.0:1788521384.054009:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+7:2392:x1875400201455360:12345-192.168.203.41@tcp:9:umount.0 00000020:00000080:1.0:1788521384.054038:0:8434:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d18d1 00000020:00010000:1.0:1788521384.054046:0:8434:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8fef48511800: total 0 00000100:00080000:1.0:1788521384.054050:0:8434:0:(import.c:65:import_set_state_nolock()) ffff8fef48517800 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1788521384.054092:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:1.0:1788521384.054113:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000020:00010000:0.0:1788521384.054325:0:6508:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8fef48511800: total 0 00010000:00010000:0.0:1788521384.054385:0:6508:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8fef48511800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788521384.054449:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000101ea398/0x411dd0ee4d2d2358 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed982 expref: 6 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521384.054485:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea1ca7e4/0x411dd0ee4d2d1c89 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed79f expref: 5 pid: 8875 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521384.054500:0:6508:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8fef48511800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788521384.054513:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521384.054515:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521384.054516:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521384.054793:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fc75e887-507e-4861-8203-e266d82f5177+2:2392:x1875400201455360:12345-192.168.203.41@tcp:9:umount.0 Request processed in 783us (1577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521384.054801:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 80 00000100:00100000:3.0:1788521384.073944:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521384.074030:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201455488 00000100:00100000:0.0:1788521384.074040:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201455488 00000100:00100000:0.0:1788521384.074132:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 81 00000100:00100000:0.0:1788521384.074142:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f075f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+5:2392:x1875400201455488:12345-192.168.203.41@tcp:9:umount.0 00000020:00000080:0.0:1788521384.074173:0:8875:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d165b 00000100:00080000:0.0:1788521384.074182:0:8875:0:(import.c:65:import_set_state_nolock()) ffff8fef7f07a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788521384.074246:0:8875:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788521384.074404:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f075f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fc75e887-507e-4861-8203-e266d82f5177+2:2392:x1875400201455488:12345-192.168.203.41@tcp:9:umount.0 Request processed in 263us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521384.074412:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 81 00010000:00010000:1.0:1788521384.074591:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788521384.074828:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521384.091977:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521384.092050:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201456512 00000100:00100000:1.0:1788521384.092070:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201456512 00000100:00100000:1.0:1788521384.092133:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 258 00000100:00100000:1.0:1788521384.092158:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+22:2392:x1875400201456512:12345-192.168.203.41@tcp:39:umount.0 00000020:00000080:1.0:1788521384.092192:0:9815:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d128e 00000020:00010000:1.0:1788521384.092210:0:9815:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8fee43268800: total 0 00000100:00080000:1.0:1788521384.092227:0:9815:0:(import.c:65:import_set_state_nolock()) ffff8fee4326a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788521384.092257:0:9815:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:1.0:1788521384.092460:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fc75e887-507e-4861-8203-e266d82f5177+21:2392:x1875400201456512:12345-192.168.203.41@tcp:39:umount.0 Request processed in 304us (492us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1788521384.092468:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 258 00000020:00010000:3.0:1788521384.093588:0:7461:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8fee43268800: total 0 00010000:00010000:3.0:1788521384.093658:0:7461:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8fee43268800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788521384.093699:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef76505500) 00010000:00010000:3.0:1788521384.093704:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788521384.093714:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cbe00/0x411dd0ee4d2d1cf2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7bb expref: 20 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521384.093756:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:3.0:1788521384.093759:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521384.093764:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d1c4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed78a expref: 19 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521384.093777:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:3.0:1788521384.093780:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788521384.093784:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d1ffb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed89b expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521384.093796:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:3.0:1788521384.093799:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788521384.093803:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca200/0x411dd0ee4d2d192c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed6b8 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521384.093815:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fee410f5900) 00010000:00010000:3.0:1788521384.093818:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521384.094074:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d15d6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5ca expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521384.094100:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:3.0:1788521384.094102:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788521384.094107:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12d600/0x411dd0ee4d2d2239 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed935 expref: 15 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521384.094183:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:3.0:1788521384.094185:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788521384.094197:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb800/0x411dd0ee4d2d1c74 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed798 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521384.094212:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8fee410f7d00) 00010000:00010000:3.0:1788521384.094214:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788521384.094218:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749cb400/0x411dd0ee4d2d1b6a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed752 expref: 13 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521384.094233:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8fee42476a00) 00010000:00010000:3.0:1788521384.094235:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788521384.094239:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410c00/0x411dd0ee4d2d15ba lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5c3 expref: 12 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521384.094256:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8fef76505b00) 00010000:00010000:3.0:1788521384.094259:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788521384.094262:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee434aba00/0x411dd0ee4d2d1d0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed7c2 expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521384.094275:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:3.0:1788521384.094278:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788521384.094281:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef413fdc00/0x411dd0ee4d2d2343 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed97b expref: 10 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521384.094292:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8fef51db3700) 00010000:00010000:3.0:1788521384.094294:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788521384.094298:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef749ca000/0x411dd0ee4d2d1631 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5df expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521384.094314:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8fef74a77f00) 00010000:00010000:3.0:1788521384.094322:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521384.094326:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2319 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed96d expref: 8 pid: 9815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521384.094339:0:7461:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8fee43268800, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1788521384.094357:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521384.094359:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521384.094361:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521384.106293:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521384.106387:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201456640 00000100:00100000:1.0:1788521384.106397:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201456640 00000100:00100000:1.0:1788521384.106486:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 259 00000100:00100000:1.0:1788521384.106496:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+5:2392:x1875400201456640:12345-192.168.203.41@tcp:39:umount.0 00000020:00000080:1.0:1788521384.106524:0:6520:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d1295 00000100:00080000:1.0:1788521384.106540:0:6520:0:(import.c:65:import_set_state_nolock()) ffff8fef7efd7800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788521384.106570:0:6520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788521384.106728:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fc75e887-507e-4861-8203-e266d82f5177+3:2392:x1875400201456640:12345-192.168.203.41@tcp:39:umount.0 Request processed in 232us (442us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788521384.106736:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 259 00010000:00010000:0.0:1788521384.106764:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788521384.107349:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788521384.141233:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521384.589399:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788521384.589424:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222478208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521384.589491:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521384.589642:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222478208 00000100:00100000:0.0:1788521384.589650:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222478208 00000100:00100000:0.0:1788521384.589711:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788521384.589721:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f074e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222478208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788521384.589765:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788521384.589811:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f074e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222478208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521384.589818:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788521384.589951:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222478208:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788521384.590406:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521384.590640:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222478336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788521384.590678:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521384.590765:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222478336 00000100:00100000:1.0:1788521384.590770:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222478336 00000100:00100000:1.0:1788521384.590822:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788521384.590829:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f074a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222478336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788521384.590842:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788521384.590878:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f074a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222478336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521384.590911:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:3.0:1788521384.591006:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521384.591031:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222478336:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788521385.167138:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521385.971376:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521385.971434:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521385.971535:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201456896 00000100:00100000:0.0:1788521385.971545:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201456896 00000100:00100000:0.0:1788521385.971612:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201456768 00000100:00100000:0.0:1788521385.971616:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201456768 00000100:00100000:0.0:1788521385.971636:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 24 00000100:00100000:0.0:1788521385.971645:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f234d90e-c25e-4162-a7b5-1cc50583b917+11:2395:x1875400201456896:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521385.971660:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521385.971678:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef749cac00/0x411dd0ee4d2d1398 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed522 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521385.971694:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521385.971756:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f234d90e-c25e-4162-a7b5-1cc50583b917+10:2395:x1875400201456896:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 111us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521385.971763:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 24 00000100:00100000:0.0:1788521385.971780:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 25 00000100:00100000:0.0:1788521385.971786:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4e7e0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f234d90e-c25e-4162-a7b5-1cc50583b917+9:2395:x1875400201456768:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521385.971794:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521385.971803:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fee434abc00/0x411dd0ee4d2d1391 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed4f1 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521385.971812:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521385.971841:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4e7e0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f234d90e-c25e-4162-a7b5-1cc50583b917+8:2395:x1875400201456768:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 55us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521385.971870:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 25 00000100:00100000:0.0:1788521385.976575:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521385.977294:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201457024 00000100:00100000:3.0:1788521385.977304:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201457024 00000100:00100000:3.0:1788521385.977378:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 26 00000100:00100000:3.0:1788521385.977389:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f234d90e-c25e-4162-a7b5-1cc50583b917+8:2396:x1875400201457024:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521385.977405:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521385.977972:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef749cae00/0x411dd0ee4d2d1589 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed5ae expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521385.977993:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521385.978064:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f234d90e-c25e-4162-a7b5-1cc50583b917+7:2396:x1875400201457024:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 676us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521385.978083:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 26 00000100:00100000:3.0:1788521385.996199:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521385.996578:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201457280 00000100:00100000:1.0:1788521385.996588:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201457280 00000100:00100000:1.0:1788521385.996728:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 260 00000100:00100000:1.0:1788521385.996740:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+6:2392:x1875400201457280:12345-192.168.203.41@tcp:39:umount.0 00000020:00000080:1.0:1788521385.996779:0:6519:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d13ad 00000020:00010000:1.0:1788521385.996788:0:6519:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8fee41abb000: total 0 00000100:00080000:1.0:1788521385.996802:0:6519:0:(import.c:65:import_set_state_nolock()) ffff8fee41abe800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788521385.996836:0:6519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:1.0:1788521385.997060:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2392:x1875400201457280:12345-192.168.203.41@tcp:39:umount.0 Request processed in 311us (859us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1788521385.997068:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 260 00000100:00080000:3.0:1788521385.997154:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:2.0:1788521385.997361:0:6507:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8fee41abb000: total 0 00010000:00010000:2.0:1788521385.997411:0:6507:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8fee41abb000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788521385.997446:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef76505500) 00010000:00010000:2.0:1788521385.997449:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788521385.997457:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef7f12c800/0x411dd0ee4d2d2366 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed989 expref: 4 pid: 12956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521385.997482:0:6507:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8fee41abb000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788521385.997493:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521385.997494:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521385.997496:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521386.015001:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521386.015087:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201457408 00000100:00100000:1.0:1788521386.015106:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201457408 00000100:00100000:1.0:1788521386.015178:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 261 00000100:00100000:1.0:1788521386.015189:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+5:2392:x1875400201457408:12345-192.168.203.41@tcp:39:umount.0 00000020:00000080:1.0:1788521386.015232:0:9815:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d13a6 00000100:00080000:1.0:1788521386.015243:0:9815:0:(import.c:65:import_set_state_nolock()) ffff8fef7f064800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788521386.015277:0:9815:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788521386.015436:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3ebc0a53-9d31-4673-9ea1-597a62a00e6b+3:2392:x1875400201457408:12345-192.168.203.41@tcp:39:umount.0 Request processed in 248us (444us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788521386.015443:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 261 00010000:00010000:2.0:1788521386.015533:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788521386.015916:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788521386.083590:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521386.083878:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201457664 00000100:00100000:0.0:1788521386.083936:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201457664 00000100:00100000:0.0:1788521386.083983:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 403 00000100:00100000:0.0:1788521386.083993:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+7:2392:x1875400201457664:12345-192.168.203.41@tcp:251:umount.0 00000020:00000080:0.0:1788521386.084035:0:6512:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d126b 00000020:00010000:0.0:1788521386.084042:0:6512:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8fef7efd7000: total 0 00000100:00080000:0.0:1788521386.084056:0:6512:0:(import.c:65:import_set_state_nolock()) ffff8fee4326c000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788521386.084125:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f234d90e-c25e-4162-a7b5-1cc50583b917+3:2392:x1875400201457664:12345-192.168.203.41@tcp:251:umount.0 Request processed in 133us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521386.084132:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 403 00000020:00010000:2.0:1788521386.084540:0:13735:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8fef7efd7000: total 0 00010000:00010000:2.0:1788521386.084590:0:13735:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8fef7efd7000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788521386.084625:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef6d7b7400/0x411dd0ee4d2d1344 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed4e3 expref: 2 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521386.084659:0:13735:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8fef7efd7000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788521386.084670:0:13735:0:(genops.c:885:class_export_put()) final put ffff8fef7efd7000/f234d90e-c25e-4162-a7b5-1cc50583b917 00010000:00010000:2.0:1788521386.084690:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521386.084692:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521386.084694:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788521386.084733:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef7efd7000/f234d90e-c25e-4162-a7b5-1cc50583b917 for MGS 00000020:00000080:1.0:1788521386.084771:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fee4326c000 for MGS 00010000:00010000:0.0:1788521386.189228:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521387.151169:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43df3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222478464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788521387.151235:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521387.151302:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222478464 00000100:00100000:0.0:1788521387.151309:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222478464 00000100:00100000:0.0:1788521387.151351:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788521387.151360:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222478464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788521387.151391:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788521387.151434:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222478464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521387.151440:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788521387.151484:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43df3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222478464:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788521387.151719:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222478720:0@lo:400:kworker.0 00000100:00100000:3.0:1788521387.151750:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521387.151790:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222478720 00000100:00100000:3.0:1788521387.151794:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222478720 00000100:00100000:3.0:1788521387.151820:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1788521387.151826:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222478720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521387.151859:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222478720:12345-0@lo:400:kworker.0 Request processed in 33us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521387.151865:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1788521387.151910:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222478720:0@lo:400:kworker.0 00000100:00100000:3.0:1788521387.151937:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875400222478848:0@lo:400:kworker.0 00000100:00100000:3.0:1788521387.151958:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521387.151986:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222478848 00000100:00100000:3.0:1788521387.151989:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222478848 00000100:00100000:3.0:1788521387.152009:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1788521387.152014:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875400222478848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521387.152051:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875400222478848:12345-0@lo:400:kworker.0 Request processed in 37us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521387.152057:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1788521387.152079:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875400222478848:0@lo:400:kworker.0 00000100:00100000:3.0:1788521387.152119:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875400222479232:0@lo:400:kworker.0 00000100:00100000:3.0:1788521387.152153:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521387.152181:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222479232 00000100:00100000:3.0:1788521387.152185:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222479232 00000100:00100000:3.0:1788521387.152213:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1788521387.152219:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875400222479232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521387.152252:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875400222479232:12345-0@lo:400:kworker.0 Request processed in 33us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521387.152257:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00010000:00080000:3.0:1788521387.152283:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f0cb100 x1875400222479232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521387.152293:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875400222479232:0@lo:400:kworker.0 00000100:00100000:3.0:1788521387.152317:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222479360:0@lo:400:kworker.0 00000100:00100000:3.0:1788521387.152338:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521387.152359:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222479360 00000100:00100000:3.0:1788521387.152362:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222479360 00000100:00100000:3.0:1788521387.152384:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788521387.152389:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222479360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521387.152416:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222479360:12345-0@lo:400:kworker.0 Request processed in 27us (77us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521387.152421:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788521387.152441:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222479360:0@lo:400:kworker.0 00000100:00100000:3.0:1788521387.152471:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222479744:0@lo:400:kworker.0 00000100:00100000:3.0:1788521387.152488:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521387.152505:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222479744 00000100:00100000:3.0:1788521387.152508:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222479744 00000100:00100000:3.0:1788521387.152531:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1788521387.152536:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222479744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521387.152561:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222479744:12345-0@lo:400:kworker.0 Request processed in 25us (72us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521387.152566:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00010000:00080000:3.0:1788521387.152588:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f0caa00 x1875400222479744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521387.152597:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222479744:0@lo:400:kworker.0 00000100:00100000:3.0:1788521387.152618:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222479872:0@lo:400:kworker.0 00000100:00100000:3.0:1788521387.152636:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521387.152797:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222478592:0@lo:400:kworker.0 00000100:00100000:0.0:1788521387.152833:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521387.152865:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875400222479104:0@lo:400:kworker.0 00000100:00100000:0.0:1788521387.152935:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521387.152948:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875400222479616:0@lo:400:kworker.0 00000100:00100000:0.0:1788521387.152965:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521387.152977:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788521387.152981:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222478976:0@lo:400:kworker.0 00000100:00100000:0.0:1788521387.152998:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521387.153008:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222479488:0@lo:400:kworker.0 00000100:00100000:0.0:1788521387.153023:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521387.153032:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222480000:0@lo:400:kworker.0 00000100:00100000:0.0:1788521387.153059:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521387.153080:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222479104 00000100:00100000:0.0:1788521387.153084:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222479104 00000100:00100000:0.0:1788521387.153104:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222479616 00000100:00100000:0.0:1788521387.153107:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222479616 00000100:00100000:0.0:1788521387.153123:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1788521387.153129:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875400222479104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521387.153163:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875400222479104:12345-0@lo:400:kworker.0 Request processed in 34us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521387.153170:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1788521387.153182:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1788521387.153187:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875400222479616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521387.153213:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875400222479616:12345-0@lo:400:kworker.0 Request processed in 26us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521387.153228:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00080000:0.0:1788521387.153244:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788521387.153248:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788521387.153249:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788521387.153257:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222479872 00000100:00100000:0.0:1788521387.153260:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222479872 00000100:00100000:0.0:1788521387.153280:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222479488 00000100:00100000:0.0:1788521387.153283:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222479488 00000100:00100000:0.0:1788521387.153292:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222480000 00000100:00100000:0.0:1788521387.153294:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222480000 00000100:00100000:0.0:1788521387.153305:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788521387.153310:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222479872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521387.153340:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222479872:12345-0@lo:400:kworker.0 Request processed in 30us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521387.153346:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788521387.153356:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788521387.153362:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222479488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521387.153385:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222479488:12345-0@lo:400:kworker.0 Request processed in 24us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521387.153392:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788521387.153400:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788521387.153405:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222480000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521387.153427:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222480000:12345-0@lo:400:kworker.0 Request processed in 22us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521387.153432:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788521387.153454:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222479488:0@lo:400:kworker.0 00000100:00100000:0.0:1788521387.153463:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222480000:0@lo:400:kworker.0 00000100:00100000:0.0:1788521387.153481:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875400222479104:0@lo:400:kworker.0 00000100:00100000:0.0:1788521387.153490:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875400222479616:0@lo:400:kworker.0 00000100:00080000:0.0:1788521387.153507:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788521387.153510:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788521387.154113:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222478592 00000100:00100000:3.0:1788521387.154119:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222478592 00000100:00100000:3.0:1788521387.154148:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1788521387.154155:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3644:x1875400222478592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521387.154209:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3644:x1875400222478592:12345-0@lo:400:kworker.0 Request processed in 55us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521387.154215:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1788521387.154244:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222478976 00000100:00100000:3.0:1788521387.154249:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222478976 00000100:00100000:3.0:1788521387.154275:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788521387.154282:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222478976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521387.154313:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222478976:12345-0@lo:400:kworker.0 Request processed in 32us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521387.154319:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788521387.154369:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222479872:0@lo:400:kworker.0 00000100:00100000:1.0:1788521387.154478:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222478976:0@lo:400:kworker.0 00000100:00100000:1.0:1788521387.154487:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222478592:0@lo:400:kworker.0 00000100:00100000:1.0:1788521387.156091:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef44fc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222480128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521387.156150:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521387.156186:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222480128 00000100:00100000:2.0:1788521387.156194:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222480128 00000100:00100000:2.0:1788521387.156236:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788521387.156244:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222480128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788521387.156270:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788521387.156311:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222480128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521387.156317:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788521387.156324:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef44fc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222480128:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788521387.214177:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788521387.277876:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788521387.599585:0:13799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788521387.599592:0:13799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788521387.599689:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788521387.599696:0:13799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00100000:0.0:1788521387.605221:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3ebc0a53-9d31-4673-9ea1-597a62a00e6b 00000001:00080000:0.0:1788521387.605240:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1788521387.605247:0:6498:0:(genops.c:885:class_export_put()) final put ffff8fee41abb000/3ebc0a53-9d31-4673-9ea1-597a62a00e6b 00000020:00000080:1.0:1788521387.610027:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fee41abb000/3ebc0a53-9d31-4673-9ea1-597a62a00e6b for lustre-MDT0000 00000001:00100000:0.0:1788521387.610033:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fc75e887-507e-4861-8203-e266d82f5177 00000001:00080000:0.0:1788521387.610059:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1788521387.610075:0:6498:0:(genops.c:885:class_export_put()) final put ffff8fee43268800/fc75e887-507e-4861-8203-e266d82f5177 00000020:00000080:1.0:1788521387.610128:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fee41abe800 for lustre-MDT0000 00000020:00000080:1.0:1788521387.610140:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fee43268800/fc75e887-507e-4861-8203-e266d82f5177 for lustre-MDT0000 00000020:00000080:1.0:1788521387.610174:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fee4326a800 for lustre-MDT0000 00000100:00100000:2.0:1788521387.662858:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef44fc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222480256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788521387.662945:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521387.663014:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222480256 00000100:00100000:2.0:1788521387.663022:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222480256 00000100:00100000:2.0:1788521387.663077:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788521387.663086:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222480256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788521387.663120:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788521387.663166:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222480256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521387.663172:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788521387.663215:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef44fc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222480256:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788521387.663692:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521387.663703:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222480384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788521387.663737:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521387.663846:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222480384 00000100:00100000:0.0:1788521387.663852:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222480384 00000100:00100000:0.0:1788521387.663910:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788521387.663917:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222480384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788521387.663932:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788521387.663966:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222480384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521387.663972:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788521387.664001:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222480384:0@lo:13:osp-pre-1-1.0 00000020:01000004:2.0:1788521387.981402:0:15208:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788521388.003017:0:15208:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788521388.003156:0:15208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee42411a00/0x411dd0ee4d2d1313 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d131a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.003174:0:15208:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee42411a00/0x411dd0ee4d2d1313 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d131a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.003182:0:15208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee42411a00/0x411dd0ee4d2d1313 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d131a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.003190:0:15208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.141@tcp lock: ffff8fee42411a00/0x411dd0ee4d2d1313 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d131a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.003216:0:15208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788521388.003221:0:15208:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788521388.003249:0:15208:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788521388.003254:0:15208:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788521388.003260:0:15208:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788521388.003285:0:15208:0:(import.c:65:import_set_state_nolock()) ffff8fef81587000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788521388.003358:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875400222480512:0@lo:39:umount.0 00000100:00100000:0.0:1788521388.003438:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521388.003516:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222480512 00000100:00100000:2.0:1788521388.003524:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222480512 00000100:00100000:2.0:1788521388.003575:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788521388.003584:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875400222480512:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788521388.003606:0:6521:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d0e82 00000100:00080000:2.0:1788521388.003613:0:6521:0:(import.c:65:import_set_state_nolock()) ffff8fef817a3000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788521388.003670:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3642:x1875400222480512:12345-0@lo:39:umount.0 Request processed in 86us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521388.003677:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:2.0:1788521388.003686:0:6521:0:(genops.c:885:class_export_put()) final put ffff8fef71ba0800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1788521388.003723:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521388.003736:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fee42411a00/0x411dd0ee4d2d1313 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d131a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.003743:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42411a00 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:2.0:1788521388.003747:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fee42411a00/0x411dd0ee4d2d1313 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d131a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.003756:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fee42411a00/0x411dd0ee4d2d1313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x411dd0ee4d2d131a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521388.003764:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fee42411a00/0x411dd0ee4d2d1313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x411dd0ee4d2d131a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521388.003770:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788521388.003772:0:7461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788521388.003775:0:7461:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:0.0:1788521388.003841:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef81587000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788521388.003854:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875400222480512:0@lo:39:umount.0 00010000:00010000:2.0:1788521388.004044:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fee42411a00/0x411dd0ee4d2d1313 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x411dd0ee4d2d131a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.004052:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521388.004079:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fee42411a00/0x411dd0ee4d2d1313 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x411dd0ee4d2d131a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.004095:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fee42411a00/0x411dd0ee4d2d1313 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x411dd0ee4d2d131a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.004108:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521388.004110:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521388.004112:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521388.004119:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788521388.004130:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222480640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788521388.004167:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788521388.004200:0:15208:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788521388.004203:0:15208:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788521388.004207:0:15208:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788521388.005066:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788521388.006180:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef71ba0800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00010000:00010000:2.0:1788521388.006505:0:15208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6200/0x411dd0ee4d2d1321 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1328 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.006517:0:15208:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6200/0x411dd0ee4d2d1321 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d1328 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.006525:0:15208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6200/0x411dd0ee4d2d1321 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d1328 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.006532:0:15208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6200/0x411dd0ee4d2d1321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d1328 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.006551:0:15208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521388.006561:0:13735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521388.006567:0:13735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6200/0x411dd0ee4d2d1321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d1328 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.006573:0:13735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6200 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:2.0:1788521388.006577:0:13735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6200/0x411dd0ee4d2d1321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d1328 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.006585:0:13735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6200/0x411dd0ee4d2d1321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x411dd0ee4d2d1328 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521388.006593:0:13735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6200/0x411dd0ee4d2d1321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x411dd0ee4d2d1328 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521388.006616:0:13735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788521388.006619:0:13735:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788521388.006648:0:13735:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6200/0x411dd0ee4d2d1321 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x411dd0ee4d2d1328 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.006654:0:13735:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521388.006673:0:13735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6200/0x411dd0ee4d2d1321 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x411dd0ee4d2d1328 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.006680:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6200/0x411dd0ee4d2d1321 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x411dd0ee4d2d1328 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.006692:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521388.006694:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521388.006696:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521388.006713:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef44fc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222480768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788521388.006772:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521388.006915:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222480640 00000100:00100000:2.0:1788521388.006922:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222480640 00000100:00100000:2.0:1788521388.006962:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222480768 00000100:00100000:2.0:1788521388.006965:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222480768 00000100:00100000:2.0:1788521388.006983:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788521388.006990:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+25:3644:x1875400222480640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788521388.007003:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521388.007018:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef6d7b6600/0x411dd0ee4d2d131a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x411dd0ee4d2d1313 expref: 25 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.007041:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521388.007199:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+24:3644:x1875400222480640:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (2913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521388.007208:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788521388.007225:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788521388.007231:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee424ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:3644:x1875400222480768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788521388.007239:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521388.007247:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fee42411600/0x411dd0ee4d2d1328 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x411dd0ee4d2d1321 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.007256:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521388.007278:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee424ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:3644:x1875400222480768:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521388.007284:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788521388.007313:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef44fc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222480768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788521388.007322:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222480640:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788521388.007393:0:15208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef40030c00/0x411dd0ee4d2d1225 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d122c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.007402:0:15208:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef40030c00/0x411dd0ee4d2d1225 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d122c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.007409:0:15208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef40030c00/0x411dd0ee4d2d1225 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d122c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.007417:0:15208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.141@tcp lock: ffff8fef40030c00/0x411dd0ee4d2d1225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d122c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.007433:0:15208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521388.007445:0:15208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d157b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1582 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.007453:0:15208:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d157b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d1582 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.007459:0:15208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d157b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d1582 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.007465:0:15208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d157b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d1582 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.007475:0:15208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788521388.007480:0:15208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef413fc400/0x411dd0ee4d2d0de1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0de8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.007485:0:15208:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef413fc400/0x411dd0ee4d2d0de1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d0de8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.007502:0:15208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef413fc400/0x411dd0ee4d2d0de1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d0de8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.007508:0:15208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.141@tcp lock: ffff8fef413fc400/0x411dd0ee4d2d0de1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d0de8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.007521:0:15208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1788521388.007525:0:15208:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788521388.007529:0:15208:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1788521388.007558:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788521388.007562:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef40030c00/0x411dd0ee4d2d1225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d122c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.007579:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40030c00 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:2.0:1788521388.007582:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef40030c00/0x411dd0ee4d2d1225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d122c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.007589:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef40030c00/0x411dd0ee4d2d1225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x411dd0ee4d2d122c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521388.007596:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef40030c00/0x411dd0ee4d2d1225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x411dd0ee4d2d122c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521388.007600:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788521388.007603:0:7461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788521388.007605:0:7461:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788521388.007619:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef40030c00/0x411dd0ee4d2d1225 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x411dd0ee4d2d122c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.007625:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521388.007641:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef40030c00/0x411dd0ee4d2d1225 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x411dd0ee4d2d122c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.007648:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef40030c00/0x411dd0ee4d2d1225 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x411dd0ee4d2d122c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.007658:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788521388.007661:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d157b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d1582 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.007666:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40031a00 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:2.0:1788521388.007668:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d157b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d1582 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.007682:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d157b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x411dd0ee4d2d1582 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521388.007687:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d157b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x411dd0ee4d2d1582 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521388.007692:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788521388.007695:0:7461:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788521388.007696:0:7461:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788521388.007710:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d157b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x411dd0ee4d2d1582 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.007715:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521388.007721:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d157b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x411dd0ee4d2d1582 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.007726:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef40031a00/0x411dd0ee4d2d157b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x411dd0ee4d2d1582 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.007736:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521388.007740:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef413fc400/0x411dd0ee4d2d0de1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d0de8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.007745:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef413fc400 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:2.0:1788521388.007748:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef413fc400/0x411dd0ee4d2d0de1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d0de8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.007753:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef413fc400/0x411dd0ee4d2d0de1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x411dd0ee4d2d0de8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521388.007769:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef413fc400/0x411dd0ee4d2d0de1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x411dd0ee4d2d0de8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521388.007774:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788521388.007776:0:7461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788521388.007778:0:7461:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788521388.007789:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef413fc400/0x411dd0ee4d2d0de1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x411dd0ee4d2d0de8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521388.007998:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521388.008076:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521388.008153:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef413fc400/0x411dd0ee4d2d0de1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x411dd0ee4d2d0de8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.008160:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef413fc400/0x411dd0ee4d2d0de1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x411dd0ee4d2d0de8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.008171:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521388.008172:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521388.008174:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521388.008187:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef44fc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222481024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788521388.008222:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521388.008252:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788521388.008258:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222480896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788521388.008278:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521388.008297:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222481024 00000100:00100000:2.0:1788521388.008301:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222481024 00000100:00100000:2.0:1788521388.008322:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222480896 00000100:00100000:2.0:1788521388.008325:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222480896 00000100:00100000:2.0:1788521388.008337:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788521388.008350:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+23:3646:x1875400222481024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788521388.008359:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521388.008369:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef40030200/0x411dd0ee4d2d1582 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x411dd0ee4d2d157b expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.008378:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521388.008405:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:3646:x1875400222481024:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521388.008411:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788521388.008512:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788521388.008522:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222481152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788521388.008549:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521388.008637:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222481152 00000100:00100000:2.0:1788521388.008641:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222481152 00000100:00100000:2.0:1788521388.008659:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788521388.008664:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+22:3646:x1875400222480896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788521388.008671:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521388.008679:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef4167fe00/0x411dd0ee4d2d122c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x411dd0ee4d2d1225 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.008689:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521388.008710:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+21:3646:x1875400222480896:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521388.008716:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788521388.008728:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788521388.008733:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+20:3644:x1875400222481152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788521388.008740:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521388.008748:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef4167e800/0x411dd0ee4d2d0de8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x411dd0ee4d2d0de1 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.008757:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521388.008873:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+19:3644:x1875400222481152:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521388.008880:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788521388.008929:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222480896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788521388.008938:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef44fc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222481024:0@lo:103:ldlm_bl.0 00000020:01000004:2.0:1788521388.008966:0:15208:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788521388.008971:0:15208:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788521388.008976:0:15208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788521388.008982:0:15208:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/10 00000020:00080000:2.0:1788521388.008986:0:15208:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8fef7a7c5800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788521388.008992:0:15208:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8fee4211a800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788521388.008996:0:15208:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8fef7a3b2800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788521388.009000:0:15208:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8fef7a235000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1788521388.009004:0:15208:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8fef6e3a19c0) has exports, disconnecting them 00000020:00080000:2.0:1788521388.009008:0:15208:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8fef7a7c5800), last request at 1788521387 00000020:00000080:2.0:1788521388.009015:0:15208:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d1192 00000100:00080000:2.0:1788521388.009046:0:15208:0:(import.c:65:import_set_state_nolock()) ffff8fee4326d800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788521388.009158:0:15208:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fef7a7c5800): rc 0 00000020:00000080:2.0:1788521388.009162:0:15208:0:(genops.c:885:class_export_put()) final put ffff8fef7a7c5800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:1.0:1788521388.009203:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521388.009221:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222481152:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521388.009303:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788521388.011624:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fef817a3000 for lustre-MDT0000 00000020:00080000:2.0:1788521388.012734:0:15208:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8fee4211a800), last request at 1788521387 00000020:00000080:2.0:1788521388.012744:0:15208:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d106c 00000100:00080000:2.0:1788521388.012754:0:15208:0:(import.c:65:import_set_state_nolock()) ffff8fee4211d800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788521388.012776:0:15208:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fee4211a800): rc 0 00000020:00000080:2.0:1788521388.012779:0:15208:0:(genops.c:885:class_export_put()) final put ffff8fee4211a800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:1.0:1788521388.012824:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788521388.013000:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef7a7c5800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788521388.013102:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fee4326d800 for lustre-MDT0000 00000020:00080000:2.0:1788521388.013233:0:15208:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8fef7a3b2800), last request at 1788521136 00000020:00000080:2.0:1788521388.013237:0:15208:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d0f69 00000100:00080000:2.0:1788521388.013256:0:15208:0:(import.c:65:import_set_state_nolock()) ffff8fef7a3b1000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788521388.013276:0:15208:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fef7a3b2800): rc 0 00000020:00000080:2.0:1788521388.013278:0:15208:0:(genops.c:885:class_export_put()) final put ffff8fef7a3b2800/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:0.0:1788521388.013301:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788521388.013325:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fee4211a800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788521388.013382:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fee4211d800 for lustre-MDT0000 00000020:00000080:1.0:1788521388.013550:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef7a3b2800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788521388.013574:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fef7a3b1000 for lustre-MDT0000 00000020:00080000:2.0:1788521388.013603:0:15208:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8fef7a235000), last request at 1788521136 00000020:00000080:2.0:1788521388.013609:0:15208:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d0f38 00000100:00080000:2.0:1788521388.013614:0:15208:0:(import.c:65:import_set_state_nolock()) ffff8fef7a3b6000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788521388.013634:0:15208:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:2.0:1788521388.013720:0:15208:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fef7a235000): rc 0 00000004:00000080:2.0:1788521388.013726:0:15208:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa9e34803fae0 00000100:00080000:2.0:1788521388.013744:0:15208:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788521388.013748:0:15208:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:1.0:1788521388.014173:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788521388.015238:0:15208:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788521388.015267:0:15208:0:(import.c:65:import_set_state_nolock()) ffff8fef755ad000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788521388.015325:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222481280:0@lo:39:umount.0 00000100:00100000:0.0:1788521388.015403:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788521388.016305:0:15208:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788521388.016309:0:15208:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1788521388.016354:0:15208:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788521388.016413:0:15208:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788521388.016440:0:15208:0:(import.c:65:import_set_state_nolock()) ffff8fef7ef40000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788521388.016455:0:15208:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788521388.016458:0:15208:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1788521388.016465:0:15208:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788521388.016647:0:15208:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788521388.016658:0:15208:0:(import.c:65:import_set_state_nolock()) ffff8fef7ef47000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788521388.016691:0:15208:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8fef6e3a19c0) has no exports 00000100:00100000:0.0:1788521388.016768:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222481408:0@lo:9:umount.0 00000100:00100000:3.0:1788521388.016910:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222481280 00000100:00100000:3.0:1788521388.016919:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222481280 00000100:00100000:3.0:1788521388.017202:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788521388.017213:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875400222481280:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788521388.017262:0:6525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d0fc4 00000100:00080000:3.0:1788521388.017271:0:6525:0:(import.c:65:import_set_state_nolock()) ffff8fef76680000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788521388.017293:0:6525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1788521388.017436:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3642:x1875400222481280:12345-0@lo:39:umount.0 Request processed in 225us (2032us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788521388.017443:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00010000:00010000:3.0:1788521388.017466:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521388.017619:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521388.017683:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef44fc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222481536:0@lo:9:umount.0 00000100:00100000:0.0:1788521388.017708:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788521388.017805:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef755ad000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788521388.017812:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222481280:0@lo:39:umount.0 00000100:00100000:1.0:1788521388.018061:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222481408 00000100:00100000:1.0:1788521388.018067:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222481408 00000100:00100000:1.0:1788521388.018113:0:8875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222481536 00000100:00100000:1.0:1788521388.018129:0:8875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222481536 00000100:00100000:1.0:1788521388.018155:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788521388.018162:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875400222481408:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788521388.018181:0:8875:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d1114 00000100:00080000:1.0:1788521388.018187:0:8875:0:(import.c:65:import_set_state_nolock()) ffff8fef7ef41800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788521388.018223:0:8875:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1788521388.018318:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3642:x1875400222481408:12345-0@lo:9:umount.0 Request processed in 155us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521388.018325:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788521388.018339:0:8875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788521388.018345:0:8875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875400222481536:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788521388.018357:0:8875:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d1256 00000100:00080000:1.0:1788521388.018362:0:8875:0:(import.c:65:import_set_state_nolock()) ffff8fee4211b800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788521388.018384:0:8875:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00010000:00010000:0.0:1788521388.018527:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788521388.018546:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef7ef40000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788521388.018555:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788521388.018557:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788521388.018560:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222481408:0@lo:9:umount.0 00000100:00100000:1.0:1788521388.018759:0:8875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3642:x1875400222481536:12345-0@lo:9:umount.0 Request processed in 413us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521388.018766:0:8875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:1.0:1788521388.018781:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788521388.018832:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef7ef47000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788521388.018856:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788521388.018859:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788521388.018862:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef44fc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222481536:0@lo:9:umount.0 00000020:00080000:3.0:1788521388.026203:0:15208:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8fef6e3a19c0) has no exports 00000020:00000080:3.0:1788521388.074418:0:15208:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d0e3c 00000020:00000080:3.0:1788521388.074485:0:15208:0:(genops.c:885:class_export_put()) final put ffff8fef81494800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788521388.074584:0:15208:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788521388.074644:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef81494800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788521388.074665:0:15208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788521388.074674:0:15208:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788521388.074691:0:15208:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8fef6da84d40) has no exports 00000020:00000080:0.0:1788521388.075285:0:15208:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d0e35 00000020:00000080:0.0:1788521388.075292:0:15208:0:(genops.c:885:class_export_put()) final put ffff8fef81476800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788521388.075340:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef81476800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788521388.075402:0:15208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788521388.075408:0:15208:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788521388.075412:0:15208:0:(genops.c:885:class_export_put()) final put ffff8fef4e626000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788521388.075414:0:15208:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef4e626000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788521388.075418:0:15208:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:0.0:1788521388.237211:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521389.261065:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521389.710047:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222481664:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788521389.710124:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521389.710934:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222481664 00000100:00100000:2.0:1788521389.710945:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222481664 00000100:00080000:0.0:1788521389.711148:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521389.711182:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788521389.711195:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222481664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788521389.711235:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788521389.711302:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222481664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521389.711310:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788521389.711387:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222481664:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1788521389.711944:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788521389.711953:0:8430:0:(genops.c:885:class_export_put()) final put ffff8fef7ef44000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788521389.711986:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fc75e887-507e-4861-8203-e266d82f5177 00000020:00000080:0.0:1788521389.711989:0:8430:0:(genops.c:885:class_export_put()) final put ffff8fef7f078800/fc75e887-507e-4861-8203-e266d82f5177 00000001:00100000:0.0:1788521389.712909:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788521389.712926:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1788521389.712931:0:7450:0:(genops.c:885:class_export_put()) final put ffff8fef817a1000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788521389.712941:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3ebc0a53-9d31-4673-9ea1-597a62a00e6b 00000001:00080000:0.0:1788521389.712946:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1788521389.712949:0:7450:0:(genops.c:885:class_export_put()) final put ffff8fef7f063800/3ebc0a53-9d31-4673-9ea1-597a62a00e6b 00000001:00100000:0.0:1788521389.712954:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fc75e887-507e-4861-8203-e266d82f5177 00000001:00080000:0.0:1788521389.712958:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1788521389.712959:0:7450:0:(genops.c:885:class_export_put()) final put ffff8fef7efd4000/fc75e887-507e-4861-8203-e266d82f5177 00000001:00100000:3.0:1788521389.713133:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788521389.713138:0:9512:0:(genops.c:885:class_export_put()) final put ffff8fee4211f800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788521389.713149:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fc75e887-507e-4861-8203-e266d82f5177 00000020:00000080:3.0:1788521389.713151:0:9512:0:(genops.c:885:class_export_put()) final put ffff8fef48511800/fc75e887-507e-4861-8203-e266d82f5177 00000020:00000080:2.0:1788521389.713809:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef7ef44000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788521389.713929:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef7f078800/fc75e887-507e-4861-8203-e266d82f5177 for lustre-OST0000 00000020:00000080:2.0:1788521389.713954:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef817a1000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788521389.714004:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef7f063800/3ebc0a53-9d31-4673-9ea1-597a62a00e6b for lustre-MDT0001 00000020:00000080:2.0:1788521389.714184:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef7efd4000/fc75e887-507e-4861-8203-e266d82f5177 for lustre-MDT0001 00000020:00000080:2.0:1788521389.714225:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fee4211f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788521389.714242:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef48511800/fc75e887-507e-4861-8203-e266d82f5177 for lustre-OST0001 00000020:00000080:2.0:1788521389.714261:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fef7ef41800 for lustre-OST0000 00000020:00000080:2.0:1788521389.714265:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fef7f07a000 for lustre-OST0000 00000020:00000080:2.0:1788521389.714268:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fef76680000 for lustre-MDT0001 00000020:00000080:2.0:1788521389.714271:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fef7f064800 for lustre-MDT0001 00000020:00000080:2.0:1788521389.714276:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fef7efd7800 for lustre-MDT0001 00000020:00000080:2.0:1788521389.714279:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fee4211b800 for lustre-OST0001 00000020:00000080:2.0:1788521389.714282:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fef48517800 for lustre-OST0001 00010000:00010000:3.0:1788521390.285465:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521391.309288:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521392.269280:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222481792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788521392.269382:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521392.269524:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222481792 00000100:00100000:0.0:1788521392.269535:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222481792 00000100:00100000:0.0:1788521392.269586:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788521392.269597:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1875400222481792:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1788521392.269638:0:10099:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788521392.269700:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1875400222481792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (318us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788521392.269708:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:02020000:2.0:1788521392.269791:0:3645:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:3.0:1788521392.271463:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222481920:0@lo:400:kworker.0 00000100:00100000:0.0:1788521392.271464:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875400222482048:0@lo:400:kworker.0 00000100:00100000:1.0:1788521392.271601:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875400222482176:0@lo:400:kworker.0 00000100:00100000:3.0:1788521392.275656:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521392.275739:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222482432:0@lo:400:kworker.0 00000100:00100000:3.0:1788521392.275784:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521392.275839:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788521392.275846:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875400222482304:0@lo:400:kworker.0 00000100:00100000:3.0:1788521392.275876:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521392.275912:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222482816:0@lo:400:kworker.0 00000100:00100000:3.0:1788521392.275934:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521392.275999:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222481920 00000100:00100000:3.0:1788521392.276414:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222481920 00000100:00100000:3.0:1788521392.276553:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:3.0:1788521392.276564:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef71e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+19:3646:x1875400222481920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521392.276645:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef71e82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf+19:3646:x1875400222481920:12345-0@lo:400:kworker.0 Request processed in 83us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521392.276652:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:3.0:1788521392.276696:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222482432 00000100:00100000:3.0:1788521392.276700:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222482432 00000100:00100000:3.0:1788521392.276748:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222482816 00000100:00100000:3.0:1788521392.276751:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222482816 00000100:00100000:3.0:1788521392.276774:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788521392.276780:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222482432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521392.276812:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222482432:12345-0@lo:400:kworker.0 Request processed in 32us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521392.276818:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788521392.276828:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788521392.276834:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222482816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521392.276858:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222482816:12345-0@lo:400:kworker.0 Request processed in 25us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521392.276865:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788521392.276908:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222482304 00000100:00100000:3.0:1788521392.276921:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222482304 00000100:00100000:3.0:1788521392.278284:0:9815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1788521392.278307:0:9815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875400222482304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521392.278402:0:9815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875400222482304:12345-0@lo:400:kworker.0 Request processed in 106us (2525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521392.278410:0:9815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00010000:00080000:3.0:1788521392.278618:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43d21c00 x1875400222482304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521392.278636:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875400222482304:0@lo:400:kworker.0 00000100:00100000:3.0:1788521392.278654:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222482816:0@lo:400:kworker.0 00000100:00100000:3.0:1788521392.278667:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222481920:0@lo:400:kworker.0 00000100:00100000:3.0:1788521392.278679:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222482432:0@lo:400:kworker.0 00000100:00080000:3.0:1788521392.278749:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788521392.278755:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788521392.278758:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521392.280292:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521392.280356:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875400222482688:0@lo:400:kworker.0 00000100:00100000:1.0:1788521392.280389:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521392.282209:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222482176 00000100:00100000:3.0:1788521392.282225:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222482176 00000100:00100000:3.0:1788521392.282285:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222482688 00000100:00100000:3.0:1788521392.282289:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222482688 00000100:00100000:3.0:1788521392.282409:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1788521392.282421:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875400222482688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521392.282512:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875400222482688:12345-0@lo:400:kworker.0 Request processed in 92us (2120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521392.282519:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1788521392.282538:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788521392.282543:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875400222482176:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788521392.282568:0:6519:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788521392.282599:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875400222482176:12345-0@lo:400:kworker.0 Request processed in 55us (2317us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788521392.282605:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:3.0:1788521392.282755:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788521392.288176:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521392.288264:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222482560:0@lo:400:kworker.0 00000100:00100000:3.0:1788521392.288277:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222482048 00000100:00100000:3.0:1788521392.288290:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222482048 00000100:00100000:0.0:1788521392.288342:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521392.288350:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788521392.288361:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875400222482048:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788521392.288372:0:12956:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788521392.288388:0:9815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222482560 00000100:00100000:0.0:1788521392.288394:0:9815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222482560 00000100:00100000:0.0:1788521392.288429:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788521392.288432:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1875400222482048:12345-0@lo:400:kworker.0 Request processed in 70us (267us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788521392.288439:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875400222482560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521392.288445:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000020:00080000:0.0:1788521392.288449:0:6521:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788521392.288488:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875400222482560:12345-0@lo:400:kworker.0 Request processed in 50us (146us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788521392.288495:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:0.0:1788521392.288542:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788521392.288548:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8fef7a3be000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788521392.288552:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788521392.288571:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8fef7a3be000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788521392.288575:0:3643:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 186 00000100:00080000:0.0:1788521392.288583:0:3643:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8fef7a3be000 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:0.0:1788521392.288620:0:3643:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee43d20000 x1875400222482944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788521392.288655:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875400222482048:0@lo:400:kworker.0 00000100:00080000:0.0:1788521392.288687:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788521392.288690:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8fef7a7c0800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788521392.288693:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788521392.288696:0:3643:0:(import.c:65:import_set_state_nolock()) ffff8fef7a7c0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788521392.288700:0:3643:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 234 00000100:00080000:0.0:1788521392.288704:0:3643:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8fef7a7c0800 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:0.0:1788521392.288719:0:3643:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee43d21500 x1875400222483072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788521392.288729:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222482560:0@lo:400:kworker.0 00000100:00100000:3.0:1788521392.288852:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875400222482944:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788521392.288901:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521392.288922:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875400222483072:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788521392.288958:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521392.289012:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222482944 00000100:00100000:3.0:1788521392.289018:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222482944 00000100:00100000:3.0:1788521392.289036:0:12956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222483072 00000100:00100000:3.0:1788521392.289039:0:12956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222483072 00000100:00100000:3.0:1788521392.289054:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788521392.289059:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875400222482944:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1788521392.289078:0:12956:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788521392.289116:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875400222482944:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 56us (215us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788521392.289123:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788521392.289136:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788521392.289149:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875400222483072:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1788521392.289157:0:12956:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788521392.289181:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875400222483072:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 32us (223us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788521392.289187:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:3.0:1788521392.289214:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef7a3be000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788521392.289219:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788521392.289222:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875400222482944:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1788521392.289231:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef7a7c0800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788521392.289234:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788521392.289237:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875400222483072:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1788521392.289453:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788521392.289457:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8fef81471000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788521392.289469:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788521392.289473:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8fef81471000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788521392.289476:0:3644:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 210 00000100:00080000:1.0:1788521392.289482:0:3644:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8fef81471000 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:1.0:1788521392.289502:0:3644:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee43d4c000 x1875400222483200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788521392.289526:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875400222482176:0@lo:400:kworker.0 00010000:00080000:1.0:1788521392.289544:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43d23800 x1875400222482688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521392.289556:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875400222482688:0@lo:400:kworker.0 00000100:00100000:3.0:1788521392.291428:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875400222483200:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788521392.291522:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521392.292859:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222483200 00000100:00100000:0.0:1788521392.292872:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222483200 00000100:00100000:0.0:1788521392.292956:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788521392.292966:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875400222483200:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1788521392.292990:0:6520:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788521392.293100:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875400222483200:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 135us (1577us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788521392.293109:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:0.0:1788521392.293172:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef81471000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788521392.293178:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788521392.293183:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875400222483200:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1788521392.331714:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788521392.331726:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8fef755ad800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788521392.331731:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788521392.331740:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8fef755ad800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788521392.333433:0:3645:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 186 00000100:00080000:2.0:1788521392.333449:0:3645:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8fef755ad800 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:3.0:1788521392.334499:0:3645:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fef7f0caa00 x1875400222483328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788521392.334877:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222483328:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788521392.334999:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521392.335125:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222483328 00000100:00100000:3.0:1788521392.335137:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222483328 00010000:00010000:1.0:1788521392.335255:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521392.335427:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788521392.335437:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1875400222483328:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1788521392.335459:0:6525:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788521392.335587:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1875400222483328:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 149us (587us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788521392.335596:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00080000:1.0:1788521392.337819:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef755ad800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788521392.337836:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788521392.337842:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222483328:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788521392.782116:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788521392.782145:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222483456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788521392.782238:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521392.782382:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222483456 00000100:00100000:3.0:1788521392.782393:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222483456 00000100:00100000:3.0:1788521392.782459:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788521392.782500:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222483456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788521392.782538:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788521392.782606:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222483456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521392.782614:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788521392.783176:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222483456:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788521393.357641:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788521393.808160:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788521393.808191:0:6498:0:(genops.c:885:class_export_put()) final put ffff8fef7a235000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788521393.808642:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef7a235000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788521393.808723:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fef7a3b6000 for lustre-MDT0000 00000020:01000000:0.0:1788521394.125087:0:15208:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fef816faf60 - data ffff8fef652575e8/ffff8fef7a500800 00000020:01000000:0.0:1788521394.125259:0:15208:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fef6d7a72a0 - data ffff8fef6517e000/ffff8fef71527c00 00000001:00000004:0.0:1788521394.135737:0:15208:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1788521394.235084:0:15208:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788521394.235096:0:15208:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788521394.235117:0:15208:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8fee43e2ad80 x1875400222481280/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788521398 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521394.235153:0:15208:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788521394.239049:0:15208:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788521394.239062:0:15208:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1788521394.239136:0:15208:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788521394.239141:0:15208:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788521394.242143:0:8873:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788521394.242154:0:8873:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1788521394.242171:0:8873:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788521394.242815:0:15208:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788521394.242823:0:15208:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1788521394.242846:0:15208:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788521394.242850:0:15208:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788521394.245703:0:9966:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788521394.245712:0:9966:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1788521394.245749:0:9966:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788521394.247533:0:15208:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d0e04 00000020:00000080:3.0:1788521394.247547:0:15208:0:(genops.c:885:class_export_put()) final put ffff8fef71575800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788521394.248584:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef71575800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788521394.256229:0:15208:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d0e19 00000020:00000080:3.0:1788521394.256249:0:15208:0:(genops.c:885:class_export_put()) final put ffff8fef71573000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788521394.256278:0:15208:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788521394.256285:0:15208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788521394.256298:0:15208:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788521394.256304:0:15208:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8fef6e3a0000) has no exports 00000004:01000000:3.0:1788521394.256534:0:15208:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788521394.256546:0:15208:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d124f 00000020:00000080:3.0:1788521394.256551:0:15208:0:(genops.c:885:class_export_put()) final put ffff8fef7efd3800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788521394.256556:0:15208:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788521394.256577:0:15208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788521394.256587:0:15208:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788521394.256590:0:15208:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff8fee426d3380) has no exports 00000020:00000080:3.0:1788521394.256599:0:15208:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d1248 00000020:00000080:3.0:1788521394.256604:0:15208:0:(genops.c:885:class_export_put()) final put ffff8fef7ef45800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788521394.257002:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef71573000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788521394.257013:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef7efd3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788521394.257018:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef7ef45800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788521394.258602:0:15208:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788521394.258612:0:15208:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788521394.258617:0:15208:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1788521394.258628:0:15208:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788521394.258631:0:15208:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788521394.258687:0:15208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788521394.258704:0:15208:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788521394.258714:0:15208:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d110d 00000020:00000080:3.0:1788521394.258725:0:15208:0:(genops.c:885:class_export_put()) final put ffff8fef7a3b5800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788521394.258733:0:15208:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788521394.258738:0:15208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788521394.258744:0:15208:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788521394.258748:0:15208:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8fef7a258000) has no exports 00000020:00000080:3.0:1788521394.258768:0:15208:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d1106 00000020:00000080:3.0:1788521394.258773:0:15208:0:(genops.c:885:class_export_put()) final put ffff8fef7ef46800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788521394.260114:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fef7ef47000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788521394.260130:0:37:0:(genops.c:885:class_export_put()) final put ffff8fee41abd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788521394.260134:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fee41abd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788521394.260142:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788521394.260246:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef7a3b5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788521394.260251:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef7ef46800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788521394.260652:0:15208:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788521394.260657:0:15208:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788521394.260662:0:15208:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1788521394.260670:0:15208:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788521394.260673:0:15208:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788521394.260725:0:15208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788521394.260739:0:15208:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788521394.260759:0:15208:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788521394.260768:0:15208:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d0fbd 00000020:00000080:3.0:1788521394.260777:0:15208:0:(genops.c:885:class_export_put()) final put ffff8fef765ba000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788521394.260781:0:15208:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788521394.260787:0:15208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788521394.260805:0:15208:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788521394.260810:0:15208:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8fef7a25b380) has no exports 00000020:00000080:3.0:1788521394.260817:0:15208:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d0fb6 00000020:00000080:3.0:1788521394.260821:0:15208:0:(genops.c:885:class_export_put()) final put ffff8fef7a233800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788521394.263156:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fef7ef40000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788521394.263182:0:37:0:(genops.c:885:class_export_put()) final put ffff8fef816f2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788521394.263186:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef816f2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788521394.263198:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788521394.263308:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef765ba000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788521394.263315:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef7a233800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788521394.273985:0:15208:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788521394.274004:0:15208:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788521394.274010:0:15208:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1788521394.274037:0:15208:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788521394.274103:0:15208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788521394.274121:0:15208:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788521394.274160:0:15208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788521394.274163:0:15208:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788521394.274171:0:15208:0:(genops.c:885:class_export_put()) final put ffff8fef71574000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788521394.274177:0:15208:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef71574000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788521394.274194:0:15208:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788521394.274318:0:15208:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d0e20 00000020:00000080:2.0:1788521394.274327:0:15208:0:(genops.c:885:class_export_put()) final put ffff8fef71575000/lustre-MDD0000_UUID 00000020:01000000:2.0:1788521394.274333:0:15208:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788521394.274337:0:15208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788521394.274342:0:15208:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788521394.274346:0:15208:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8fef6e3a3380) has no exports 00000020:00000080:2.0:1788521394.274372:0:15208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788521394.274375:0:15208:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788521394.274379:0:15208:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d0e27 00000020:00000080:2.0:1788521394.274383:0:15208:0:(genops.c:885:class_export_put()) final put ffff8fef71577000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788521394.274392:0:15208:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fef58328000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788521394.274396:0:15208:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fef58328000 3 00000020:01000004:2.0:1788521394.274399:0:15208:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8fef58328000 from lustre-MDT0000 00000020:00000080:2.0:1788521394.274420:0:15208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788521394.274423:0:15208:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788521394.274426:0:15208:0:(genops.c:885:class_export_put()) final put ffff8fef71570800/lustre-MDT0000_UUID 00000020:00000080:2.0:1788521394.274428:0:15208:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef71570800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788521394.274435:0:15208:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788521394.274463:0:15208:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788521394.274468:0:15208:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788521394.274471:0:15208:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788521394.274473:0:15208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788521394.274476:0:15208:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788521394.274486:0:15208:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8fef6d493800 0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788521394.274498:0:15208:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8fef6da83380) has exports, disconnecting them 00000020:00080000:2.0:1788521394.274503:0:15208:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8fef6d493800), last request at 1788521114 00000020:00000080:2.0:1788521394.274521:0:15208:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d0dc5 00000020:00010000:2.0:1788521394.274526:0:15208:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8fef6d493800: total 2 00000100:00080000:2.0:1788521394.274530:0:15208:0:(import.c:65:import_set_state_nolock()) ffff8fef6d494800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788521394.274554:0:15208:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fef6d493800): rc 0 00000020:00080000:2.0:1788521394.274559:0:15208:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8fef6da83380) has no exports 00000100:00100000:0.0:1788521394.274714:0:6512:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8fef5a4fc800:6512] 0 exiting: rc = 1 00000020:00000080:0.0:1788521394.274808:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fef755ad000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788521394.274815:0:37:0:(genops.c:885:class_export_put()) final put ffff8fef81665800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788521394.274818:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef81665800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1788521394.274822:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788521394.274906:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef71575000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788521394.274910:0:37:0:(genops.c:885:class_export_put()) final put ffff8fef71576000/lustre-MDD0000_UUID 00000020:00000080:0.0:1788521394.274912:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef71576000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788521394.274916:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788521394.274940:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef71577000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:0.0:1788521394.274961:0:7461:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8fef6d493800: total 0 00010000:00010000:0.0:1788521394.274966:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521394.274984:0:7461:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8fef6d493800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788521394.275030:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fee434ab000/0x411dd0ee4d2d12fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x411dd0ee4d2d12f7 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521394.275048:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef749cb000/0x411dd0ee4d2d12f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x411dd0ee4d2d12e9 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521394.275061:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef6d7b7a00/0x411dd0ee4d2d130c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x411dd0ee4d2d1305 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521394.275086:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef821dd000/0x411dd0ee4d2d0ec1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x411dd0ee4d2d0eba expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521394.275102:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef821dda00/0x411dd0ee4d2d0ecf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x411dd0ee4d2d0ec8 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521394.275114:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fee434aa400/0x411dd0ee4d2d1558 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x411dd0ee4d2d1551 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521394.275125:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fee42410200/0x411dd0ee4d2d1566 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x411dd0ee4d2d155f expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521394.275135:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef749ca600/0x411dd0ee4d2d1336 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x411dd0ee4d2d132f expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521394.275145:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef749cba00/0x411dd0ee4d2d12c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x411dd0ee4d2d12bf expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521394.275155:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef40030400/0x411dd0ee4d2d1574 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x411dd0ee4d2d156d expref: 5 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521394.275168:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef40030600/0x411dd0ee4d2d11e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x411dd0ee4d2d11df expref: 4 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521394.275181:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fee42411000/0x411dd0ee4d2d12e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x411dd0ee4d2d12db expref: 3 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521394.275192:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef6d7b6400/0x411dd0ee4d2d12d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x411dd0ee4d2d12cd expref: 2 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521394.275217:0:7461:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8fef6d493800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788521394.275233:0:7461:0:(genops.c:885:class_export_put()) final put ffff8fef6d493800/0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf 00010000:00010000:0.0:1788521394.275246:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521394.275249:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521394.275250:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788521394.275257:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef6d493800/0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf for MGS 00000020:00000080:0.0:1788521394.275280:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fef6d494800 for MGS 00000100:00100000:0.0:1788521394.277533:0:6513:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8fef52a4a800:6513] 1 exiting: rc = 0 00000100:00100000:2.0:1788521394.288276:0:6514:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8fef5a4fda00:6514] 2 exiting: rc = 0 00000100:00100000:0.0:1788521394.288477:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288487:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288494:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288501:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288508:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288514:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288522:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288528:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288534:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288542:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288548:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288555:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288561:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288568:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288576:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288583:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288589:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288595:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288600:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288607:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288614:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288621:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288627:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288652:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288660:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288666:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288673:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288679:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288686:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288692:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288698:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288705:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288710:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288717:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288723:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288728:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288735:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288741:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288747:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288753:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288758:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288766:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288772:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288778:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288784:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288794:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288800:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288807:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288813:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288819:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288826:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288831:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288837:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288844:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288850:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288856:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288863:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288868:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288919:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288926:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288933:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288939:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288946:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521394.288965:0:15208:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788521394.290506:0:15208:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fef7a44a120 - data ffff8fef653191b0/ffff8fef7679d400 00000020:01000000:0.0:1788521394.290662:0:15208:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fef42a96de0 - data ffff8fef6510d0d8/ffff8fef71de4c00 00000020:00000080:0.0:1788521394.291224:0:15208:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d0da9 00000020:00000080:0.0:1788521394.291236:0:15208:0:(genops.c:885:class_export_put()) final put ffff8fef4e6c5000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788521394.291258:0:15208:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fef58328000 from MGS, refs=2 00000020:01000004:0.0:1788521394.291261:0:15208:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fef58328000 2 00000020:01000004:0.0:1788521394.291265:0:15208:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8fef58328000 from MGS 00000020:00000080:0.0:1788521394.291290:0:15208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788521394.291298:0:15208:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788521394.291301:0:15208:0:(genops.c:885:class_export_put()) final put ffff8fef554c3800/MGS 00000020:00000080:0.0:1788521394.291304:0:15208:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef554c3800/MGS for MGS 00000020:01000000:0.0:1788521394.291313:0:15208:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788521394.291391:0:15208:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788521394.291395:0:15208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788521394.291400:0:15208:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788521394.291409:0:15208:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8fef81583800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788521394.291416:0:15208:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8fef6da80000) has exports, disconnecting them 00000020:00080000:0.0:1788521394.291422:0:15208:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8fef81583800), last request at 1788521115 00000020:00000080:0.0:1788521394.291427:0:15208:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d0e74 00000020:00080000:0.0:1788521394.291437:0:15208:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fef81583800): rc 0 00000020:00000080:0.0:1788521394.291443:0:15208:0:(genops.c:885:class_export_put()) final put ffff8fef81583800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788521394.292324:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef4e6c5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788521394.292338:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef81583800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788521394.292974:0:15208:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788521394.292980:0:15208:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788521394.292986:0:15208:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788521394.293003:0:15208:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788521394.293034:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fef81587000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788521394.293235:0:15208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788521394.293243:0:15208:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788521394.293250:0:15208:0:(genops.c:885:class_export_put()) final put ffff8fef81476000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788521394.293254:0:15208:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef81476000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788521394.293260:0:15208:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788521394.293355:0:15208:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fef58328000 1 00000020:00000080:2.0:1788521394.293363:0:15208:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d0d9b 00000020:00000080:2.0:1788521394.293371:0:15208:0:(genops.c:885:class_export_put()) final put ffff8fef5832d000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788521394.293380:0:15208:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788521394.293389:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef5832d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788521394.293399:0:15208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788521394.293404:0:15208:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788521394.293408:0:15208:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8fef6e3a4d40) has no exports 00010000:00010000:3.0:1788521394.410190:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788521394.422164:0:15208:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788521394.422182:0:15208:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788521394.422189:0:15208:0:(genops.c:885:class_export_put()) final put ffff8fef5832e000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788521394.422195:0:15208:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef5832e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788521394.422203:0:15208:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788521394.422355:0:15208:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8fef58329800 00000020:02000400:3.0:1788521394.422502:0:15208:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:0.0:1788521394.829073:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788521394.829095:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222483584:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788521394.829164:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521394.829482:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222483584 00000100:00100000:3.0:1788521394.829490:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222483584 00000100:00100000:3.0:1788521394.829673:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788521394.829683:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222483584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788521394.829711:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788521394.829761:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222483584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521394.829767:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788521394.829811:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222483584:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788521394.829898:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788521395.470010:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521396.499718:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788521397.394878:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788521397.394903:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788521397.394907:0:37:0:(import.c:65:import_set_state_nolock()) ffff8fef755ad800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788521397.394916:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 442 00000100:00080000:1.0:1788521397.394931:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788521397.394939:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8fef755ad800 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:1.0:1788521397.394964:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee43d4ed80 x1875400222483840/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788521397.394991:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788521397.394995:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788521397.394997:0:37:0:(import.c:65:import_set_state_nolock()) ffff8fef7a3be000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788521397.395001:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 442 00000100:00080000:1.0:1788521397.395003:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788521397.395007:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8fef7a3be000 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:1.0:1788521397.395020:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee43d4c380 x1875400222483968/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788521397.395028:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788521397.395031:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788521397.395032:0:37:0:(import.c:65:import_set_state_nolock()) ffff8fef81471000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788521397.395035:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 442 00000100:00080000:1.0:1788521397.395037:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788521397.395041:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8fef81471000 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:1.0:1788521397.395049:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee43d4c700 x1875400222484096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788521397.395087:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788521397.395090:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788521397.395092:0:37:0:(import.c:65:import_set_state_nolock()) ffff8fef7a7c0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788521397.395095:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 442 00000100:00080000:1.0:1788521397.395104:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788521397.395108:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8fef7a7c0800 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:1.0:1788521397.395120:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fef76714e00 x1875400222484480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788521397.395173:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222483840:0@lo:38:kworker.0 00000100:00100000:1.0:1788521397.395235:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521397.395288:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875400222483968:0@lo:38:kworker.0 00000100:00100000:1.0:1788521397.395315:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521397.395340:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875400222484096:0@lo:38:kworker.0 00000100:00100000:1.0:1788521397.395360:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521397.395381:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875400222484480:0@lo:38:kworker.0 00000100:00100000:1.0:1788521397.395400:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521397.395437:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222483840 00000100:00100000:1.0:1788521397.395444:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222483840 00000100:00100000:1.0:1788521397.395473:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788521397.395479:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1875400222483840:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788521397.395497:0:6524:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788521397.395520:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222483712:0@lo:400:kworker.0 00000100:00100000:1.0:1788521397.395534:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1875400222483840:12345-0@lo:38:kworker.0 Request processed in 55us (299us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788521397.395541:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000400:00000100:2.0:1788521397.395543:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875400222483712 offset 0 length 224: 4 00000100:00100000:2.0:1788521397.395560:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222484736:0@lo:400:kworker.0 00000100:00080000:1.0:1788521397.395575:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef755ad800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788521397.395579:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788521397.395582:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521397.395583:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222483840:0@lo:38:kworker.0 00000100:00100000:2.0:1788521397.395602:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788521397.395607:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875400222484608:0@lo:400:kworker.0 00000100:00100000:2.0:1788521397.395629:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521397.395726:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222484736 00000100:00100000:0.0:1788521397.396012:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875400222484224:0@lo:400:kworker.0 00000100:00100000:0.0:1788521397.396049:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521397.396068:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521397.396073:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222484352:0@lo:400:kworker.0 00000100:00100000:0.0:1788521397.396094:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521397.396125:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222483968 00000100:00100000:0.0:1788521397.396130:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222483968 00000100:00100000:0.0:1788521397.396144:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222484096 00000100:00100000:0.0:1788521397.396146:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222484096 00000100:00100000:0.0:1788521397.396154:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222484480 00000100:00100000:0.0:1788521397.396157:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222484480 00000100:00100000:0.0:1788521397.396163:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222484608 00000100:00100000:0.0:1788521397.396165:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222484608 00000100:00100000:0.0:1788521397.396205:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222484224 00000100:00100000:0.0:1788521397.396209:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222484224 00000100:00100000:0.0:1788521397.396224:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1788521397.396229:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875400222484608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521397.396272:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875400222484608:12345-0@lo:400:kworker.0 Request processed in 42us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521397.396278:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1788521397.396844:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222484736 00000100:00100000:2.0:1788521397.396901:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222484352 00000100:00100000:2.0:1788521397.396905:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222484352 00000100:00100000:2.0:1788521397.396930:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788521397.396937:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222484736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521397.396989:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222484736:12345-0@lo:400:kworker.0 Request processed in 53us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521397.396994:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788521397.397008:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788521397.397013:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222484352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521397.397043:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222484352:12345-0@lo:400:kworker.0 Request processed in 30us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521397.397048:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788521397.397067:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1788521397.397074:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875400222484224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521397.397099:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875400222484224:12345-0@lo:400:kworker.0 Request processed in 26us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521397.397117:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1788521397.397130:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788521397.397134:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875400222483968:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788521397.397150:0:12956:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788521397.397184:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875400222483968:12345-0@lo:38:kworker.0 Request processed in 48us (1868us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788521397.397189:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788521397.397201:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788521397.397205:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875400222484096:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788521397.397214:0:12956:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788521397.397237:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875400222484096:12345-0@lo:38:kworker.0 Request processed in 31us (1876us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788521397.397242:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788521397.397251:0:12956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788521397.397255:0:12956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875400222484480:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788521397.397263:0:12956:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788521397.397281:0:12956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1875400222484480:12345-0@lo:38:kworker.0 Request processed in 25us (1881us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788521397.398418:0:12956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:2.0:1788521397.398447:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788521397.398452:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521397.398456:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788521397.398503:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222484352:0@lo:400:kworker.0 00010000:00080000:2.0:1788521397.398520:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8fee43d4c000 x1875400222484224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521397.398541:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3645:1875400222484224:0@lo:400:kworker.0 00010000:00080000:2.0:1788521397.398602:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8fef715a3800 x1875400222484608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521397.398611:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875400222484608:0@lo:400:kworker.0 00000100:00100000:2.0:1788521397.398624:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222484736:0@lo:400:kworker.0 00000100:00080000:2.0:1788521397.398653:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef7a3be000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788521397.398659:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788521397.398662:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875400222483968:0@lo:38:kworker.0 00000100:00080000:2.0:1788521397.398672:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef81471000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788521397.398675:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788521397.398679:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875400222484096:0@lo:38:kworker.0 00000100:00080000:2.0:1788521397.398688:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef7a7c0800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788521397.398691:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788521397.398694:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875400222484480:0@lo:38:kworker.0 00010000:00010000:2.0:1788521397.518062:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788521397.520184:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788521397.901141:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788521397.901164:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222484864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788521397.901245:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521397.901351:0:11958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222484864 00000100:00100000:3.0:1788521397.901359:0:11958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222484864 00000100:00100000:3.0:1788521397.901408:0:11958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788521397.901417:0:11958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222484864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788521397.901442:0:11958:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788521397.901483:0:11958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222484864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521397.901489:0:11958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788521397.901577:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222484864:0@lo:13:osp-pre-1-1.0 00000020:01000004:0.0:1788521398.427559:0:15410:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788521398.443547:0:15410:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1788521398.443603:0:15410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7e00/0x411dd0ee4d2d12f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d12fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521398.443616:0:15410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7e00/0x411dd0ee4d2d12f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d12fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521398.443623:0:15410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7e00/0x411dd0ee4d2d12f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d12fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521398.443629:0:15410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7e00/0x411dd0ee4d2d12f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d12fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521398.443651:0:15410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788521398.443656:0:15410:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788521398.443679:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788521398.443684:0:15410:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788521398.443691:0:15410:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788521398.443697:0:15410:0:(import.c:65:import_set_state_nolock()) ffff8fef7a3be000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788521398.443701:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788521398.443703:0:15410:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788521398.444595:0:15410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788521398.445568:0:15410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee42411200/0x411dd0ee4d2d1305 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d130c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521398.445581:0:15410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee42411200/0x411dd0ee4d2d1305 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d130c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521398.445607:0:15410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee42411200/0x411dd0ee4d2d1305 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d130c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521398.445614:0:15410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.141@tcp lock: ffff8fee42411200/0x411dd0ee4d2d1305 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d130c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521398.445722:0:15410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788521398.445731:0:15410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749ca800/0x411dd0ee4d2d11df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d11e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521398.445737:0:15410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749ca800/0x411dd0ee4d2d11df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d11e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521398.445743:0:15410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef749ca800/0x411dd0ee4d2d11df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d11e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521398.445749:0:15410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.141@tcp lock: ffff8fef749ca800/0x411dd0ee4d2d11df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d11e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521398.445938:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788521398.445946:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7e00/0x411dd0ee4d2d12f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d12fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521398.445954:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7e00 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:3.0:1788521398.445957:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7e00/0x411dd0ee4d2d12f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d12fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521398.445976:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7e00/0x411dd0ee4d2d12f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x411dd0ee4d2d12fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521398.445984:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7e00/0x411dd0ee4d2d12f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x411dd0ee4d2d12fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521398.445990:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788521398.445993:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788521398.445996:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788521398.446031:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7e00/0x411dd0ee4d2d12f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x411dd0ee4d2d12fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521398.446037:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521398.446065:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7e00/0x411dd0ee4d2d12f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x411dd0ee4d2d12fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521398.446071:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b7e00/0x411dd0ee4d2d12f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x411dd0ee4d2d12fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521398.446084:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788521398.446087:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fee42411200/0x411dd0ee4d2d1305 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d130c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521398.446093:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42411200 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:3.0:1788521398.446102:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fee42411200/0x411dd0ee4d2d1305 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d130c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521398.446109:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fee42411200/0x411dd0ee4d2d1305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x411dd0ee4d2d130c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521398.446115:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fee42411200/0x411dd0ee4d2d1305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x411dd0ee4d2d130c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521398.446120:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788521398.446122:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1788521398.446135:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fee42411200/0x411dd0ee4d2d1305 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x411dd0ee4d2d130c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521398.446141:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521398.446154:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fee42411200/0x411dd0ee4d2d1305 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x411dd0ee4d2d130c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521398.446161:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fee42411200/0x411dd0ee4d2d1305 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x411dd0ee4d2d130c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521398.446170:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521398.446173:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef749ca800/0x411dd0ee4d2d11df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d11e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521398.446178:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef749ca800 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:3.0:1788521398.446181:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef749ca800/0x411dd0ee4d2d11df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d11e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521398.446186:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef749ca800/0x411dd0ee4d2d11df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x411dd0ee4d2d11e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521398.446203:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef749ca800/0x411dd0ee4d2d11df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x411dd0ee4d2d11e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521398.446208:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788521398.446210:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1788521398.446222:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef749ca800/0x411dd0ee4d2d11df lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x411dd0ee4d2d11e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521398.446228:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521398.446234:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef749ca800/0x411dd0ee4d2d11df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x411dd0ee4d2d11e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521398.446241:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521398.446242:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521398.446244:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521398.446266:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222485248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521398.446334:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521398.446384:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788521398.446390:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222485120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521398.446411:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521398.446438:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222485248 00000100:00100000:3.0:1788521398.446445:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222485248 00000100:00100000:3.0:1788521398.446472:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222485120 00000100:00100000:3.0:1788521398.446474:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222485120 00000100:00100000:3.0:1788521398.446485:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788521398.446491:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef4e7e3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3644:x1875400222485248:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788521398.446497:0:6505:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788521398 with bad export cookie 4692136108705516997 00000100:00100000:2.0:1788521398.446940:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222484992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788521398.446980:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521398.447011:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788521398.447019:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788521398.447123:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222484992 00000100:00100000:2.0:1788521398.447127:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222484992 00000100:00100000:2.0:1788521398.447562:0:15411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788521398.447577:0:15411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3644:x1875400222485120:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788521398.447582:0:15411:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788521398 with bad export cookie 4692136108705516997 00000100:00100000:2.0:1788521398.447629:0:15411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3644:x1875400222485120:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (1217us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788521398.447636:0:15411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788521398.447654:0:15411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788521398.447658:0:15411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58343b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1875400222484992:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788521398.447662:0:15411:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788521398 with bad export cookie 4692136108705516997 00000100:00100000:2.0:1788521398.447688:0:15411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58343b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1875400222484992:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (707us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788521398.447694:0:15411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1788521398.447719:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.141@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788521398.447723:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8fef71e17800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788521398.448299:0:3646:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.141@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:0.0:1788521398.448379:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521398.453827:0:15410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788521398.453843:0:15410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef749ca800/0x411dd0ee4d2d11df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x411dd0ee4d2d11e6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521398.453868:0:15410:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788521398.453897:0:15410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d156d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1574 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521398.453905:0:15410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d156d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d1574 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521398.453927:0:15410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d156d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d1574 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521398.453935:0:15410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d156d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d1574 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521398.455663:0:13734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521398.455675:0:13734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d156d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d1574 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521398.455686:0:13734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434ab800 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:0.0:1788521398.455689:0:13734:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d156d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d1574 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521398.455699:0:13734:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d156d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x411dd0ee4d2d1574 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521398.455868:0:13734:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d156d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x411dd0ee4d2d1574 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521398.455874:0:13734:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788521398.455877:0:13734:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788521398.458287:0:15410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:1.0:1788521398.458300:0:15410:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788521398.458324:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521398.458339:0:15410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef4167f000/0x411dd0ee4d2d0ec8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d0ecf expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521398.458351:0:15410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef4167f000/0x411dd0ee4d2d0ec8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d0ecf expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521398.458358:0:15410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef4167f000/0x411dd0ee4d2d0ec8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d0ecf expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521398.458364:0:15410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.141@tcp lock: ffff8fef4167f000/0x411dd0ee4d2d0ec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d0ecf expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521398.458388:0:15410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788521398.458392:0:15410:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1788521398.458395:0:15410:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1788521398.458432:0:15410:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1788521398.458436:0:15410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1788521398.458440:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788521398.458446:0:15410:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788521398.458452:0:15410:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8fee426de000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788521398.458471:0:15410:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8fee4211d000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788521398.458476:0:15410:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8fef7559b380) has exports, disconnecting them 00000020:00080000:1.0:1788521398.458480:0:15410:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8fee426de000), last request at 1788521397 00000020:00000080:1.0:1788521398.458549:0:15410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d11a7 00000100:00080000:1.0:1788521398.458565:0:15410:0:(import.c:65:import_set_state_nolock()) ffff8fee426dd800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788521398.458615:0:15410:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fee426de000): rc 0 00000020:00000080:1.0:1788521398.458617:0:15410:0:(genops.c:885:class_export_put()) final put ffff8fee426de000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1788521398.458627:0:15410:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8fee4211d000), last request at 1788521397 00000020:00000080:1.0:1788521398.458630:0:15410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d1081 00000100:00080000:1.0:1788521398.458635:0:15410:0:(import.c:65:import_set_state_nolock()) ffff8fee4211b000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788521398.458645:0:15410:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fee4211d000): rc 0 00000020:00000080:1.0:1788521398.458647:0:15410:0:(genops.c:885:class_export_put()) final put ffff8fee4211d000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1788521398.458653:0:15410:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa9e341c63ae0 00000100:00080000:1.0:1788521398.458668:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788521398.458677:0:15410:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8fee43d21180 x1875400222481792/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788521408 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521398.458690:0:15410:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:1.0:1788521398.460261:0:15410:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788521398.460270:0:15410:0:(import.c:65:import_set_state_nolock()) ffff8fef755ad800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788521398.460606:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788521398.460610:0:15410:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:1.0:1788521398.460623:0:15410:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788521398.460688:0:15410:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788521398.460712:0:15410:0:(import.c:65:import_set_state_nolock()) ffff8fef81664000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788521398.460727:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788521398.460729:0:15410:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1788521398.460738:0:15410:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788521398.460816:0:15410:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788521398.460827:0:15410:0:(import.c:65:import_set_state_nolock()) ffff8fef81660800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788521398.460849:0:15410:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8fef7559b380) has no exports 00010000:00010000:1.0:1788521398.462037:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521398.462046:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef4167f000/0x411dd0ee4d2d0ec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d0ecf expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521398.462055:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef4167f000 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:1.0:1788521398.462059:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef4167f000/0x411dd0ee4d2d0ec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d0ecf expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521398.462069:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef4167f000/0x411dd0ee4d2d0ec8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x411dd0ee4d2d0ecf expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521398.462076:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef4167f000/0x411dd0ee4d2d0ec8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x411dd0ee4d2d0ecf expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521398.462082:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788521398.462084:0:7461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788521398.462087:0:7461:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:2.0:1788521398.471124:0:3646:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.141@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788521398.471131:0:3646:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788521398.471140:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fee43d4d180 x1875400222483712/t0(0) o400->MGC192.168.203.141@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788521413 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521398.471153:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fef7f0cb100 x1875400222485248/t0(0) o103->MGC192.168.203.141@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788521414 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521398.471161:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fef7f0cb480 x1875400222485120/t0(0) o103->MGC192.168.203.141@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788521414 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521398.471170:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fef7f0c9180 x1875400222484992/t0(0) o103->MGC192.168.203.141@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788521414 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788521398.472660:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788521398.472667:0:3646:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788521398.472668:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:0.0:1788521398.474082:0:13734:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d156d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x411dd0ee4d2d1574 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521398.474095:0:13734:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521398.474110:0:13734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d156d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x411dd0ee4d2d1574 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521398.474117:0:13734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d156d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x411dd0ee4d2d1574 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521398.474137:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521398.474139:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521398.474141:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788521398.474696:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8fef71e17800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788521398.474706:0:3646:0:(import.c:545:import_select_connection()) MGC192.168.203.141@tcp: connect to NID 0@lo last attempt 164 00000100:00080000:2.0:1788521398.474714:0:3646:0:(import.c:665:import_select_connection()) MGC192.168.203.141@tcp: import ffff8fef71e17800 using connection 192.168.203.141@tcp/0@lo 00010000:00010000:2.0:1788521398.474785:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788521398.474796:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fee426de000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1788521398.475231:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fee4211d000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1788521398.475256:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fee426dd800 for lustre-MDT0001 00000020:00000080:2.0:1788521398.475260:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fee4211b000 for lustre-MDT0001 00000100:00100000:2.0:1788521398.475280:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:0:1875400222485632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788521398.475289:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222481792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788521398.475422:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222485376:0@lo:9:umount.0 00000100:00100000:2.0:1788521398.475483:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521398.475513:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222485504:0@lo:9:umount.0 00000100:00100000:2.0:1788521398.475534:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788521398.475628:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef4167f000/0x411dd0ee4d2d0ec8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x411dd0ee4d2d0ecf expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521398.475638:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788521398.475659:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef4167f000/0x411dd0ee4d2d0ec8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x411dd0ee4d2d0ecf expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521398.475665:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef4167f000/0x411dd0ee4d2d0ec8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x411dd0ee4d2d0ecf expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521398.475680:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521398.475692:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521398.475694:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521398.475984:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788521398.475993:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222485376 00000100:00100000:0.0:1788521398.475993:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:0:1875400222485760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788521398.476000:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222485376 00000100:00100000:2.0:1788521398.476044:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222485504 00000100:00100000:2.0:1788521398.476048:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222485504 00000100:00100000:2.0:1788521398.476075:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788521398.476082:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58343480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875400222485376:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788521398.476103:0:8434:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d10dc 00000100:00080000:2.0:1788521398.476111:0:8434:0:(import.c:65:import_set_state_nolock()) ffff8fef76797800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788521398.476148:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788521398.476246:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788521398.476254:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76714e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875400222485504:12345-0@lo:9:umount.0 00000100:00100000:2.0:1788521398.476256:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58343480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3642:x1875400222485376:12345-0@lo:9:umount.0 Request processed in 174us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521398.476262:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000020:00000080:0.0:1788521398.476267:0:8436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d1217 00000100:00080000:0.0:1788521398.476273:0:8436:0:(import.c:65:import_set_state_nolock()) ffff8fef7efd6000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788521398.476299:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00010000:00010000:2.0:1788521398.476327:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788521398.476353:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef81664000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788521398.476365:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788521398.476367:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788521398.476370:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222485376:0@lo:9:umount.0 00000100:00100000:0.0:1788521398.476377:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76714e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3642:x1875400222485504:12345-0@lo:9:umount.0 Request processed in 125us (843us total) trans 0 rc 0/0 00000100:00080000:2.0:1788521398.476380:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef81660800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788521398.476383:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000004:00080000:2.0:1788521398.476388:0:3642:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788521398.476390:0:3642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788521398.476392:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222485504:0@lo:9:umount.0 00010000:00010000:0.0:1788521398.476403:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521398.476430:0:3646:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee4359bb80 x1875400222485888/t0(0) o250->MGC192.168.203.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788521398.476453:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4359bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3642:1875400222485888:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:2.0:1788521398.476472:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875400222485888 offset 0 length 520: 4 00000100:00100000:2.0:1788521398.476498:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3646:1875400222484992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521398.477638:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222485120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521398.477648:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222485248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521398.477656:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3644:1875400222483712:0@lo:400:kworker.0 00010000:00010000:0.0:1788521398.477684:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1788521398.486399:0:6505:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1875400222485248 offset 224 length 224: 4 00000100:00100000:3.0:1788521398.486435:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef4e7e3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3644:x1875400222485248:12345-0@lo:103:ldlm_bl.0 Request processed in 39941us (40100us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788521398.486447:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000020:00080000:1.0:1788521398.493213:0:15410:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8fef7559b380) has no exports 00010000:00010000:2.0:1788521398.547457:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788521398.549977:0:15410:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fef7a44a6c0 - data ffff8fef65319360/ffff8fee43141800 00000020:01000000:0.0:1788521398.550148:0:15410:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fef7666a2a0 - data ffff8fef651e8d80/ffff8fef67b8c000 00000001:00000004:3.0:1788521398.566086:0:15410:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:3.0:1788521398.618102:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788521398.618111:0:15410:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788521398.618119:0:15410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788521398.627458:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788521398.627467:0:15410:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:3.0:1788521398.627488:0:15410:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788521398.627491:0:15410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788521398.634063:0:8867:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788521398.634072:0:8867:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1788521398.634086:0:8867:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788521398.634634:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788521398.634640:0:15410:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1788521398.634662:0:15410:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788521398.634665:0:15410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788521398.635050:0:9962:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788521398.635054:0:9962:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1788521398.635065:0:9962:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788521398.636202:0:15410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d0eeb 00000020:00000080:3.0:1788521398.636212:0:15410:0:(genops.c:885:class_export_put()) final put ffff8fef81665000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788521398.636524:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef81665000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788521398.640264:0:15410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d0f00 00000020:00000080:3.0:1788521398.640276:0:15410:0:(genops.c:885:class_export_put()) final put ffff8fef755aa000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788521398.640555:0:15410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1788521398.640561:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788521398.640570:0:15410:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788521398.640574:0:15410:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8fef755999c0) has no exports 00000004:01000000:3.0:1788521398.640748:0:15410:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788521398.640757:0:15410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d1209 00000020:00000080:3.0:1788521398.640762:0:15410:0:(genops.c:885:class_export_put()) final put ffff8fee4326a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788521398.642390:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef755aa000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1788521398.642712:0:15410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788521398.642823:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788521398.642836:0:15410:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788521398.642841:0:15410:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8fef7efe8000) has no exports 00000020:00000080:1.0:1788521398.642850:0:15410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d1202 00000020:00000080:1.0:1788521398.642857:0:15410:0:(genops.c:885:class_export_put()) final put ffff8fef81666800/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1788521398.643287:0:15410:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788521398.643292:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788521398.643296:0:15410:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1788521398.643302:0:15410:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788521398.643304:0:15410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788521398.643336:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788521398.643344:0:15410:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788521398.643350:0:15410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d10c7 00000020:00000080:1.0:1788521398.643355:0:15410:0:(genops.c:885:class_export_put()) final put ffff8fef76795800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788521398.643359:0:15410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788521398.643363:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788521398.643367:0:15410:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788521398.643369:0:15410:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8fef4e784d40) has no exports 00000020:00000080:1.0:1788521398.643373:0:15410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d10c0 00000020:00000080:1.0:1788521398.643376:0:15410:0:(genops.c:885:class_export_put()) final put ffff8fef81666000/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1788521398.643693:0:15410:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788521398.643697:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788521398.643699:0:15410:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:1.0:1788521398.643703:0:15410:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788521398.643704:0:15410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788521398.643751:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788521398.643765:0:15410:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1788521398.643778:0:15410:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788521398.643784:0:15410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d0f23 00000020:00000080:1.0:1788521398.643788:0:15410:0:(genops.c:885:class_export_put()) final put ffff8fef7a3b1800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788521398.643793:0:15410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1788521398.643796:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788521398.643800:0:15410:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788521398.643802:0:15410:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8fef75598000) has no exports 00000020:00000080:1.0:1788521398.643806:0:15410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d0f1c 00000020:00000080:1.0:1788521398.643809:0:15410:0:(genops.c:885:class_export_put()) final put ffff8fef755a8800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788521398.645088:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fee4326a000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788521398.645103:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef81666800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788521398.645109:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fef81660800 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788521398.645116:0:8:0:(genops.c:885:class_export_put()) final put ffff8fee4326c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788521398.645119:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fee4326c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1788521398.645123:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788521398.645215:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef76795800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788521398.645224:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef81666000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788521398.645232:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fef81664000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788521398.645237:0:8:0:(genops.c:885:class_export_put()) final put ffff8fee4211c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788521398.645239:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fee4211c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1788521398.645242:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788521398.645270:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef7a3b1800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788521398.645297:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef755a8800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788521398.645933:0:15410:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788521398.645938:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788521398.645941:0:15410:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788521398.645948:0:15410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788521398.646004:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788521398.646013:0:15410:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788521398.646030:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fef755ad800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788521398.646039:0:8:0:(genops.c:885:class_export_put()) final put ffff8fef755ae800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788521398.646042:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef755ae800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788521398.646047:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788521398.646053:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788521398.646059:0:15410:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788521398.646063:0:15410:0:(genops.c:885:class_export_put()) final put ffff8fef81662000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788521398.646066:0:15410:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef81662000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788521398.646070:0:15410:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788521398.646591:0:15410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d0f07 00000020:00000080:0.0:1788521398.646598:0:15410:0:(genops.c:885:class_export_put()) final put ffff8fef755ac800/lustre-MDD0001_UUID 00000020:01000000:0.0:1788521398.646614:0:15410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788521398.646619:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788521398.646624:0:15410:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788521398.646627:0:15410:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8fef7559cd40) has no exports 00000020:00000080:0.0:1788521398.646648:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788521398.646651:0:15410:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788521398.646655:0:15410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d0f0e 00000020:00000080:0.0:1788521398.646659:0:15410:0:(genops.c:885:class_export_put()) final put ffff8fef755ab800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788521398.646666:0:15410:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fef81580000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788521398.646669:0:15410:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fef81580000 2 00000020:01000004:0.0:1788521398.646672:0:15410:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8fef81580000 from lustre-MDT0001 00000020:00000080:0.0:1788521398.646688:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788521398.646693:0:15410:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788521398.646695:0:15410:0:(genops.c:885:class_export_put()) final put ffff8fef81664800/lustre-MDT0001_UUID 00000020:00000080:0.0:1788521398.646697:0:15410:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef81664800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788521398.646704:0:15410:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788521398.646731:0:15410:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788521398.646741:0:15410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788521398.646744:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788521398.646747:0:15410:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788521398.646753:0:15410:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8fef7a3b6800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788521398.646758:0:15410:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8fef6d7f0000) has exports, disconnecting them 00000020:00080000:0.0:1788521398.646762:0:15410:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8fef7a3b6800), last request at 1788521136 00000020:00000080:0.0:1788521398.646765:0:15410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d0f62 00000020:00080000:0.0:1788521398.646777:0:15410:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fef7a3b6800): rc 0 00000020:00000080:0.0:1788521398.646781:0:15410:0:(genops.c:885:class_export_put()) final put ffff8fef7a3b6800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788521398.647082:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef755ac800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788521398.647087:0:8:0:(genops.c:885:class_export_put()) final put ffff8fef755a8000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788521398.647090:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef755a8000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788521398.647098:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788521398.647291:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef755ab800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788521398.647295:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef7a3b6800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788521398.664009:0:15410:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788521398.664018:0:15410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788521398.664022:0:15410:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788521398.664029:0:15410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788521398.664063:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fef7a3be000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788521398.664261:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788521398.664271:0:15410:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1788521398.664287:0:15410:0:(genops.c:885:class_export_put()) final put ffff8fef7a3bc000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788521398.664291:0:15410:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef7a3bc000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788521398.664303:0:15410:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788521398.664377:0:15410:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fef81580000 1 00000020:00000080:3.0:1788521398.664384:0:15410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d0e9e 00000020:00000080:3.0:1788521398.664390:0:15410:0:(genops.c:885:class_export_put()) final put ffff8fef81475800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1788521398.664398:0:15410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788521398.664407:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef81475800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788521398.664418:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788521398.664423:0:15410:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788521398.664426:0:15410:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8fef6d7f4d40) has no exports 00000020:00000080:3.0:1788521398.711232:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788521398.711246:0:15410:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1788521398.711251:0:15410:0:(genops.c:885:class_export_put()) final put ffff8fef81490800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788521398.711255:0:15410:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef81490800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1788521398.711263:0:15410:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1788521398.711394:0:15410:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8fef81583000 00000020:01000000:3.0:1788521398.711423:0:15410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788521398.711427:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788521398.711431:0:15410:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788521398.711435:0:15410:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8fef4e7819c0) has no exports 00000100:00100000:3.0:1788521398.711539:0:6519:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8fef460ef800:6519] 0 exiting: rc = 1 00000100:00100000:0.0:1788521398.711687:0:9815:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8fee42498000:9815] 3 exiting: rc = 0 00000100:00100000:0.0:1788521398.711770:0:6520:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8fef49d4ae00:6520] 1 exiting: rc = 0 00000100:00100000:2.0:1788521398.714670:0:12956:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8fef7a45b000:12956] 4 exiting: rc = 0 00000100:00100000:0.0:1788521398.714786:0:6521:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8fef6063c000:6521] 2 exiting: rc = 0 00000100:00100000:3.0:1788521398.714838:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.714852:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.714857:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.714864:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.714900:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.714907:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.714912:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.714918:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.714924:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.714931:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.714937:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.714942:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.714947:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.714952:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.714967:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.714973:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.714979:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.714985:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.714990:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.714995:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715002:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715008:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715013:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715018:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715023:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715029:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715034:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715039:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715045:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715065:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715071:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715077:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715082:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715086:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715092:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715097:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715103:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715108:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715112:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715117:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715123:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715128:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715134:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715140:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715145:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715150:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715155:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715160:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715165:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715171:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715178:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715184:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715190:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715200:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715206:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715212:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715217:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715223:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715229:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715234:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715239:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715244:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715250:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.715264:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521398.719272:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8fef460ee000:6522] 0 exiting: rc = 1 00000100:00100000:0.0:1788521398.719390:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8fef51b1ae00:6523] 1 exiting: rc = 0 00000100:00100000:3.0:1788521398.719480:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719489:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719496:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719502:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719508:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719513:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719520:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719526:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719531:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719537:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719544:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719549:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719558:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719563:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719568:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719573:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719578:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719582:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719587:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719592:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719597:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719602:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719619:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719626:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719631:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719637:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719642:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719648:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719653:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719657:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719663:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719667:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719672:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719677:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719682:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719699:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719704:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719709:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719714:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.719719:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.720040:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.720047:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.720052:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.720057:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.720062:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.720067:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.720072:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.720077:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.720082:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.720087:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.720092:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.720097:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.720102:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.720106:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.720112:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.720116:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.720121:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.720126:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.720131:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.720137:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.720142:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.720147:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.720152:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.720157:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.720604:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8fef71c62c00:6525] 1 exiting: rc = 0 00000100:00100000:2.0:1788521398.720766:0:10099:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8fef76754000:10099] 2 exiting: rc = 0 00000100:00100000:0.0:1788521398.721022:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8fef460e4e00:6524] 0 exiting: rc = 1 00000100:00100000:3.0:1788521398.721068:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721088:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721098:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721104:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721111:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721128:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721134:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721141:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721147:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721152:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721158:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721174:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721182:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721188:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721194:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721201:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721207:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721213:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721220:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721226:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721232:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721240:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721246:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721265:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721273:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721291:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721298:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721305:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721311:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721318:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721323:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721329:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721337:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721342:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721351:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721373:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721381:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721386:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721392:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721398:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721410:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721415:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721422:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721428:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721434:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721440:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721446:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721464:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721471:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721477:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721483:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721488:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721495:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721501:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721506:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721512:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721518:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721524:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721529:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721550:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721558:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721563:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721569:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.721580:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.731242:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8fef6db1e800:6527] 1 exiting: rc = 0 00000100:00100000:2.0:1788521398.731693:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8fef71c62200:6526] 0 exiting: rc = 1 00000100:00100000:3.0:1788521398.731833:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.731841:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.731846:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.731851:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.731857:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.731861:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.731968:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.731975:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.731981:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.731986:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732003:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732009:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732014:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732020:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732026:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732031:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732036:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732041:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732047:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732052:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732058:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732064:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732069:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732074:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732079:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732085:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732090:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732095:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732101:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732106:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732112:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732117:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732123:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732129:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732135:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732168:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732174:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732180:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732184:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732190:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732196:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732201:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732207:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732212:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732218:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732233:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732239:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732359:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732368:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732372:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732377:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732383:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732388:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732392:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732397:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732402:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732406:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732410:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732415:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732420:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732424:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732429:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732434:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.732439:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521398.733051:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8fef6db1ee00:6528] 0 exiting: rc = 1 00000100:00100000:1.0:1788521398.733210:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8fef6db1fc00:6529] 1 exiting: rc = 0 00000100:00100000:1.0:1788521398.733369:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733375:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733380:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733385:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733391:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733397:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733402:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733407:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733412:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733417:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733422:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733427:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733431:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733436:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733440:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733445:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733449:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733453:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733458:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733463:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733467:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733471:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733475:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733489:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733493:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733498:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733503:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733507:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733512:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733516:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733520:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733525:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733529:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733534:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733539:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733544:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733549:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733553:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733558:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733562:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733567:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733571:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733576:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733580:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733585:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733590:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733595:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733600:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733604:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733609:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733616:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733620:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733625:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733630:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733635:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733640:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733645:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733650:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733661:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733861:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733946:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733954:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733969:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.733975:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.734413:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8fef71c63200:6531] 1 exiting: rc = 0 00000100:00100000:0.0:1788521398.734530:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8fef71c63000:6530] 0 exiting: rc = 1 00000100:00100000:1.0:1788521398.735060:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735067:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735072:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735078:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735084:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735090:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735096:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735102:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735107:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735113:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735118:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735123:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735129:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735134:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735139:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735145:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735151:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735155:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735160:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735166:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735170:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735176:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735182:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735187:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735192:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735198:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735203:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735209:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735227:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735232:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735237:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735242:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735247:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735253:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735259:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735264:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735270:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735290:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735298:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735303:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735308:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735314:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735319:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735324:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735330:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735335:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735340:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735346:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735352:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735358:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735363:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735369:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735374:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735379:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735384:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735390:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735395:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735401:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735406:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735410:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735415:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735420:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735425:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.735440:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.736371:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8fef4303a800:6534] 2 exiting: rc = 0 00000100:00100000:0.0:1788521398.736699:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8fef74a8cc00:6532] 0 exiting: rc = 1 00000100:00100000:0.0:1788521398.741049:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8fef4303a200:6533] 1 exiting: rc = 0 00000100:00100000:1.0:1788521398.748562:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748572:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748595:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748602:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748607:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748671:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748677:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748683:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748688:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748694:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748700:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748705:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748710:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748716:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748790:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748797:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748802:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748808:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748813:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748818:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748823:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748828:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748833:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748838:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748843:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748848:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748968:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748977:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748983:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748988:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748994:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.748999:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749005:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749023:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749028:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749033:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749039:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749044:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749050:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749055:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749061:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749067:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749073:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749078:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749083:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749089:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749093:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749098:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749103:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749108:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749126:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749132:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749138:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749143:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749149:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749155:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749160:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749166:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749171:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749176:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749181:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749187:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749191:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521398.749197:0:15410:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788521398.754490:0:15410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788521398.754503:0:15410:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788521398.754509:0:15410:0:(genops.c:885:class_export_put()) final put ffff8fef71e15800/MDS_uuid 00000020:00000080:0.0:1788521398.754513:0:15410:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef71e15800/MDS_uuid for MDS 00000020:01000000:0.0:1788521398.754519:0:15410:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788521398.754657:0:15410:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1788521399.570992:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521400.598458:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521401.616534:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788521402.455586:0:15611:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788521402.475172:0:15611:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788521402.475230:0:15611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6c00/0x411dd0ee4d2d12db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d12e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521402.475245:0:15611:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6c00/0x411dd0ee4d2d12db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d12e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521402.475252:0:15611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6c00/0x411dd0ee4d2d12db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d12e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521402.475278:0:15611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6c00/0x411dd0ee4d2d12db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d12e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521402.475336:0:15611:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788521402.475343:0:15611:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788521402.475370:0:15611:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788521402.475375:0:15611:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788521402.475382:0:15611:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788521402.475388:0:15611:0:(import.c:65:import_set_state_nolock()) ffff8fef81471000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788521402.475392:0:15611:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788521402.475394:0:15611:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788521402.475396:0:15611:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788521402.476262:0:15611:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788521402.476267:0:15611:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788521402.476271:0:15611:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788521402.476293:0:15611:0:(import.c:65:import_set_state_nolock()) ffff8fee42118000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788521402.477304:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4359b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1875400222486016:0@lo:39:umount.0 00000400:00000100:3.0:1788521402.477368:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875400222486016 offset 0 length 224: 4 00010000:00010000:0.0:1788521402.479418:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521402.479430:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6c00/0x411dd0ee4d2d12db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d12e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521402.479443:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6c00 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:0.0:1788521402.479465:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6c00/0x411dd0ee4d2d12db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d12e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521402.479476:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6c00/0x411dd0ee4d2d12db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x411dd0ee4d2d12e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521402.479484:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6c00/0x411dd0ee4d2d12db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x411dd0ee4d2d12e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521402.479490:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788521402.479493:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788521402.479497:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788521402.479513:0:6507:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fef71e17800 00010000:00010000:0.0:1788521402.479517:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6c00/0x411dd0ee4d2d12db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x411dd0ee4d2d12e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521402.479523:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6c00/0x411dd0ee4d2d12db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x411dd0ee4d2d12e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521402.479536:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521402.479538:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521402.479540:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788521402.509648:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788521402.509657:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788521402.509661:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788521402.509664:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788521402.509668:0:8:0:(import.c:65:import_set_state_nolock()) ffff8fef7a7c0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788521402.509676:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 447 00000100:00080000:3.0:1788521402.509683:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788521402.509718:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8fef7a7c0800 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:3.0:1788521402.509754:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fef7f0ca680 x1875400222486144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788521402.509830:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875400222486144:0@lo:38:kworker.0 00000400:00000100:2.0:1788521402.509909:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875400222486144 offset 0 length 520: 4 00000100:00100000:1.0:1788521402.510086:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788521402.510100:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875400222486272:0@lo:400:kworker.0 00000400:00000100:1.0:1788521402.510124:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875400222486272 offset 0 length 224: 4 00010000:00010000:2.0:1788521402.638443:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788521403.533913:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788521403.533923:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788521403.533938:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788521403.533941:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788521403.534029:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875400222486400:0@lo:400:kworker.0 00000400:00000100:1.0:1788521403.534088:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875400222486400 offset 0 length 224: 4 00010000:00010000:3.0:1788521403.666099:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788521404.052421:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788521404.052430:0:8430:0:(genops.c:885:class_export_put()) final put ffff8fef76790800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788521404.053214:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef76790800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788521404.053276:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fef76797800 for lustre-OST0000 00000001:00100000:3.0:1788521404.055324:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788521404.055333:0:9512:0:(genops.c:885:class_export_put()) final put ffff8fef7efd2800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788521404.055468:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef7efd2800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788521404.055539:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fef7efd6000 for lustre-OST0001 00010000:00010000:3.0:1788521404.685191:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521405.709126:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521406.733695:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788521407.564980:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788521407.564991:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788521407.564994:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788521407.564997:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788521407.565146:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222486528:0@lo:400:kworker.0 00000400:00000100:2.0:1788521407.565209:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875400222486528 offset 0 length 224: 4 00010000:00010000:2.0:1788521407.759634:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521408.653055:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788521398/real 1788521398] req@ffff8fee4359bb80 x1875400222485888/t0(0) o250->MGC192.168.203.141@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788521408 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521408.653103:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fee4359bb80 x1875400222485888/t0(0) o250->MGC192.168.203.141@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788521408 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788521408.653123:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef71e17800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788521408.653152:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788521408.653157:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4359bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3642:1875400222485888:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:0.0:1788521408.653203:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788521408.653218:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788521408.653222:0:37:0:(import.c:65:import_set_state_nolock()) ffff8fef71e17800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788521408.653228:0:37:0:(import.c:545:import_select_connection()) MGC192.168.203.141@tcp: connect to NID 0@lo last attempt 448 00000100:00080000:0.0:1788521408.653234:0:37:0:(import.c:630:import_select_connection()) MGC192.168.203.141@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788521408.653240:0:37:0:(import.c:665:import_select_connection()) MGC192.168.203.141@tcp: import ffff8fef71e17800 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:0.0:1788521408.653272:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee43d21500 x1875400222486656/t0(0) o250->MGC192.168.203.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788521408.653297:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788521408.653302:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788521408.653454:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788521408.653468:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222486784:0@lo:400:kworker.0 00000400:00000100:1.0:1788521408.653514:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875400222486784 offset 0 length 224: 4 00000100:00100000:3.0:1788521408.653666:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3642:1875400222486656:0@lo:250:kworker.0 00000400:00000100:3.0:1788521408.653690:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875400222486656 offset 0 length 520: 4 00010000:00010000:3.0:1788521408.781501:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521409.805158:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521410.830269:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521411.853116:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521412.749148:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788521402/real 1788521402] req@ffff8fee4359b800 x1875400222486016/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788521412 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521412.749186:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fee4359b800 x1875400222486016/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788521412 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788521412.749211:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fee42118000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788521412.749265:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4359b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1875400222486016:0@lo:39:umount.0 00000100:00080000:2.0:1788521412.749498:0:15611:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788521412.749503:0:15611:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788521412.749584:0:15611:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788521412.755003:0:15611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d12e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d12f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521412.755028:0:15611:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d12e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d12f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521412.755037:0:15611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d12e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d12f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521412.755044:0:15611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d12e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d12f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521412.755081:0:15611:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521412.755088:0:15611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434aae00/0x411dd0ee4d2d155f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1566 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521412.755095:0:15611:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434aae00/0x411dd0ee4d2d155f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d1566 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521412.755102:0:15611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434aae00/0x411dd0ee4d2d155f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d1566 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521412.755108:0:15611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.141@tcp lock: ffff8fee434aae00/0x411dd0ee4d2d155f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d1566 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521412.755128:0:15611:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788521412.755134:0:15611:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788521412.755164:0:15611:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788521412.755169:0:15611:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:0.0:1788521412.755169:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788521412.755173:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00000080:2.0:1788521412.755175:0:15611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:0.0:1788521412.755180:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d12e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d12f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521412.755182:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fee434aae00/0x411dd0ee4d2d155f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d1566 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788521412.755183:0:15611:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00010000:00010000:0.0:1788521412.755197:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434ab200 already unused, calling callback (ffffffffc1352c20) 00010000:00010000:3.0:1788521412.755200:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aae00 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:0.0:1788521412.755204:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d12e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d12f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521412.755206:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fee434aae00/0x411dd0ee4d2d155f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d1566 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788521412.755207:0:15611:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8fef6da819c0) has no exports 00010000:00010000:0.0:1788521412.755230:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d12e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x411dd0ee4d2d12f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521412.755238:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fee434aae00/0x411dd0ee4d2d155f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x411dd0ee4d2d1566 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521412.755239:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d12e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x411dd0ee4d2d12f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788521412.755241:0:15611:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8fef6da819c0) has no exports 10000000:00010000:3.0:1788521412.755255:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fee434aae00/0x411dd0ee4d2d155f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x411dd0ee4d2d1566 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521412.755260:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788521412.755263:0:7461:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788521412.755265:0:7461:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788521412.755278:0:7461:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fef71e17800 00010000:00010000:3.0:1788521412.755282:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fee434aae00/0x411dd0ee4d2d155f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x411dd0ee4d2d1566 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521412.755285:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788521412.755291:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788521412.755296:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788521412.755305:0:6508:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fef71e17800 00010000:00010000:3.0:1788521412.755306:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fee434aae00/0x411dd0ee4d2d155f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x411dd0ee4d2d1566 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521412.755309:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d12e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x411dd0ee4d2d12f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521412.755325:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d12e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x411dd0ee4d2d12f0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521412.755333:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521412.755336:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521412.755339:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521412.755340:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521412.755343:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521412.755347:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788521412.761230:0:15611:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fef816fa300 - data ffff8fef6535f288/ffff8fef7a500400 00000020:01000000:2.0:1788521412.762104:0:15611:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fee422c9120 - data ffff8fef65277798/ffff8fef766ce800 00100000:10000000:2.0:1788521412.772063:0:15611:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788521412.782146:0:15611:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d103b 00000020:00000080:2.0:1788521412.782161:0:15611:0:(genops.c:885:class_export_put()) final put ffff8fef81660000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788521412.782176:0:15611:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fef76680800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788521412.782180:0:15611:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fef76680800 2 00000020:01000004:2.0:1788521412.782184:0:15611:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8fef76680800 from lustre-OST0000 00000020:00000080:2.0:1788521412.782207:0:15611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788521412.782216:0:15611:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788521412.782219:0:15611:0:(genops.c:885:class_export_put()) final put ffff8fef81662800/lustre-OST0000_UUID 00000020:00000080:2.0:1788521412.782222:0:15611:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef81662800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788521412.782228:0:15611:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788521412.782280:0:15611:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788521412.782284:0:15611:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788521412.782288:0:15611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788521412.782294:0:15611:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788521412.782300:0:15611:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8fef765bf800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788521412.782305:0:15611:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8fee42138000) has exports, disconnecting them 00000020:00080000:2.0:1788521412.782311:0:15611:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8fef765bf800), last request at 1788521160 00000020:00000080:2.0:1788521412.782315:0:15611:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d1065 00000020:00080000:2.0:1788521412.782324:0:15611:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fef765bf800): rc 0 00000020:00000080:2.0:1788521412.782329:0:15611:0:(genops.c:885:class_export_put()) final put ffff8fef765bf800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788521412.783230:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef81660000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788521412.783243:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef765bf800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788521412.783812:0:15611:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788521412.783817:0:15611:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788521412.783830:0:15611:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788521412.783835:0:15611:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788521412.784006:0:15611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788521412.784014:0:15611:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1788521412.784019:0:15611:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788521412.784023:0:15611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788521412.784027:0:15611:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788521412.784033:0:15611:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8fee4211f000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788521412.784038:0:15611:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8fef4e783380) has exports, disconnecting them 00000020:00080000:3.0:1788521412.784043:0:15611:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8fee4211f000), last request at 1788521160 00000020:00000080:3.0:1788521412.784046:0:15611:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d107a 00000020:00080000:3.0:1788521412.784058:0:15611:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fee4211f000): rc 0 00000020:00000080:3.0:1788521412.784062:0:15611:0:(genops.c:885:class_export_put()) final put ffff8fee4211f000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788521412.784675:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fef81471000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788521412.784683:0:37:0:(genops.c:885:class_export_put()) final put ffff8fef81667800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788521412.784686:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef81667800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788521412.784692:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788521412.784753:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fee4211f000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788521412.798046:0:15611:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788521412.798055:0:15611:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788521412.798060:0:15611:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788521412.798068:0:15611:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788521412.798113:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fee42118000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788521412.798323:0:15611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788521412.798331:0:15611:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788521412.798337:0:15611:0:(genops.c:885:class_export_put()) final put ffff8fee42118800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788521412.798341:0:15611:0:(genops.c:844:class_export_destroy()) destroying export ffff8fee42118800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788521412.798346:0:15611:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788521412.798431:0:15611:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fef76680800 1 00000020:00000080:1.0:1788521412.798437:0:15611:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d1003 00000020:00000080:1.0:1788521412.798454:0:15611:0:(genops.c:885:class_export_put()) final put ffff8fef71ba6000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788521412.798465:0:15611:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788521412.798474:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef71ba6000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788521412.798505:0:15611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788521412.798511:0:15611:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788521412.798515:0:15611:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8fef7a25cd40) has no exports 00000020:00000080:3.0:1788521412.870647:0:15611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788521412.870662:0:15611:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788521412.870669:0:15611:0:(genops.c:885:class_export_put()) final put ffff8fef76681800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788521412.870673:0:15611:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef76681800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788521412.870683:0:15611:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788521412.870835:0:15611:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8fef76685000 00000020:02000400:3.0:1788521412.870932:0:15611:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788521412.880733:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788521413.772962:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788521413.772971:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788521413.772974:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788521413.772977:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788521413.773101:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875400222486912:0@lo:400:kworker.0 00000400:00000100:2.0:1788521413.773154:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875400222486912 offset 0 length 224: 4 00010000:00010000:2.0:1788521413.902031:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521414.925304:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521415.952736:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521416.975502:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788521417.124379:0:15813:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788521417.134087:0:15813:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788521417.134248:0:15813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6a00/0x411dd0ee4d2d12bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d12c6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521417.134264:0:15813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6a00/0x411dd0ee4d2d12bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d12c6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521417.134272:0:15813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6a00/0x411dd0ee4d2d12bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d12c6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521417.134280:0:15813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6a00/0x411dd0ee4d2d12bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d12c6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521417.134303:0:15813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788521417.134309:0:15813:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788521417.134333:0:15813:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788521417.134344:0:15813:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fef7f0ca680 x1875400222486144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788521422 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788521417.134361:0:13735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788521417.134371:0:15813:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00010000:00010000:0.0:1788521417.134379:0:13735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6a00/0x411dd0ee4d2d12bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d12c6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788521417.134385:0:15813:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788521417.134393:0:15813:0:(import.c:65:import_set_state_nolock()) ffff8fef7a7c0800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788521417.134399:0:15813:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788521417.134404:0:15813:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fef7f0ca680 x1875400222486144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788521422 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788521417.134414:0:13735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6a00 already unused, calling callback (ffffffffc1352c20) 00000100:00100000:2.0:1788521417.134420:0:15813:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 10000000:00010000:0.0:1788521417.134422:0:13735:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6a00/0x411dd0ee4d2d12bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d12c6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521417.134425:0:15813:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00010000:00010000:0.0:1788521417.134435:0:13735:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6a00/0x411dd0ee4d2d12bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x411dd0ee4d2d12c6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521417.134442:0:13735:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6a00/0x411dd0ee4d2d12bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x411dd0ee4d2d12c6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521417.134448:0:13735:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788521417.134450:0:13735:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788521417.134453:0:13735:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788521417.134468:0:13735:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fef71e17800 00010000:00010000:0.0:1788521417.134472:0:13735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6a00/0x411dd0ee4d2d12bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x411dd0ee4d2d12c6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521417.134479:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6a00/0x411dd0ee4d2d12bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x411dd0ee4d2d12c6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521417.134495:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521417.134497:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521417.134498:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521417.136056:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875400222486144:0@lo:38:kworker.0 00000100:00080000:2.0:1788521417.138421:0:15813:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788521417.138682:0:15813:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fef7f0c9500 x1875400222486272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521418 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521417.138707:0:15813:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fee43d23800 x1875400222486400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521419 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521417.138716:0:15813:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fee43d22680 x1875400222486528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521423 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521417.138733:0:15813:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fee43d20000 x1875400222486784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521424 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521417.138741:0:15813:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fee43d23b80 x1875400222486912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521429 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521417.138753:0:15813:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1788521417.138786:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875400222486912:0@lo:400:kworker.0 00000100:00080000:2.0:1788521417.138819:0:15813:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788521417.139158:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875400222486400:0@lo:400:kworker.0 00000100:00100000:0.0:1788521417.139169:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875400222486272:0@lo:400:kworker.0 00000100:00100000:1.0:1788521417.139246:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222486784:0@lo:400:kworker.0 00000100:00100000:1.0:1788521417.139253:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222486528:0@lo:400:kworker.0 00000100:00080000:2.0:1788521417.140079:0:15813:0:(import.c:65:import_set_state_nolock()) ffff8fee426dc800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788521417.140142:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1875400222487040:0@lo:39:umount.0 00000400:00000100:3.0:1788521417.140198:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875400222487040 offset 0 length 224: 4 00010000:00010000:2.0:1788521417.997670:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788521418.893405:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788521418.893417:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788521419.021336:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521420.050400:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521421.069152:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521422.093301:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521423.117133:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521423.309591:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788521408/real 1788521408] req@ffff8fee43d21500 x1875400222486656/t0(0) o250->MGC192.168.203.141@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788521423 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521423.309621:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fee43d21500 x1875400222486656/t0(0) o250->MGC192.168.203.141@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788521423 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788521423.309662:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef71e17800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788521423.309686:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788521423.309690:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3642:1875400222486656:0@lo:250:kworker.0 00000100:00080000:2.0:1788521423.309761:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788521423.309766:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788521423.309769:0:37:0:(import.c:65:import_set_state_nolock()) ffff8fef71e17800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788521423.309774:0:37:0:(import.c:545:import_select_connection()) MGC192.168.203.141@tcp: connect to NID 0@lo last attempt 458 00000100:00080000:2.0:1788521423.309780:0:37:0:(import.c:630:import_select_connection()) MGC192.168.203.141@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788521423.309786:0:37:0:(import.c:665:import_select_connection()) MGC192.168.203.141@tcp: import ffff8fef71e17800 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:2.0:1788521423.309827:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee43599c00 x1875400222487168/t0(0) o250->MGC192.168.203.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788521423.309965:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3642:1875400222487168:0@lo:250:kworker.0 00000400:00000100:3.0:1788521423.310010:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875400222487168 offset 0 length 520: 4 00010000:00010000:0.0:1788521424.144018:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521425.165237:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521426.189153:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521427.213198:0:13735:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521427.405049:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788521417/real 1788521417] req@ffff8fee43598a80 x1875400222487040/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788521427 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521427.405086:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fee43598a80 x1875400222487040/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788521427 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788521427.405111:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fee426dc800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788521427.405141:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1875400222487040:0@lo:39:umount.0 00000100:00080000:2.0:1788521427.405259:0:15813:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788521427.405265:0:15813:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788521427.405270:0:15813:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788521427.406131:0:15813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee42411400/0x411dd0ee4d2d12cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d12d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521427.406145:0:15813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee42411400/0x411dd0ee4d2d12cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d12d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521427.406152:0:15813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee42411400/0x411dd0ee4d2d12cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d12d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521427.406159:0:15813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.141@tcp lock: ffff8fee42411400/0x411dd0ee4d2d12cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d12d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521427.407980:0:15813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521427.407995:0:15813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef40030800/0x411dd0ee4d2d1551 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d1558 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521427.408004:0:15813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef40030800/0x411dd0ee4d2d1551 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d1558 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521427.408011:0:15813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef40030800/0x411dd0ee4d2d1551 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d1558 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521427.408017:0:15813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.141@tcp lock: ffff8fef40030800/0x411dd0ee4d2d1551 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x411dd0ee4d2d1558 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521427.408061:0:15813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788521427.408066:0:15813:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788521427.408102:0:15813:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788521427.408107:0:15813:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788521427.408114:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788521427.408120:0:15813:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788521427.408125:0:15813:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8fee426d0000) has no exports 00000020:00080000:2.0:1788521427.408150:0:15813:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8fee426d0000) has no exports 00010000:00010000:3.0:1788521427.408161:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788521427.408170:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fee42411400/0x411dd0ee4d2d12cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d12d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521427.408180:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42411400 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:3.0:1788521427.408184:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fee42411400/0x411dd0ee4d2d12cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d12d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521427.408193:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fee42411400/0x411dd0ee4d2d12cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x411dd0ee4d2d12d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521427.408200:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fee42411400/0x411dd0ee4d2d12cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x411dd0ee4d2d12d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521427.408218:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788521427.408221:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1788521427.408224:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1788521427.408237:0:6507:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fef71e17800 00010000:00010000:3.0:1788521427.408241:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fee42411400/0x411dd0ee4d2d12cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x411dd0ee4d2d12d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521427.408247:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fee42411400/0x411dd0ee4d2d12cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x411dd0ee4d2d12d4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521427.408262:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521427.408265:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef40030800/0x411dd0ee4d2d1551 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d1558 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521427.408271:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40030800 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:3.0:1788521427.408274:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef40030800/0x411dd0ee4d2d1551 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x411dd0ee4d2d1558 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521427.408280:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef40030800/0x411dd0ee4d2d1551 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x411dd0ee4d2d1558 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521427.408286:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef40030800/0x411dd0ee4d2d1551 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x411dd0ee4d2d1558 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521427.408291:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788521427.408292:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788521427.408294:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788521427.408311:0:6507:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fef71e17800 00010000:00010000:3.0:1788521427.408314:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef40030800/0x411dd0ee4d2d1551 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x411dd0ee4d2d1558 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521427.408327:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef40030800/0x411dd0ee4d2d1551 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x411dd0ee4d2d1558 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521427.408341:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521427.408344:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521427.408345:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521427.408732:0:13734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788521427.414643:0:15813:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fef7a44a180 - data ffff8fef65362438/ffff8fef7ef80000 00000020:01000000:2.0:1788521427.416803:0:15813:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fef7a44af60 - data ffff8fef65361bd0/ffff8fee43141c00 00100000:10000000:2.0:1788521427.427190:0:15813:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788521427.447639:0:15813:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d1161 00000020:00000080:1.0:1788521427.447655:0:15813:0:(genops.c:885:class_export_put()) final put ffff8fee426da800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788521427.447675:0:15813:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fef7675d800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788521427.447679:0:15813:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fef7675d800 2 00000020:01000004:1.0:1788521427.447682:0:15813:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8fef7675d800 from lustre-OST0001 00000020:00000080:1.0:1788521427.447715:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788521427.447726:0:15813:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788521427.447729:0:15813:0:(genops.c:885:class_export_put()) final put ffff8fee426df800/lustre-OST0001_UUID 00000020:00000080:1.0:1788521427.447733:0:15813:0:(genops.c:844:class_export_destroy()) destroying export ffff8fee426df800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788521427.447740:0:15813:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:0.0:1788521427.447811:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fee426da800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:1.0:1788521427.448548:0:15813:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf->MGS 00010000:00010000:1.0:1788521427.448565:0:15813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef4167ee00/0x411dd0ee4d2d0eba lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x411dd0ee4d2d0ec1 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521427.448578:0:15813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef4167ee00/0x411dd0ee4d2d0eba lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x411dd0ee4d2d0ec1 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521427.448585:0:15813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788521427.448588:0:15813:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788521427.448591:0:15813:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788521427.448608:0:15813:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fef71e17800 00010000:00010000:1.0:1788521427.448612:0:15813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef4167ee00/0x411dd0ee4d2d0eba lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x411dd0ee4d2d0ec1 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521427.448628:0:15813:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fee434ab400/0x411dd0ee4d2d132f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x411dd0ee4d2d1336 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521427.448646:0:15813:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fee434ab400/0x411dd0ee4d2d132f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x411dd0ee4d2d1336 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521427.448652:0:15813:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788521427.448654:0:15813:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788521427.448655:0:15813:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788521427.448666:0:15813:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fef71e17800 00010000:00010000:1.0:1788521427.448669:0:15813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fee434ab400/0x411dd0ee4d2d132f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x411dd0ee4d2d1336 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788521427.448684:0:15813:0:(import.c:65:import_set_state_nolock()) ffff8fef71e17800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788521427.448688:0:15813:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788521427.448691:0:15813:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788521427.448693:0:15813:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788521427.448698:0:15813:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788521427.448711:0:15813:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fee43599c00 x1875400222487168/t0(0) o250->MGC192.168.203.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788521443 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788521427.448725:0:15813:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788521427.448728:0:15813:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:3.0:1788521427.448813:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43599c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf:3642:1875400222487168:0@lo:250:kworker.0 10000000:01000000:1.0:1788521427.451106:0:15813:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788521427.451125:0:15813:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d0db7 00000020:00000080:1.0:1788521427.451134:0:15813:0:(genops.c:885:class_export_put()) final put ffff8fef71e10800/0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf 00000020:01000000:1.0:1788521427.451147:0:15813:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.141@tcp (flags='') 00000020:00000080:1.0:1788521427.451254:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788521427.451262:0:15813:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.141@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788521427.451267:0:15813:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8fef4e780000) has no exports 00000020:00000080:0.0:1788521427.451516:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef71e10800/0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf for MGC192.168.203.141@tcp 10000000:01000000:3.0:1788521427.451563:0:6517:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788521427.451622:0:15813:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.141@tcp: client import never connected 00000100:00080000:1.0:1788521427.451627:0:15813:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788521427.451630:0:15813:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788521427.451634:0:15813:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788521427.451647:0:15813:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788521427.451702:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788521427.451710:0:15813:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.141@tcp (uuid 0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf) 00000020:01000000:1.0:1788521427.451718:0:15813:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788521427.451722:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788521427.451726:0:15813:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788521427.451733:0:15813:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8fee426dc000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788521427.451739:0:15813:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff8fef6d7f3380) has exports, disconnecting them 00000020:00080000:1.0:1788521427.451744:0:15813:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8fee426dc000), last request at 1788521184 00000020:00000080:1.0:1788521427.451749:0:15813:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d118b 00000020:00080000:1.0:1788521427.451775:0:15813:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fee426dc000): rc 0 00000020:00000080:1.0:1788521427.451779:0:15813:0:(genops.c:885:class_export_put()) final put ffff8fee426dc000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788521427.452467:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fef71e17800 for MGC192.168.203.141@tcp 00000020:00000080:0.0:1788521427.452476:0:37:0:(genops.c:885:class_export_put()) final put ffff8fef44a9d000/0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf 00000020:00000080:0.0:1788521427.452479:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef44a9d000/0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf for MGC192.168.203.141@tcp 00000020:01000000:0.0:1788521427.452485:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.141@tcp (0f2ffe03-3a0f-4a44-97e6-438b5eadc6bf) 00000020:00000080:0.0:1788521427.452773:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fee426dc000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788521427.452973:0:15813:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788521427.452977:0:15813:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788521427.452981:0:15813:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788521427.452986:0:15813:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788521427.453005:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fef7a7c0800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788521427.453281:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788521427.453289:0:15813:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788521427.453293:0:15813:0:(genops.c:885:class_export_put()) final put ffff8fee41ab8800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788521427.453296:0:15813:0:(genops.c:844:class_export_destroy()) destroying export ffff8fee41ab8800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788521427.453302:0:15813:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788521427.453348:0:15813:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788521427.453352:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788521427.453357:0:15813:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788521427.453363:0:15813:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8fee426db800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788521427.453369:0:15813:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff8fee426d19c0) has exports, disconnecting them 00000020:00080000:0.0:1788521427.453374:0:15813:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8fee426db800), last request at 1788521184 00000020:00000080:0.0:1788521427.453378:0:15813:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d11a0 00000020:00080000:0.0:1788521427.453396:0:15813:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fee426db800): rc 0 00000020:00000080:0.0:1788521427.453410:0:15813:0:(genops.c:885:class_export_put()) final put ffff8fee426db800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788521427.453444:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fee426db800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1788521427.463966:0:15813:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788521427.463975:0:15813:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788521427.463980:0:15813:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788521427.463988:0:15813:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788521427.464026:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fee426dc800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1788521427.464095:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788521427.464281:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788521427.467948:0:13735:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1788521427.468101:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00010000:00010000:1.0:1788521427.468568:0:13734:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-5 blwis in pool) 00000100:00100000:3.0:1788521427.468754:0:6503:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8fef52aaaa00:6503] 1 exiting: rc = 0 00000100:00100000:1.0:1788521427.469536:0:6502:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8fef52aaac00:6502] 0 exiting: rc = 1 00000100:00100000:1.0:1788521427.473650:0:9522:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8fef76713600:9522] 2 exiting: rc = 0 00000100:00100000:3.0:1788521427.473870:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.474449:0:6505:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8fef52a4a400:6505] 1 exiting: rc = 0 00000100:00100000:1.0:1788521427.474572:0:15411:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8fef42e19a00:15411] 3 exiting: rc = 0 00000100:00100000:2.0:1788521427.474614:0:6504:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8fef52aab000:6504] 0 exiting: rc = 1 00000100:00100000:1.0:1788521427.474651:0:6506:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8fef52aaae00:6506] 2 exiting: rc = 0 00000100:00100000:3.0:1788521427.474734:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.474741:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.474749:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.474755:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.475875:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.475922:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.475929:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.475951:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.475957:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.475962:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.475968:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.475973:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.475979:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.475985:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.475991:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.475997:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476002:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476008:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476013:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476019:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476025:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476030:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476034:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476039:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476118:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476127:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476132:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476137:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476141:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476147:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476214:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476226:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476231:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476307:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476314:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476319:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476324:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476329:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476334:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476339:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476344:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476349:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476363:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476367:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476372:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476377:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476386:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476392:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476397:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476403:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476407:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476413:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476419:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476425:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476431:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476436:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476441:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476446:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476452:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476457:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476462:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476468:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476473:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521427.476479:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788521427.480589:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788521427.480601:0:15813:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788521427.480606:0:15813:0:(genops.c:885:class_export_put()) final put ffff8fee426d9800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788521427.480611:0:15813:0:(genops.c:844:class_export_destroy()) destroying export ffff8fee426d9800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788521427.480617:0:15813:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788521427.480671:0:15813:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fef7675d800 1 00000020:00000080:3.0:1788521427.480677:0:15813:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x411dd0ee4d2d1130 00000020:00000080:3.0:1788521427.480683:0:15813:0:(genops.c:885:class_export_put()) final put ffff8fef816f7000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788521427.481152:0:15813:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788521427.481221:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788521427.481227:0:15813:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788521427.481231:0:15813:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff8fef7a2599c0) has no exports 00000020:00000080:1.0:1788521427.484598:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef816f7000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788521427.536647:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788521427.536660:0:15813:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788521427.536666:0:15813:0:(genops.c:885:class_export_put()) final put ffff8fef7675a800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788521427.536671:0:15813:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef7675a800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788521427.536678:0:15813:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788521427.537397:0:15813:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8fef7675f800 00000020:01000000:1.0:1788521427.537423:0:15813:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788521427.537428:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788521427.537433:0:15813:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788521427.537438:0:15813:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8fef6d7f19c0) has no exports 00000020:00000080:1.0:1788521427.537461:0:15813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788521427.537467:0:15813:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788521427.537480:0:15813:0:(genops.c:885:class_export_put()) final put ffff8fef76682000/OSS_uuid 00000020:00000080:1.0:1788521427.537483:0:15813:0:(genops.c:844:class_export_destroy()) destroying export ffff8fef76682000/OSS_uuid for OSS 00000020:01000000:1.0:1788521427.537488:0:15813:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1788521427.537663:0:6515:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788521427.538013:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8fef8162c400:8437] 2 exiting: rc = 0 00000100:00100000:0.0:1788521427.538206:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8fef76535600:8434] 0 exiting: rc = 1 00000100:00100000:1.0:1788521427.538340:0:8875:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8fef7a575e00:8875] 3 exiting: rc = 0 00000100:00100000:2.0:1788521427.538863:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8fef76534400:8436] 1 exiting: rc = 0 00000100:00100000:0.0:1788521427.539743:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539756:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539772:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539778:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539787:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539792:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539797:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539803:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539807:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539813:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539818:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539823:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539828:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539834:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539839:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539844:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539848:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539854:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539859:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539864:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539868:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539873:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539877:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539908:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539914:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539919:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539923:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539928:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539933:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539939:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539944:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539948:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539953:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539968:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539974:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539979:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539983:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539988:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539992:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.539997:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.540002:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.540007:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.540012:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.540017:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.540022:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.540028:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.540033:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.540037:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.540283:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.540293:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.540298:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.540303:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.540308:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.540313:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.540318:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.540323:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.540329:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.540333:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.540345:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.540351:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.540356:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.540362:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.540368:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.540373:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521427.543565:0:11958:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8fef7652e600:11958] 2 exiting: rc = 0 00000100:00100000:3.0:1788521427.543857:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8fef815a8e00:8438] 0 exiting: rc = 1 00000100:00100000:0.0:1788521427.544213:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8fef76530e00:8439] 1 exiting: rc = 0 00000100:00100000:1.0:1788521427.544334:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544342:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544349:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544353:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544358:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544363:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544368:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544372:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544378:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544383:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544387:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544392:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544397:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544402:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544407:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544411:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544416:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544421:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544425:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544429:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544434:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544439:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544444:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544449:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544454:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544459:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544465:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544469:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544474:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544480:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544484:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544504:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544510:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544516:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544521:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544586:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544592:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544597:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544602:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544607:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544613:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544618:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544622:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544627:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544631:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544636:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544641:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544646:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544651:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544656:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544661:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544666:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544671:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544676:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544681:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544686:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544692:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544698:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544748:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544755:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544768:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544774:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544785:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.544796:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.546681:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8fef76475200:8440] 0 exiting: rc = 1 00000100:00100000:1.0:1788521427.547569:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8fef8159d800:8442] 2 exiting: rc = 0 00000100:00100000:3.0:1788521427.548027:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8fef75467800:8441] 1 exiting: rc = 0 00000100:00100000:0.0:1788521427.548165:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548173:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548191:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548197:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548203:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548209:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548214:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548220:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548234:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548241:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548247:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548255:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548261:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548266:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548273:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548278:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548284:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548290:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548297:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548303:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548310:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548316:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548323:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548330:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548337:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548343:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548349:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548355:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548361:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548367:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548372:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548378:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548402:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548409:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548415:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548421:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548426:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548438:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548444:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548450:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548456:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548461:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548466:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548472:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548478:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548483:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548489:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548495:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548501:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548507:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548512:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548519:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548537:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548544:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548550:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548556:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548571:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548578:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548591:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548607:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548622:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548629:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548635:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.548641:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521427.555336:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8fef7a22e200:8443] 0 exiting: rc = 1 00000100:00100000:3.0:1788521427.555516:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8fef7a22f800:8444] 1 exiting: rc = 0 00000100:00100000:1.0:1788521427.555805:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.555828:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.555833:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.555838:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.555843:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.555848:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.555853:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.555859:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.555864:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.555869:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.555874:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.555879:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556128:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556134:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556140:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556145:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556150:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556323:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556329:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556334:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556339:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556343:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556347:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556352:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556358:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556363:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556368:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556373:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556377:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556382:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556387:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556392:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556397:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556402:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556407:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556411:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556424:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556428:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556433:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556438:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556443:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556449:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556453:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556458:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556463:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556468:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556480:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556486:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556491:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556496:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556500:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556505:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556509:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556514:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556518:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556668:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556676:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556681:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556686:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556691:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556696:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556701:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556714:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.556724:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521427.563257:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8fef815a9800:8445] 0 exiting: rc = 1 00000100:00100000:2.0:1788521427.563474:0:8446:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8fef42e19400:8446] 1 exiting: rc = 0 00000100:00100000:0.0:1788521427.563822:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.563831:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.563844:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.563852:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.563859:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.563865:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.563871:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.563877:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.563924:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.563930:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.563936:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.563957:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.563964:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.563970:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.563976:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.563983:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.563989:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.563995:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564002:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564012:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564018:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564024:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564029:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564247:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564256:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564264:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564271:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564277:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564284:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564292:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564299:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564305:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564310:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564315:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564321:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564342:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564350:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564358:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564365:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564379:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564395:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564402:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564409:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564421:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564428:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564435:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564442:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564448:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564455:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564478:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564485:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564491:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564497:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564503:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564509:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564515:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564520:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564605:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564612:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564617:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564623:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564629:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564636:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521427.564650:0:15813:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788521427.574858:0:15813:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788521448.166195:0:16579:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg341-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788521459.938759:0:17178:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788521459.938765:0:17178:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788521459.938767:0:17178:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788521459.938878:0:17178:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8fef48513800 00000020:01000004:3.0:1788521459.939377:0:17178:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788521459.939385:0:17178:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788521459.939399:0:17178:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8fee426d19c0) 00000020:00000080:3.0:1788521459.939413:0:17178:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788521460.047448:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788521460.054629:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788521460.067814:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1788521460.068548:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788521460.068853:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1788521460.069124:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788521460.069939:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1788521460.073709:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788521460.075630:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788521460.078019:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788521460.080426:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1788521460.081700:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788521460.083230:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788521460.086350:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1788521460.089959:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788521460.090619:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788521460.091431:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788521460.093410:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1788521460.093972:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788521460.094172:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1788521460.098704:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788521460.102230:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788521460.109245:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788521460.109938:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788521460.110228:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788521460.110863:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788521460.113928:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788521460.116055:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788521460.117678:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788521460.119963:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788521460.121364:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788521460.123746:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788521460.124564:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788521460.125662:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1788521460.127220:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1788521460.132400:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788521460.133806:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1788521460.134084:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788521460.134330:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1788521460.135097:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788521460.135390:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788521460.136121:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788521460.136715:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1788521460.136956:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1788521460.137171:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1788521460.137415:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788521460.137657:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1788521460.138265:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1788521460.142646:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1788521460.142992:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1788521460.143531:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788521460.143795:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1788521460.143999:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:1.0:1788521460.146280:0:17178:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788521460.146499:0:17178:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788521460.146507:0:17178:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788521460.146518:0:17178:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x411dd0ee4d2d2374 00000020:01000004:1.0:1788521460.146524:0:17178:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788521460.146529:0:17178:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788521460.146546:0:17178:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8fef48513800 from MGS 00000020:01000004:1.0:1788521460.146550:0:17178:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788521460.146560:0:17178:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8fef4e783380) 00000020:00000080:1.0:1788521460.146702:0:17178:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788521460.146796:0:17178:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fef48513800 from MGS, refs=2 00080000:01000000:1.0:1788521460.146815:0:17178:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788521460.146820:0:17178:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x411dd0ee4d2d2382 00000100:00100000:1.0:1788521460.147833:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788521460.148004:0:17178:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788521460.148010:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788521460.156075:0:17178:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788521460.156098:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788521460.157033:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521460.157209:0:17178:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788521460.157215:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788521460.158049:0:17178:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788521460.158058:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788521460.158374:0:17178:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788521460.158381:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788521460.161252:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521460.161258:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521460.161260:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521460.161818:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521460.161821:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521460.161823:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521460.162430:0:17178:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788521460.170111:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788521460.170684:0:17178:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788521460.179430:0:17191:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788521460.179488:0:17178:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788521460.179618:0:17178:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788521460.180459:0:17178:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788521460.180837:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788521460.181101:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788521460.181108:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788521460.181811:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788521460.181817:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788521460.182409:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788521460.182416:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788521460.183275:0:17178:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788521460.183308:0:17178:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.141@tcp' 00000020:01000004:0.0:1788521460.183310:0:17178:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788521460.183340:0:17178:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.141@tcp (typ=mgc) 00000020:00000080:0.0:1788521460.183351:0:17178:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.141@tcp (ffff8fee421399c0) 00000020:00000080:0.0:1788521460.183367:0:17178:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788521460.183446:0:17178:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fef7675f800@MGC192.168.203.141@tcp: add connection 192.168.203.141@tcp at head 00010000:00010000:0.0:1788521460.183827:0:17178:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.141@tcp-0 is initialized 00000040:01000000:0.0:1788521460.183842:0:17178:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.141@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788521460.185762:0:17195:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788521460.185867:0:17196:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788521460.185973:0:17178:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.141@tcp (uuid 94dd3513-7bc4-4d8b-8448-a7d8a70716ce) 00000020:00000080:1.0:1788521460.185996:0:17178:0:(genops.c:1385:class_connect()) connect: client 94dd3513-7bc4-4d8b-8448-a7d8a70716ce, cookie 0x411dd0ee4d2d2390 00000100:00080000:1.0:1788521460.186008:0:17178:0:(import.c:545:import_select_connection()) MGC192.168.203.141@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788521460.186015:0:17178:0:(import.c:665:import_select_connection()) MGC192.168.203.141@tcp: import ffff8fef7675f800 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:1.0:1788521460.186049:0:17178:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fef715a2a00 x1875400222487296/t0(0) o250->MGC192.168.203.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788521460.186075:0:17178:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 94dd3513-7bc4-4d8b-8448-a7d8a70716ce->MGS 00000020:01000004:1.0:1788521460.186095:0:17178:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788521460.186101:0:17178:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788521460.186113:0:17178:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8fef4e780000) 00000020:00000080:1.0:1788521460.186126:0:17178:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788521460.187496:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3642:1875400222487296:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788521460.187580:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521460.187728:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222487296 00000100:00100000:2.0:1788521460.187736:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222487296 00000100:00100000:2.0:1788521460.187772:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788521460.187779:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a5fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3642:x1875400222487296:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788521460.187801:0:17192:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 94dd3513-7bc4-4d8b-8448-a7d8a70716ce@0@lo t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:2.0:1788521460.187824:0:17192:0:(genops.c:1385:class_connect()) connect: client 94dd3513-7bc4-4d8b-8448-a7d8a70716ce, cookie 0x411dd0ee4d2d239e 00000100:00080000:2.0:1788521460.187965:0:17192:0:(import.c:65:import_set_state_nolock()) ffff8fef71577000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788521460.188018:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a5fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+5:3642:x1875400222487296:12345-0@lo:250:mount.lustre.0 Request processed in 238us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521460.188025:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788521460.188076:0:3642:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.141@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788521460.188086:0:3642:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.141@tcp: connect to target with instance 0 00000100:00080000:2.0:1788521460.188094:0:3642:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.141@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788521460.188099:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788521460.188102:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef7675f800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788521460.188104:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788521460.188111:0:3642:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788521460.188116:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3642:1875400222487296:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788521460.199471:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788521460.199825:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788521460.199832:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788521460.201118:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788521460.201128:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788521460.201591:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788521460.201598:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788521460.203185:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788521460.204175:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788521460.204183:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788521460.206767:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788521460.206782:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788521460.305112:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521460.305820:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788521460.305829:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788521460.307742:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788521460.307757:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788521460.309032:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521460.309216:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788521460.309221:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788521460.310083:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788521460.310091:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788521460.311068:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521460.311231:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788521460.311237:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788521460.312779:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788521460.312793:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788521460.314096:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521460.314291:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788521460.314297:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788521460.315210:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788521460.315219:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788521460.358221:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788521460.358439:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788521460.358446:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788521460.360967:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788521460.360984:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788521460.363902:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788521460.363917:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788521460.366685:0:17178:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788521460.366714:0:17178:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788521460.366726:0:17178:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.141@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788521460.366830:0:17178:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.141@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788521460.366868:0:17178:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.141@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788521460.366873:0:17178:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788521460.366875:0:17178:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788521460.366877:0:17178:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788521460.366878:0:17178:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788521460.366879:0:17178:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788521460.366881:0:17178:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788521460.366921:0:17178:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788521460.366922:0:17178:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788521460.366924:0:17178:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788521460.366925:0:17178:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788521460.366942:0:17178:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788521460.366944:0:17178:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788521460.366945:0:17178:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788521460.366946:0:17178:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788521460.366948:0:17178:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788521460.366949:0:17178:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788521460.366950:0:17178:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788521460.366951:0:17178:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788521460.366952:0:17178:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788521460.366953:0:17178:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788521460.366954:0:17178:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788521460.366979:0:17178:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788521460.366998:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222487424:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788521460.367079:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521460.367121:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef44fb6180 going to sleep for 11 seconds 00000100:00100000:2.0:1788521460.367134:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222487424 00000100:00100000:2.0:1788521460.367141:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222487424 00000100:00100000:2.0:1788521460.367188:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788521460.367198:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+5:17178:x1875400222487424:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788521460.367248:0:17194:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788521460.367251:0:17194:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788521460.367254:0:17194:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788521460.369503:0:17216:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788521460.370865:0:17194:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1788521460.379560:0:17217:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788521460.379570:0:17217:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1788521460.379574:0:17217:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788521460.379577:0:17217:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788521460.380111:0:17217:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788521460.380518:0:17194:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788521460.380530:0:17194:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788521460.386525:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+5:17178:x1875400222487424:12345-0@lo:253:mount.lustre.0 Request processed in 19318us (19435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521460.386555:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788521460.387441:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222487424:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788521460.387460:0:17178:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788521460.387478:0:17178:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788521460.387480:0:17178:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788521460.387481:0:17178:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788521460.387482:0:17178:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788521460.387484:0:17178:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788521460.387485:0:17178:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788521460.387486:0:17178:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788521460.387488:0:17178:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788521460.387490:0:17178:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788521460.387491:0:17178:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788521460.387511:0:17178:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8fef48513800 from lustre-MDT0000 10000000:01000000:1.0:1788521460.387549:0:17178:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788521460.387552:0:17178:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788521460.387557:0:17178:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8fee421399c0 10000000:01000000:1.0:1788521460.387561:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788521460.387579:0:17178:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8fee421399c0 from 1 10000000:01000000:1.0:1788521460.387583:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788521460.387622:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d23a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.387634:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d23a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.387644:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d23a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521460.387665:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222487552:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788521460.387931:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521460.388411:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef44fb6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521460.390024:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222487552 00000100:00100000:2.0:1788521460.390036:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222487552 00000100:00100000:2.0:1788521460.390249:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788521460.390261:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+5:17178:x1875400222487552:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521460.390283:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521460.390315:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef4167f000/0x411dd0ee4d2d23ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d23a5 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521460.390344:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef4167f000/0x411dd0ee4d2d23ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d23a5 expref: 6 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521460.390356:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef4167f000/0x411dd0ee4d2d23ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d23a5 expref: 6 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521460.390365:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef4167f000, rc 0) 00000100:00100000:2.0:1788521460.390456:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+6:17178:x1875400222487552:12345-0@lo:101:mount.lustre.0 Request processed in 197us (2525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521460.390464:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788521460.390755:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222487552:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788521460.390773:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d23a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d23ac expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.390792:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d23a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d23ac expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521460.390911:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222487680:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788521460.390947:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521460.392182:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef44fb6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521460.395651:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222487680 00000100:00100000:3.0:1788521460.395666:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222487680 00000100:00100000:3.0:1788521460.395738:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788521460.395762:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+6:17178:x1875400222487680:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788521460.395961:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+6:17178:x1875400222487680:12345-0@lo:501:mount.lustre.0 Request processed in 200us (5012us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788521460.395968:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788521460.397931:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222487680:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788521460.397988:0:17178:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788521460.398019:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d23a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d23ac expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.398031:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d23a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d23ac expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521460.398041:0:17178:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8fef48513800 10000000:01000000:1.0:1788521460.398049:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788521460.398054:0:17178:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8fef48513800 10000000:01000000:1.0:1788521460.398057:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788521460.398061:0:17178:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8fef48513800 from 1 10000000:01000000:1.0:1788521460.398064:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788521460.398099:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434aae00/0x411dd0ee4d2d23b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.398107:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fee434aae00/0x411dd0ee4d2d23b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.398118:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fee434aae00/0x411dd0ee4d2d23b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521460.398157:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222487808:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788521460.398215:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521460.398252:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef44fb6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521460.399753:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222487808 00000100:00100000:3.0:1788521460.399767:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222487808 00000100:00100000:3.0:1788521460.399814:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788521460.399823:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+6:17178:x1875400222487808:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788521460.399839:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521460.399860:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef413fcc00/0x411dd0ee4d2d23ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d23b3 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521460.399899:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef413fcc00/0x411dd0ee4d2d23ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d23b3 expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521460.399911:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef413fcc00/0x411dd0ee4d2d23ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d23b3 expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521460.399919:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fcc00, rc 0) 00000100:00100000:3.0:1788521460.399983:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+7:17178:x1875400222487808:12345-0@lo:101:mount.lustre.0 Request processed in 161us (1767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521460.399990:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788521460.403241:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222487808:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788521460.403278:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fee434aae00/0x411dd0ee4d2d23b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d23ba expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.403295:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fee434aae00/0x411dd0ee4d2d23b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d23ba expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521460.403318:0:17178:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788521460.403391:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434aae00/0x411dd0ee4d2d23b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d23ba expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.403401:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fee434aae00/0x411dd0ee4d2d23b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d23ba expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521460.403410:0:17178:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788521460.403419:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788521460.403426:0:17178:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8fef48513800 10000000:01000000:1.0:1788521460.403430:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788521460.403435:0:17178:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788521460.403438:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788521460.403473:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434aba00/0x411dd0ee4d2d23c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.403481:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fee434aba00/0x411dd0ee4d2d23c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.403505:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fee434aba00/0x411dd0ee4d2d23c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521460.403527:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222487936:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788521460.403606:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521460.403653:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef44fb6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521460.403903:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222487936 00000100:00100000:0.0:1788521460.403910:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222487936 00000100:00100000:0.0:1788521460.404009:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788521460.404020:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+7:17178:x1875400222487936:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788521460.404034:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521460.404051:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef7f12ce00/0x411dd0ee4d2d23c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d23c1 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521460.404074:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef7f12ce00/0x411dd0ee4d2d23c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d23c1 expref: 8 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521460.404085:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef7f12ce00/0x411dd0ee4d2d23c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d23c1 expref: 8 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521460.404105:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef7f12ce00, rc 0) 00000100:00100000:0.0:1788521460.404159:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+8:17178:x1875400222487936:12345-0@lo:101:mount.lustre.0 Request processed in 141us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521460.404166:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788521460.404238:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222487936:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788521460.404252:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fee434aba00/0x411dd0ee4d2d23c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d23c8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.404261:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fee434aba00/0x411dd0ee4d2d23c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d23c8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521460.404311:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222488064:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788521460.404336:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521460.404609:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef44fb6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521460.404710:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222488064 00000100:00100000:2.0:1788521460.404716:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222488064 00000100:00100000:2.0:1788521460.404739:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788521460.404746:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+8:17178:x1875400222488064:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521460.405237:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+9:17178:x1875400222488064:12345-0@lo:501:mount.lustre.0 Request processed in 488us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521460.405246:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788521460.405315:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222488064:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788521460.405353:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222488192:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788521460.405398:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521460.405422:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef44fb6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521460.405463:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222488192 00000100:00100000:0.0:1788521460.405473:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222488192 00000100:00100000:0.0:1788521460.405531:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788521460.405558:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+9:17178:x1875400222488192:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788521460.408308:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+9:17178:x1875400222488192:12345-0@lo:503:mount.lustre.0 Request processed in 2743us (2899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521460.408323:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788521460.408594:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222488192:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788521460.410109:0:17218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17218:1875400222488320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521460.410291:0:17218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521460.410337:0:17218:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef44fb6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521460.410395:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222488320 00000100:00100000:3.0:1788521460.410402:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222488320 00000100:00100000:3.0:1788521460.410440:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788521460.410449:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+9:17218:x1875400222488320:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521460.411719:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+9:17218:x1875400222488320:12345-0@lo:502:llog_process_th.0 Request processed in 1265us (1423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521460.411739:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788521460.413406:0:17218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17218:1875400222488320:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788521460.413561:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788521460.413574:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521460.413576:0:17218:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788521460.413581:0:17218:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788521460.413585:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788521460.413600:0:17218:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8fef4e7819c0) 00000020:00000080:1.0:1788521460.413617:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788521460.413622:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788521460.413704:0:17218:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788521460.413732:0:17218:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x411dd0ee4d2d23d6 00000020:00000080:1.0:1788521460.414031:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788521460.414036:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788521460.414039:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521460.414041:0:17218:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788521460.414044:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788521460.414047:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521460.414048:0:17218:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788521460.414052:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788521460.414059:0:17218:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8fef4e784d40) 00000020:00000080:1.0:1788521460.414068:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788521460.414072:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788521460.414074:0:17218:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788521460.414077:0:17218:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788521460.414082:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788521460.414123:0:17218:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fef48513800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788521460.414144:0:17218:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8fef7ef53380) 00000020:00000080:1.0:1788521460.414153:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788521460.414216:0:17218:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788521460.414222:0:17218:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x411dd0ee4d2d23eb 00000020:00000080:1.0:1788521460.414389:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788521460.414397:0:17218:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788521460.414407:0:17218:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x411dd0ee4d2d23f2 00080000:01000000:1.0:1788521460.414412:0:17218:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788521460.414415:0:17218:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x411dd0ee4d2d23f9 00010000:00010000:0.0:1788521460.474024:0:17218:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788521460.474506:0:17218:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:0.0:1788521460.474777:0:17218:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788521460.475406:0:17218:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8fee4213b380) 00000020:00000080:0.0:1788521460.475425:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788521460.475505:0:17218:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788521460.475512:0:17218:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x411dd0ee4d2d2407 00000020:00000080:1.0:1788521460.476070:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788521460.478384:0:17218:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x411dd0ee4d2d240e 00000020:00000080:1.0:1788521460.479103:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788521460.479118:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788521460.479126:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521460.479129:0:17218:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788521460.479134:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788521460.479138:0:17218:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788521460.479142:0:17218:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788521460.479143:0:17218:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788521460.479145:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788521460.479149:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521460.479151:0:17218:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788521460.479154:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788521460.479161:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521460.479162:0:17218:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788521460.479169:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788521460.479221:0:17218:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788521460.479243:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788521460.479248:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521460.479250:0:17218:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788521460.479254:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788521460.479258:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521460.479260:0:17218:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788521460.479264:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788521460.479272:0:17218:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.141@tcp to nid 0x20000c0a8cb8d (192.168.203.141@tcp) 00000020:00000080:1.0:1788521460.479319:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788521460.479334:0:17218:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8fef7ef54d40) 00000020:00000080:1.0:1788521460.479348:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788521460.479352:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788521460.479415:0:17218:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788521460.479420:0:17218:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788521460.479427:0:17218:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x411dd0ee4d2d241c 00010000:00080000:1.0:1788521460.479473:0:17218:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fef81475000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.141@tcp at head 00010000:00010000:1.0:1788521460.481477:0:17218:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1788521460.490110:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788521460.490127:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788521460.490168:0:17218:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788521460.490187:0:17218:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x411dd0ee4d2d2423 00000100:00080000:2.0:1788521460.490198:0:17218:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788521460.490204:0:17218:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8fef81475000 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:2.0:1788521460.490235:0:17218:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee43598000 x1875400222488448/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788521460.490273:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222488448:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788521460.490353:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788521460.490404:0:17218:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1788521460.490468:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521460.490472:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521460.490474:0:17218:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788521460.490477:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788521460.490480:0:17218:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1788521460.490481:0:17218:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788521460.490483:0:17218:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788521460.490491:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788521460.490494:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521460.490496:0:17218:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788521460.490499:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788521460.490504:0:17218:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788521460.490507:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521460.490509:0:17218:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788521460.490512:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788521460.490516:0:17218:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.141@tcp to nid 0x20000c0a8cb8d (192.168.203.141@tcp) 00000020:01000000:2.0:1788521460.490549:0:17218:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788521460.490553:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788521460.490564:0:17218:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8fef7efe99c0) 00000020:00000080:2.0:1788521460.490575:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788521460.490580:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788521460.490636:0:17218:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788521460.490642:0:17218:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788521460.490648:0:17218:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x411dd0ee4d2d2431 00010000:00080000:2.0:1788521460.490674:0:17218:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fef48537800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.141@tcp at head 00010000:00010000:2.0:1788521460.492278:0:17218:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1788521460.492963:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222488448 00000100:00100000:1.0:1788521460.492974:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222488448 00000100:00100000:1.0:1788521460.493018:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788521460.493027:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1875400222488448:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1788521460.493045:0:17204:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:3.0:1788521460.505647:0:17218:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788521460.506146:0:17218:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788521460.508174:0:17218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788521460.508794:0:17218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788521460.514495:0:17218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788521460.523261:0:17224:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788521460.523270:0:17224:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1788521460.525054:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1875400222488448:12345-0@lo:38:llog_process_th.0 Request processed in 32017us (34691us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788521460.525074:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788521460.525186:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef81475000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788521460.525192:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788521460.525196:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43598000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222488448:0@lo:38:llog_process_th.0 00000020:00000080:2.0:1788521460.525780:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788521460.525792:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788521460.525839:0:17218:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788521460.525866:0:17218:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x411dd0ee4d2d2438 00000100:00080000:2.0:1788521460.525876:0:17218:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788521460.526121:0:17218:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8fef48537800 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:2.0:1788521460.526170:0:17218:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee43599880 x1875400222488576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788521460.526264:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222488576:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788521460.526389:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875400222488576 offset 0 length 520: 4 00000100:00080000:2.0:1788521460.526433:0:17218:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788521460.526495:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521460.526499:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521460.526507:0:17218:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788521460.526511:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788521460.526514:0:17218:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1788521460.526516:0:17218:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788521460.526517:0:17218:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788521460.526519:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788521460.526521:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521460.526523:0:17218:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788521460.526525:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788521460.526529:0:17218:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788521460.526542:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521460.526544:0:17218:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788521460.526548:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788521460.526551:0:17218:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.141@tcp to nid 0x20000c0a8cb8d (192.168.203.141@tcp) 00000020:01000000:2.0:1788521460.526571:0:17218:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788521460.526573:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788521460.526586:0:17218:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8fef7efeb380) 00000020:00000080:2.0:1788521460.526598:0:17218:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1788521460.526603:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788521460.526664:0:17218:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788521460.526670:0:17218:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788521460.526676:0:17218:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x411dd0ee4d2d2446 00010000:00080000:2.0:1788521460.526701:0:17218:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fef81580800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.141@tcp at head 00010000:00010000:2.0:1788521460.526919:0:17218:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788521460.526982:0:17218:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788521460.526994:0:17218:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788521460.528739:0:17218:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788521460.529067:0:17218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788521460.529209:0:17218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1788521460.530099:0:17226:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788521460.530108:0:17226:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788521460.531245:0:17218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788521460.531258:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788521460.531354:0:17218:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788521460.531377:0:17218:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x411dd0ee4d2d244d 00000100:00080000:2.0:1788521460.531396:0:17218:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788521460.531405:0:17218:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8fef81580800 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:2.0:1788521460.531458:0:17218:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee4359b480 x1875400222488704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788521460.531572:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4359b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222488704:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788521460.531645:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875400222488704 offset 0 length 520: 4 00000100:00080000:2.0:1788521460.531718:0:17218:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788521460.531818:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521460.531825:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521460.531828:0:17218:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788521460.531832:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521460.531838:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521460.531840:0:17218:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788521460.531844:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788521460.531847:0:17218:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788521460.531850:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521460.531853:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521460.531855:0:17218:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788521460.531859:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521460.531862:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521460.531864:0:17218:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788521460.531870:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788521460.531952:0:17218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4359ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17218:1875400222488832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521460.532024:0:17218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521460.532052:0:17218:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef5240f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788521460.532380:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222488832 00000100:00100000:0.0:1788521460.532393:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222488832 00000100:00100000:0.0:1788521460.532438:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788521460.532446:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+9:17218:x1875400222488832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521460.532567:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+9:17218:x1875400222488832:12345-0@lo:502:llog_process_th.0 Request processed in 120us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521460.532575:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788521460.532668:0:17218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4359ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17218:1875400222488832:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788521460.532691:0:17218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521460.532695:0:17218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521460.532697:0:17218:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788521460.532700:0:17218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788521460.532999:0:17178:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1788521460.533018:0:17178:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788521460.533102:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434aba00/0x411dd0ee4d2d23c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d23c8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.533113:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fee434aba00/0x411dd0ee4d2d23c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d23c8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521460.533121:0:17178:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fef48513800 from 1 10000000:01000000:1.0:1788521460.533124:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788521460.533150:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434abe00/0x411dd0ee4d2d2454 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.533157:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fee434abe00/0x411dd0ee4d2d2454 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.533166:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fee434abe00/0x411dd0ee4d2d2454 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521460.533181:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222488960:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788521460.533218:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521460.533247:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef50861f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788521460.533286:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222488960 00000100:00100000:2.0:1788521460.533290:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222488960 00000100:00100000:2.0:1788521460.533331:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788521460.533337:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+9:17178:x1875400222488960:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521460.533347:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521460.533359:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef4167fa00/0x411dd0ee4d2d245b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d2454 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521460.533377:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef4167fa00/0x411dd0ee4d2d245b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2454 expref: 10 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521460.533387:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef4167fa00/0x411dd0ee4d2d245b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2454 expref: 10 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521460.533395:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef4167fa00, rc 0) 00000100:00100000:2.0:1788521460.533428:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+10:17178:x1875400222488960:12345-0@lo:101:mount.lustre.0 Request processed in 91us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521460.533434:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788521460.533546:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222488960:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788521460.533557:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fee434abe00/0x411dd0ee4d2d2454 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d245b expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.533567:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fee434abe00/0x411dd0ee4d2d2454 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d245b expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521460.534053:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222489088:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788521460.534086:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521460.534107:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef50861f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788521460.534158:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222489088 00000100:00100000:0.0:1788521460.534163:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222489088 00000100:00100000:0.0:1788521460.534195:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788521460.534202:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+10:17178:x1875400222489088:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788521460.534215:0:17192:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788521460.534221:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788521460.534274:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+10:17178:x1875400222489088:12345-0@lo:256:mount.lustre.0 Request processed in 73us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521460.534281:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788521460.534399:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222489088:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788521460.534914:0:17178:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788521460.535107:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434abe00/0x411dd0ee4d2d2454 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d245b expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.535117:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fee434abe00/0x411dd0ee4d2d2454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d245b expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521460.535170:0:17178:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fef48513800 from 1 10000000:01000000:0.0:1788521460.535174:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788521460.535200:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d800/0x411dd0ee4d2d2462 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521460.535207:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d800/0x411dd0ee4d2d2462 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521460.535215:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d800/0x411dd0ee4d2d2462 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521460.535229:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222489216:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788521460.535257:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521460.535293:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4e6cc000 going to sleep for 11 seconds 00000100:00100000:1.0:1788521460.535393:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222489216 00000100:00100000:1.0:1788521460.535399:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222489216 00000100:00100000:1.0:1788521460.535431:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788521460.535438:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+10:17178:x1875400222489216:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788521460.535447:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521460.535458:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fee434abc00/0x411dd0ee4d2d2469 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d2462 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.535484:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fee434abc00/0x411dd0ee4d2d2469 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2462 expref: 11 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.535493:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fee434abc00/0x411dd0ee4d2d2469 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2462 expref: 11 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.535500:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434abc00, rc 0) 00000100:00100000:1.0:1788521460.535546:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+11:17178:x1875400222489216:12345-0@lo:101:mount.lustre.0 Request processed in 108us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521460.535552:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788521460.535678:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222489216:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788521460.535696:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d800/0x411dd0ee4d2d2462 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2469 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521460.535706:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d800/0x411dd0ee4d2d2462 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d2469 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521460.535797:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222489344:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788521460.535839:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521460.535875:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4e6cc000 going to sleep for 11 seconds 00000100:00100000:2.0:1788521460.536019:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222489344 00000100:00100000:2.0:1788521460.536026:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222489344 00000100:00100000:2.0:1788521460.536075:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788521460.536085:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+11:17178:x1875400222489344:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521460.536260:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+11:17178:x1875400222489344:12345-0@lo:501:mount.lustre.0 Request processed in 175us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521460.536270:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788521460.536505:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222489344:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788521460.536551:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222489472:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788521460.536593:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521460.536621:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4e6cc000 going to sleep for 11 seconds 00000100:00100000:2.0:1788521460.536663:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222489472 00000100:00100000:2.0:1788521460.536667:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222489472 00000100:00100000:2.0:1788521460.536698:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788521460.536705:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+11:17178:x1875400222489472:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788521460.536781:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+11:17178:x1875400222489472:12345-0@lo:503:mount.lustre.0 Request processed in 76us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521460.536793:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788521460.536860:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222489472:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788521460.538389:0:17228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17228:1875400222489600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521460.538476:0:17228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521460.538574:0:17228:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4e6cc000 going to sleep for 11 seconds 00000100:00100000:1.0:1788521460.538638:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222489600 00000100:00100000:1.0:1788521460.538647:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222489600 00000100:00100000:1.0:1788521460.538756:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788521460.538770:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+11:17228:x1875400222489600:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521460.539420:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+11:17228:x1875400222489600:12345-0@lo:502:llog_process_th.0 Request processed in 654us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521460.539429:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788521460.539525:0:17228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17228:1875400222489600:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788521460.539565:0:17228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521460.539575:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521460.539577:0:17228:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788521460.539584:0:17228:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fef48513800 00000020:00000080:0.0:1788521460.539587:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788521460.539594:0:17228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521460.539602:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521460.539604:0:17228:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788521460.539606:0:17228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521460.539609:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521460.539610:0:17228:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788521460.539613:0:17228:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fef48513800 00000020:00000080:0.0:1788521460.539616:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788521460.539672:0:17228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521460.539676:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521460.539677:0:17228:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788521460.539680:0:17228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521460.539682:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521460.539684:0:17228:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788521460.539688:0:17228:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fef48513800 00000020:00000080:0.0:1788521460.539690:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788521460.539705:0:17228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521460.539707:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521460.539709:0:17228:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788521460.539711:0:17228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521460.539713:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521460.539715:0:17228:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788521460.539718:0:17228:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fef48513800 00000020:00000080:0.0:1788521460.539720:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788521460.539759:0:17228:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d20380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17228:1875400222489728:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521460.539796:0:17228:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521460.544543:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222489728 00000100:00100000:2.0:1788521460.544561:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222489728 00000100:00100000:2.0:1788521460.544620:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788521460.544635:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+11:17228:x1875400222489728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521460.544812:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+11:17228:x1875400222489728:12345-0@lo:502:llog_process_th.0 Request processed in 180us (5014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521460.544824:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788521460.549473:0:17228:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4e6cc000 going to sleep for 11 seconds 00000100:00100000:0.0:1788521460.549523:0:17228:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d20380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17228:1875400222489728:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788521460.549587:0:17228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521460.549602:0:17228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521460.549607:0:17228:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788521460.549615:0:17228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788521460.549730:0:17178:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788521460.549760:0:17178:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788521460.549782:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d800/0x411dd0ee4d2d2462 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2469 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521460.549794:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d800/0x411dd0ee4d2d2462 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2469 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521460.549864:0:17178:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788521460.549869:0:17178:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8fef48513800 10000000:01000000:0.0:1788521460.549874:0:17178:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8fef48513800 10000000:01000000:0.0:1788521460.549880:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788521460.549913:0:17178:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fef48513800 from 1 10000000:01000000:0.0:1788521460.549917:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788521460.549957:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d200/0x411dd0ee4d2d2470 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521460.549968:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d200/0x411dd0ee4d2d2470 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521460.549979:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d200/0x411dd0ee4d2d2470 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521460.550005:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222489856:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788521460.550082:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521460.550126:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4e6cc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521460.551133:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222489856 00000100:00100000:2.0:1788521460.551145:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222489856 00000100:00100000:2.0:1788521460.552953:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788521460.552969:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+11:17178:x1875400222489856:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521460.552987:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521460.553004:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef4167ee00/0x411dd0ee4d2d2477 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d2470 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521460.553031:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef4167ee00/0x411dd0ee4d2d2477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2470 expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521460.553041:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef4167ee00/0x411dd0ee4d2d2477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2470 expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521460.553050:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef4167ee00, rc 0) 00000100:00100000:2.0:1788521460.553125:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+12:17178:x1875400222489856:12345-0@lo:101:mount.lustre.0 Request processed in 162us (3045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521460.553132:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788521460.556759:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222489856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788521460.556794:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d200/0x411dd0ee4d2d2470 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2477 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521460.556810:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d200/0x411dd0ee4d2d2470 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d2477 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521460.556971:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222489984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788521460.557055:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521460.561508:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4810fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521460.561635:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222489984 00000100:00100000:1.0:1788521460.561645:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222489984 00000100:00100000:1.0:1788521460.561710:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788521460.561719:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+12:17178:x1875400222489984:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788521460.561994:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222489984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788521460.562042:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222490112:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788521460.562094:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521460.562107:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4810fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521460.562159:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+12:17178:x1875400222489984:12345-0@lo:501:mount.lustre.0 Request processed in 441us (5105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521460.562167:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788521460.562193:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222490112 00000100:00100000:1.0:1788521460.562196:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222490112 00000100:00100000:1.0:1788521460.562217:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788521460.562222:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+12:17178:x1875400222490112:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788521460.562434:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+12:17178:x1875400222490112:12345-0@lo:503:mount.lustre.0 Request processed in 211us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521460.562441:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788521460.568564:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222490112:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788521460.571242:0:17233:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d20e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17233:1875400222490240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521460.571425:0:17233:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521460.571463:0:17233:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4e6ccb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788521460.571543:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222490240 00000100:00100000:1.0:1788521460.571550:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222490240 00000100:00100000:1.0:1788521460.571594:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788521460.571603:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+12:17233:x1875400222490240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521460.571721:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+12:17233:x1875400222490240:12345-0@lo:502:llog_process_th.0 Request processed in 118us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521460.571729:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788521460.571838:0:17233:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d20e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17233:1875400222490240:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788521460.572062:0:17233:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788521460.572076:0:17233:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8fee4213cd40) 00000020:00000080:0.0:1788521460.572093:0:17233:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1788521460.572164:0:17233:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fef48513800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788521460.572169:0:17233:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fef48513800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788521460.572171:0:17233:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fef48513800 4 00010000:00080000:0.0:1788521460.572197:0:17233:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fef71bc4000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.141@tcp at head 00010000:00010000:0.0:1788521460.584527:0:17233:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1788521460.584765:0:17233:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788521460.584814:0:17233:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788521460.584827:0:17233:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x411dd0ee4d2d2485 00000100:00080000:0.0:1788521460.584838:0:17233:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788521460.584845:0:17233:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8fef71bc4000 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:0.0:1788521460.585104:0:17233:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee43d20e00 x1875400222490368/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788521460.585132:0:17233:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788521460.586797:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875400222490368:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788521460.586905:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521460.587146:0:17233:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d22300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17233:1875400222490496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521460.587192:0:17233:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521460.587218:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222490496 00000100:00100000:0.0:1788521460.587225:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222490496 00000100:00100000:0.0:1788521460.587265:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788521460.587274:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+12:17233:x1875400222490496:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521460.587395:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+12:17233:x1875400222490496:12345-0@lo:502:llog_process_th.0 Request processed in 121us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521460.587403:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788521460.587443:0:17233:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4e6ccd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521460.587461:0:17233:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d22300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17233:1875400222490496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521460.587501:0:17233:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d22300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17233:1875400222490624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521460.587528:0:17233:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521460.587561:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222490624 00000100:00100000:0.0:1788521460.587565:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222490624 00000100:00100000:0.0:1788521460.587586:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788521460.587592:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+12:17233:x1875400222490624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521460.587650:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+12:17233:x1875400222490624:12345-0@lo:502:llog_process_th.0 Request processed in 58us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521460.587657:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788521460.587683:0:17233:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4e6ccd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521460.587695:0:17233:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d22300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17233:1875400222490624:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788521460.587713:0:17233:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000100:00100000:3.0:1788521460.588047:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222490368 00000100:00100000:3.0:1788521460.588053:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222490368 00000100:00100000:3.0:1788521460.588072:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788521460.588077:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875400222490368:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788521460.588123:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875400222490368:12345-0@lo:38:llog_process_th.0 Request processed in 45us (1248us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788521460.588130:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788521460.588160:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788521460.588167:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef71bc4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788521460.588171:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788521460.588174:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875400222490368:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1788521460.588195:0:17178:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788521460.588214:0:17178:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788521460.588231:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d200/0x411dd0ee4d2d2470 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2477 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521460.588245:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d200/0x411dd0ee4d2d2470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2477 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788521460.588553:0:17178:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788521460.588555:0:17178:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788521460.588557:0:17178:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788521460.588558:0:17178:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788521460.588559:0:17178:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788521460.588560:0:17178:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788521460.588567:0:17178:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788521460.588568:0:17178:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788521460.588570:0:17178:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788521460.588572:0:17178:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788521460.588576:0:17178:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788521460.588580:0:17178:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788521460.588582:0:17178:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788521460.588583:0:17178:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788521460.588584:0:17178:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788521460.588585:0:17178:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788521460.588587:0:17178:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788521460.588587:0:17178:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788521460.588589:0:17178:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788521460.588590:0:17178:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788521460.588591:0:17178:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788521460.588615:0:17178:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788521460.588634:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222490752:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788521460.588687:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521460.588774:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4810fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521460.589919:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222490752 00000100:00100000:0.0:1788521460.589927:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222490752 00000100:00100000:0.0:1788521460.589965:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788521460.589972:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+12:17178:x1875400222490752:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788521460.589997:0:17192:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788521460.590009:0:17192:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788521460.592603:0:17192:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788521460.592622:0:17192:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788521460.592840:0:17216:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788521460.592846:0:17216:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788521460.592867:0:17216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fee434aaa00/0x411dd0ee4d2d248c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.592908:0:17216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef4167fa00/0x411dd0ee4d2d245b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2454 expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.592919:0:17216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fee434aaa00/0x411dd0ee4d2d248c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.592961:0:17216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef4167fa00/0x411dd0ee4d2d245b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d2454 expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.592976:0:17216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fef4167fa00/0x411dd0ee4d2d245b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2454 expref: 12 pid: 17194 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521460.593006:0:17216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1875400222490880:0@lo:104: 00000100:00100000:1.0:1788521460.593065:0:17216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521460.593103:0:17216:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef484e56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521460.593271:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+12:17178:x1875400222490752:12345-0@lo:253:mount.lustre.0 Request processed in 3298us (4583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521460.593282:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788521460.593349:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17178:1875400222490752:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788521460.593360:0:17178:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788521460.593363:0:17178:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788521460.593365:0:17178:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788521460.593367:0:17178:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788521460.593368:0:17178:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788521460.593369:0:17178:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788521460.593371:0:17178:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788521460.593372:0:17178:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788521460.593374:0:17178:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788521460.593375:0:17178:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788521460.593377:0:17178:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788521460.593395:0:17178:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788521460.603838:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222490880 00000100:00100000:0.0:1788521460.603860:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222490880 00000100:00100000:0.0:1788521460.604023:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788521460.604037:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+3:17216:x1875400222490880:12345-0@lo:104: 00010000:00010000:0.0:1788521460.604061:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fee434abe00/0x411dd0ee4d2d2454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d245b expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521460.604183:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788521460.604215:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+3:17216:x1875400222490880:12345-0@lo:104: Request processed in 180us (11146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521460.604227:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788521460.604263:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521460.604274:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fee434abe00/0x411dd0ee4d2d2454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d245b expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521460.604285:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434abe00 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:0.0:1788521460.604292:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fee434abe00/0x411dd0ee4d2d2454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d245b expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521460.604305:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fee434abe00/0x411dd0ee4d2d2454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d245b expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521460.604318:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fee434abe00/0x411dd0ee4d2d2454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d245b expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521460.604329:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521460.604390:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fee434abe00/0x411dd0ee4d2d2454 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d245b expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521460.604399:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521460.604429:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fee434abe00/0x411dd0ee4d2d2454 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d245b expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521460.604440:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fee434abe00/0x411dd0ee4d2d2454 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d245b expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521460.604460:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521460.604463:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521460.604466:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521460.604520:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3644:1875400222491008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521460.604576:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521460.606072:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222491008 00000100:00100000:1.0:1788521460.606085:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222491008 00010000:00010000:1.0:1788521460.606123:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef4167fa00/0x411dd0ee4d2d245b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2454 expref: 12 pid: 17194 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521460.606175:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788521460.606184:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+12:3644:x1875400222491008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788521460.606199:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521460.606206:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef4167fa00/0x411dd0ee4d2d245b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2454 expref: 12 pid: 17194 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.606219:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef4167fa00/0x411dd0ee4d2d245b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2454 expref: 12 pid: 17194 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.606240:0:17184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fee434aaa00/0x411dd0ee4d2d248c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.606250:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fee434aaa00/0x411dd0ee4d2d248c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788521460.606267:0:17184:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013421358s 00010000:00010000:1.0:1788521460.606272:0:17184:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fee434aaa00/0x411dd0ee4d2d248c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.606280:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fee434aaa00/0x411dd0ee4d2d248c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.606405:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fee434aaa00/0x411dd0ee4d2d248c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.606413:0:17184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fee434aaa00/0x411dd0ee4d2d248c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.606420:0:17184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aaa00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:1.0:1788521460.606424:0:17184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fee434aaa00/0x411dd0ee4d2d248c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.606433:0:17184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fee434aaa00/0x411dd0ee4d2d248c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.606444:0:17184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fee434aaa00/0x411dd0ee4d2d248c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.606457:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521460.608051:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+12:3644:x1875400222491008:12345-0@lo:103:ldlm_bl.0 Request processed in 1861us (3467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521460.608062:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788521460.608123:0:17216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef4167fa00/0x411dd0ee4d2d245b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d2454 expref: 11 pid: 17194 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521460.608139:0:17216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1875400222490880:0@lo:104: 00010000:00010000:1.0:1788521460.608160:0:17216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fee434aaa00/0x411dd0ee4d2d248c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.608170:0:17216:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fee434aaa00/0x411dd0ee4d2d248c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.608194:0:17216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fee434aaa00/0x411dd0ee4d2d248c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521460.608201:0:17216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fee434aaa00/0x411dd0ee4d2d248c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521460.609571:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3644:1875400222491008:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788521460.629312:0:17178:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788521460.636847:0:17178:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788521460.636997:0:17239:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1788521460.637004:0:17239:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788521460.644880:0:17240:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788521460.645029:0:17178:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:0.0:1788521460.654747:0:17241:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8fee43d22300 x1875400222491136/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521460.654761:0:17241:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef43200300 going to sleep for 0 seconds 00000040:00080000:2.0:1788521460.654994:0:17240:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1788521460.656190:0:17178:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788521460.656239:0:17178:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788521460.656682:0:17178:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788521460.656689:0:17178:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788521460.656720:0:17178:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788521460.660011:0:17240:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788521460.660094:0:17240:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1788521460.661262:0:17178:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788521460.662429:0:17178:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788521460.662500:0:17178:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1788521460.668180:0:17178:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:3.0:1788521460.670396:0:17178:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788521460.673839:0:17178:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788521460.673993:0:17178:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa9e34191b988 00100000:10000000:3.0:1788521460.674005:0:17178:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788521460.675673:0:17178:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788521460.675689:0:17178:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.141@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788521460.675703:0:17178:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788521460.675726:0:17178:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788521460.676420:0:17178:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788521460.676614:0:17178:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788521461.202995:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788521461.646132:0:17234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788521461.709106:0:17241:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef43200300 going to sleep for 0 seconds 10000000:01000000:0.0:1788521461.903727:0:17196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788521461.903810:0:17196:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fef48513800 from 7 10000000:01000000:0.0:1788521461.903815:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788521461.903859:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d600/0x411dd0ee4d2d2493 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521461.903872:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d600/0x411dd0ee4d2d2493 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521461.903897:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d600/0x411dd0ee4d2d2493 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521461.903925:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222491264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788521461.903997:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521461.904196:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef432003c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521461.908099:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222491264 00000100:00100000:1.0:1788521461.908112:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222491264 00000100:00100000:1.0:1788521461.908191:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788521461.908201:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+11:17196:x1875400222491264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521461.908215:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521461.908231:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fee434ab800/0x411dd0ee4d2d249a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d2493 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521461.908258:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fee434ab800/0x411dd0ee4d2d249a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2493 expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521461.908279:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fee434ab800/0x411dd0ee4d2d249a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2493 expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521461.908288:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434ab800, rc 0) 00000100:00100000:1.0:1788521461.908358:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+12:17196:x1875400222491264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (4360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521461.908365:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788521461.908433:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222491264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521461.908458:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d600/0x411dd0ee4d2d2493 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d249a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521461.908467:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d600/0x411dd0ee4d2d2493 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d249a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521461.908534:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222491392:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788521461.908571:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521461.908735:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef484e5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521461.908801:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222491392 00000100:00100000:2.0:1788521461.908808:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222491392 00000100:00100000:2.0:1788521461.908847:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788521461.908856:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+12:17196:x1875400222491392:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788521461.908873:0:17192:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788521461.908910:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788521461.908914:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788521461.908999:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+12:17196:x1875400222491392:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 143us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521461.909006:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788521461.909161:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222491392:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788521461.909204:0:17196:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788521461.909212:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d600/0x411dd0ee4d2d2493 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d249a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521461.909222:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d600/0x411dd0ee4d2d2493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d249a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521462.221141:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788521462.669494:0:17234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788521462.732972:0:17241:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef43200300 going to sleep for 0 seconds 00010000:00010000:3.0:1788521463.247778:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521463.758040:0:17241:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef43200300 going to sleep for 0 seconds 00010000:00010000:0.0:1788521464.273704:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788521464.759793:0:17483:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg341-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788521464.780994:0:17241:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef43200300 going to sleep for 0 seconds 00010000:00010000:3.0:1788521465.293983:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788521465.716465:0:17535:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788521465.716653:0:17535:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788521465.804977:0:17241:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef43200300 going to sleep for 0 seconds 00000100:00080000:3.0:1788521466.001586:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788521466.001595:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788521466.001600:0:37:0:(import.c:65:import_set_state_nolock()) ffff8fef81475000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788521466.001610:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 510 00000100:00080000:3.0:1788521466.001616:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788521466.001634:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8fef81475000 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:3.0:1788521466.001663:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fef7f0ca300 x1875400222491648/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788521466.003078:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788521466.003083:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788521466.003086:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788521466.003090:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788521466.003093:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788521466.003097:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788521466.003100:0:37:0:(import.c:65:import_set_state_nolock()) ffff8fef71bc4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788521466.003112:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8fef71bc4000 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:3.0:1788521466.003149:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fef7f0c8e00 x1875400222491776/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788521466.003280:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222491648:0@lo:38:kworker.0 00000100:00100000:3.0:1788521466.003520:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521466.003621:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875400222491776:0@lo:38:kworker.0 00000100:00100000:3.0:1788521466.003683:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521466.004043:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222491648 00000100:00100000:3.0:1788521466.004051:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222491648 00000100:00100000:3.0:1788521466.004083:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788521466.004091:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1875400222491648:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788521466.004110:0:17205:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788521466.004821:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3645:1875400222491520:0@lo:400:kworker.0 00000100:00100000:0.0:1788521466.005016:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521466.005250:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222491776 00000100:00100000:2.0:1788521466.005273:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222491776 00000100:00100000:2.0:1788521466.005318:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788521466.005326:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875400222491776:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788521466.005360:0:17201:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:2.0:1788521466.005408:0:17201:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x411dd0ee4d2d24a1 00000004:00100000:2.0:1788521466.005429:0:17201:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788521466.005622:0:17201:0:(import.c:65:import_set_state_nolock()) ffff8fef81585800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788521466.006115:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875400222491776:12345-0@lo:38:kworker.0 Request processed in 787us (2430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521466.006145:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788521466.006183:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222491520 00000100:00100000:2.0:1788521466.006188:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222491520 00000100:00100000:2.0:1788521466.006225:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788521466.006231:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+12:3645:x1875400222491520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521466.006270:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+12:3645:x1875400222491520:12345-0@lo:400:kworker.0 Request processed in 40us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521466.006278:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788521466.008911:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3645:1875400222491520:0@lo:400:kworker.0 00010000:00080000:0.0:1788521466.008977:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8fef7f0c8e00 x1875400222491776/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788521476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788521466.008994:0:3642:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788521466.009002:0:3642:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788521466.009008:0:3642:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788521466.009011:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef71bc4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788521466.009017:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875400222491776:0@lo:38:kworker.0 00000100:00100000:3.0:1788521466.012026:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1875400222491648:12345-0@lo:38:kworker.0 Request processed in 7921us (8500us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788521466.012046:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788521466.012119:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef81475000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788521466.012133:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788521466.012139:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222491648:0@lo:38:kworker.0 00010000:00010000:0.0:1788521466.317488:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521466.840611:0:17241:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef43200300 going to sleep for 0 seconds 00000020:00000004:1.0:1788521466.843090:0:17585:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788521466.843600:0:17585:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788521467.343997:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521467.854038:0:17241:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef43200300 going to sleep for 0 seconds 00010000:00010000:2.0:1788521468.366461:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521468.877134:0:17241:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef43200300 going to sleep for 0 seconds 00010000:00010000:1.0:1788521469.389297:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521469.901224:0:17241:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef43200300 going to sleep for 0 seconds 00000100:00100000:2.0:1788521470.092945:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788521460/real 1788521460] req@ffff8fee4359b480 x1875400222488704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521470 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521470.092974:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fee4359b480 x1875400222488704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521470 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521470.092984:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788521460/real 1788521460] req@ffff8fee43599880 x1875400222488576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521470 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521470.092995:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fee43599880 x1875400222488576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521470 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788521470.093013:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef81580800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788521470.093036:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788521470.093040:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4359b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222488704:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788521470.093046:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef48537800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788521470.093051:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788521470.093054:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222488576:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788521470.095815:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788521470.095821:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788521470.095825:0:8:0:(import.c:65:import_set_state_nolock()) ffff8fef81475000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788521470.095832:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 516 00000100:00080000:0.0:1788521470.095838:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788521470.095845:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8fef81475000 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:0.0:1788521470.095866:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee43d23800 x1875400222492032/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788521470.095894:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788521470.095898:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788521470.095900:0:8:0:(import.c:65:import_set_state_nolock()) ffff8fef48537800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788521470.095911:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 510 00000100:00080000:0.0:1788521470.095915:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788521470.095918:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8fef48537800 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:0.0:1788521470.095929:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee43d22d80 x1875400222492160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788521470.095938:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788521470.095940:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788521470.095942:0:8:0:(import.c:65:import_set_state_nolock()) ffff8fef81580800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788521470.095945:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 510 00000100:00080000:0.0:1788521470.095947:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788521470.095950:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8fef81580800 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:0.0:1788521470.095958:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee43d23100 x1875400222492288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788521470.096006:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521470.096019:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3645:1875400222491904:0@lo:400:kworker.0 00000100:00100000:0.0:1788521470.096080:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521470.096127:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222492032:0@lo:38:kworker.0 00000100:00100000:0.0:1788521470.096156:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521470.096172:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222492160:0@lo:8:kworker.0 00000400:00000100:0.0:1788521470.096190:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875400222492160 offset 0 length 520: 4 00000100:00100000:0.0:1788521470.096200:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222492288:0@lo:8:kworker.0 00000400:00000100:0.0:1788521470.096215:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875400222492288 offset 0 length 520: 4 00000100:00100000:0.0:1788521470.096232:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222492416:0@lo:400:kworker.0 00000100:00100000:0.0:1788521470.096254:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521470.096291:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222491904 00000100:00100000:0.0:1788521470.096299:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222491904 00000100:00100000:0.0:1788521470.096341:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788521470.096350:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+12:3645:x1875400222491904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521470.096398:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+12:3645:x1875400222491904:12345-0@lo:400:kworker.0 Request processed in 48us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521470.096405:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788521470.096435:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222492032 00000100:00100000:0.0:1788521470.096438:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222492032 00000100:00100000:0.0:1788521470.096456:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521470.096461:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1875400222492032:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788521470.096487:0:17204:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788521470.101007:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222492416 00000100:00100000:3.0:1788521470.101029:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222492416 00000100:00100000:3.0:1788521470.101081:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788521470.101090:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222492416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521470.101177:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222492416:12345-0@lo:400:kworker.0 Request processed in 88us (4921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521470.101184:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788521470.101225:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8fee43d20a80 x1875400222492416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521470.101275:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222492416:0@lo:400:kworker.0 00000100:00100000:0.0:1788521470.117780:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1875400222492032:12345-0@lo:38:kworker.0 Request processed in 21310us (21615us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788521470.117794:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521470.117846:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3645:1875400222491904:0@lo:400:kworker.0 00000100:00080000:1.0:1788521470.119425:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef81475000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788521470.119434:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788521470.119447:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222492032:0@lo:38:kworker.0 00010000:00010000:2.0:1788521470.416550:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521470.925496:0:17241:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef43200300 going to sleep for 0 seconds 00010000:00010000:1.0:1788521471.445553:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521471.949578:0:17241:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef43200300 going to sleep for 0 seconds 00010000:00010000:2.0:1788521472.462163:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788521472.912085:0:17234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788521472.973234:0:17241:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef43200300 going to sleep for 0 seconds 00010000:00010000:1.0:1788521473.489019:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521474.001044:0:17241:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef43200300 going to sleep for 0 seconds 00000020:01000004:1.0:1788521474.500040:0:17930:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788521474.500044:0:17930:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788521474.500045:0:17930:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788521474.500149:0:17930:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8fef7a3b2800 00000020:01000004:1.0:1788521474.500164:0:17930:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1788521474.500175:0:17930:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788521474.500189:0:17930:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8fef7ef50000) 00000020:00000080:1.0:1788521474.500209:0:17930:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00010000:00010000:2.0:1788521474.514551:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788521474.558542:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1788521474.560287:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788521474.563010:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788521474.563907:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1788521474.564362:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788521474.564673:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1788521474.564956:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1788521474.565150:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788521474.565392:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788521474.565719:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1788521474.566012:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788521474.566259:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1788521474.566730:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788521474.568922:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788521474.569548:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788521474.569851:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788521474.570191:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1788521474.570643:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1788521474.570938:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788521474.571314:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788521474.571626:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788521474.572057:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788521474.575065:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788521474.575708:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788521474.576043:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1788521474.576334:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788521474.576584:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788521474.576817:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788521474.577084:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788521474.577342:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788521474.577601:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788521474.577848:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788521474.578418:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788521474.579536:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788521474.580746:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788521474.581566:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788521474.581825:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788521474.582211:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788521474.582578:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788521474.583207:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788521474.583555:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788521474.583837:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1788521474.584240:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1788521474.584569:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788521474.584923:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788521474.585446:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1788521474.598362:0:17930:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788521474.598577:0:17930:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788521474.598588:0:17930:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788521474.598599:0:17930:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x411dd0ee4d2d24af 00000020:01000004:3.0:1788521474.598606:0:17930:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788521474.598626:0:17930:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.141@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788521474.598630:0:17930:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788521474.598635:0:17930:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788521474.600661:0:17930:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788521474.600672:0:17930:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.141@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788521474.608909:0:17930:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.141@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788521474.608950:0:17930:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.141@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1788521474.608954:0:17930:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788521474.608956:0:17930:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788521474.608957:0:17930:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521474.608958:0:17930:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521474.608959:0:17930:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521474.608960:0:17930:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521474.608962:0:17930:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788521474.608964:0:17930:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521474.608965:0:17930:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788521474.608969:0:17930:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1788521474.608971:0:17930:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788521474.608972:0:17930:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788521474.608974:0:17930:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521474.608975:0:17930:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521474.608976:0:17930:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521474.608977:0:17930:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521474.608978:0:17930:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788521474.608979:0:17930:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521474.608980:0:17930:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788521474.609018:0:17930:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788521474.609038:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222492544:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788521474.609105:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521474.609218:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee433e43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521474.609356:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222492544 00000100:00100000:0.0:1788521474.609363:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222492544 00000100:00100000:0.0:1788521474.609417:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788521474.609427:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+12:17930:x1875400222492544:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788521474.609480:0:17192:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788521474.609484:0:17192:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1788521474.609490:0:17192:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788521474.609866:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+12:17930:x1875400222492544:12345-0@lo:253:mount.lustre.0 Request processed in 440us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521474.609905:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788521474.610032:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222492544:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788521474.610042:0:17930:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788521474.610050:0:17930:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788521474.610051:0:17930:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788521474.610052:0:17930:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521474.610054:0:17930:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521474.610055:0:17930:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521474.610056:0:17930:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521474.610057:0:17930:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788521474.610059:0:17930:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521474.610060:0:17930:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788521474.610075:0:17930:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8fef7a3b2800 from lustre-MDT0001 10000000:01000000:2.0:1788521474.610100:0:17930:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788521474.610102:0:17930:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788521474.610109:0:17930:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8fee421399c0 local copy 00010000:00010000:2.0:1788521474.610118:0:17930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d23a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d23ac expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521474.610192:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222492672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521474.610241:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521474.610476:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee433e4300 going to sleep for 11 seconds 00000100:00100000:3.0:1788521474.610603:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222492672 00000100:00100000:3.0:1788521474.610609:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222492672 00000100:00100000:3.0:1788521474.610655:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788521474.610663:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+12:17930:x1875400222492672:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788521474.610738:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+12:17930:x1875400222492672:12345-0@lo:501:mount.lustre.0 Request processed in 76us (496us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788521474.610744:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788521474.610860:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222492672:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788521474.610874:0:17930:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788521474.610917:0:17930:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788521474.610923:0:17930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d23a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d23ac expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521474.610933:0:17930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d23a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d23ac expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521474.610957:0:17930:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8fef7a3b2800 10000000:01000000:2.0:1788521474.610962:0:17930:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788521474.610967:0:17930:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8fee421399c0 10000000:01000000:2.0:1788521474.610978:0:17930:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788521474.610981:0:17930:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8fee421399c0 from 1 10000000:01000000:2.0:1788521474.610984:0:17930:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788521474.611009:0:17930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef4167f800/0x411dd0ee4d2d24b6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521474.611019:0:17930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef4167f800/0x411dd0ee4d2d24b6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521474.611027:0:17930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef4167f800/0x411dd0ee4d2d24b6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521474.611042:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222492800:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788521474.611069:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521474.611085:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee433e4300 going to sleep for 11 seconds 00000100:00100000:0.0:1788521474.612571:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222492800 00000100:00100000:0.0:1788521474.612582:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222492800 00000100:00100000:0.0:1788521474.612624:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788521474.612633:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+12:17930:x1875400222492800:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788521474.612658:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521474.612676:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef7f12d400/0x411dd0ee4d2d24bd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d24b6 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.612702:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef7f12d400/0x411dd0ee4d2d24bd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d24b6 expref: 13 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.612713:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef7f12d400/0x411dd0ee4d2d24bd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d24b6 expref: 13 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.612722:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef7f12d400, rc 0) 00000100:00100000:0.0:1788521474.612784:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+13:17930:x1875400222492800:12345-0@lo:101:mount.lustre.0 Request processed in 153us (1714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521474.612791:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788521474.612962:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222492800:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521474.612981:0:17930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef4167f800/0x411dd0ee4d2d24b6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d24bd expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521474.612989:0:17930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef4167f800/0x411dd0ee4d2d24b6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d24bd expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521474.613009:0:17930:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788521474.613021:0:17930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef4167f800/0x411dd0ee4d2d24b6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d24bd expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521474.613029:0:17930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef4167f800/0x411dd0ee4d2d24b6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d24bd expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521474.613039:0:17930:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8fef7a3b2800 10000000:01000000:2.0:1788521474.613055:0:17930:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788521474.613059:0:17930:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8fef7a3b2800 from 1 10000000:01000000:2.0:1788521474.613062:0:17930:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788521474.613084:0:17930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef4167fc00/0x411dd0ee4d2d24c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521474.613091:0:17930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef4167fc00/0x411dd0ee4d2d24c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521474.613097:0:17930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef4167fc00/0x411dd0ee4d2d24c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521474.613114:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222492928:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788521474.613148:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521474.613173:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee433e4300 going to sleep for 11 seconds 00000100:00100000:3.0:1788521474.613574:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222492928 00000100:00100000:3.0:1788521474.613581:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222492928 00000100:00100000:3.0:1788521474.613612:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788521474.613619:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+13:17930:x1875400222492928:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788521474.613628:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521474.613639:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d24cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d24c4 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521474.613668:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d24cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d24c4 expref: 14 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521474.613685:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef413fde00/0x411dd0ee4d2d24cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d24c4 expref: 14 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521474.613692:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fde00, rc 0) 00000100:00100000:3.0:1788521474.613734:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+14:17930:x1875400222492928:12345-0@lo:101:mount.lustre.0 Request processed in 117us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521474.613739:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788521474.613848:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222492928:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521474.613860:0:17930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef4167fc00/0x411dd0ee4d2d24c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d24cb expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521474.613867:0:17930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef4167fc00/0x411dd0ee4d2d24c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d24cb expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521474.613878:0:17930:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788521474.613905:0:17930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef4167fc00/0x411dd0ee4d2d24c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d24cb expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521474.613911:0:17930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef4167fc00/0x411dd0ee4d2d24c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d24cb expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521474.613919:0:17930:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788521474.613928:0:17930:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788521474.613934:0:17930:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8fef7a3b2800 10000000:01000000:2.0:1788521474.613936:0:17930:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788521474.613939:0:17930:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788521474.613941:0:17930:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788521474.613957:0:17930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef4167f400/0x411dd0ee4d2d24d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521474.613964:0:17930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef4167f400/0x411dd0ee4d2d24d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521474.613972:0:17930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef4167f400/0x411dd0ee4d2d24d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521474.613986:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222493056:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788521474.614014:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521474.614037:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee433e4300 going to sleep for 11 seconds 00000100:00100000:0.0:1788521474.614310:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222493056 00000100:00100000:0.0:1788521474.614316:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222493056 00000100:00100000:0.0:1788521474.614339:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788521474.614345:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+14:17930:x1875400222493056:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788521474.614353:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521474.614361:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef7f12c800/0x411dd0ee4d2d24d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d24d2 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.614374:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef7f12c800/0x411dd0ee4d2d24d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d24d2 expref: 15 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.614390:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef7f12c800/0x411dd0ee4d2d24d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d24d2 expref: 15 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.614396:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef7f12c800, rc 0) 00000100:00100000:0.0:1788521474.614446:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+15:17930:x1875400222493056:12345-0@lo:101:mount.lustre.0 Request processed in 90us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521474.614452:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788521474.614541:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222493056:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521474.614553:0:17930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef4167f400/0x411dd0ee4d2d24d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d24d9 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521474.614561:0:17930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef4167f400/0x411dd0ee4d2d24d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d24d9 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788521474.616176:0:17930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:0.0:1788521474.617639:0:17930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788521474.621779:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788521474.621832:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1788521474.621848:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1788521474.621862:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1788521474.621876:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:0.0:1788521474.621959:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:0.0:1788521474.621976:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:0.0:1788521474.621990:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1788521474.622001:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1788521474.622012:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:0.0:1788521474.622023:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:0.0:1788521474.622036:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:0.0:1788521474.622047:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:0.0:1788521474.622058:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1788521474.622068:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1788521474.622080:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:0.0:1788521474.622093:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1788521474.622104:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1788521474.622114:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:0.0:1788521474.622127:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1788521474.622139:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1788521474.622165:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1788521474.622178:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1788521474.622277:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:0.0:1788521474.622285:0:17930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:0.0:1788521474.622386:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d21c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222493184:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788521474.622519:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521474.622620:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef516a5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788521474.628771:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222493184 00000100:00100000:2.0:1788521474.628786:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222493184 00000100:00100000:2.0:1788521474.628857:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788521474.628868:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+15:17930:x1875400222493184:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521474.629068:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+15:17930:x1875400222493184:12345-0@lo:501:mount.lustre.0 Request processed in 202us (6549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521474.629087:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788521474.629399:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d21c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222493184:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788521474.629456:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d21c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222493312:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788521474.629507:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521474.629532:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef516a5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788521474.629910:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222493312 00000100:00100000:3.0:1788521474.629915:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222493312 00000100:00100000:3.0:1788521474.629944:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788521474.629950:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+15:17930:x1875400222493312:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788521474.632727:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+15:17930:x1875400222493312:12345-0@lo:503:mount.lustre.0 Request processed in 2767us (3210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521474.632740:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788521474.632946:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d21c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222493312:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788521474.633498:0:17930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788521474.633576:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d21c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222493440:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788521474.633804:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521474.633844:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef516a5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788521474.634029:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222493440 00000100:00100000:1.0:1788521474.634036:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222493440 00000100:00100000:1.0:1788521474.634083:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788521474.634091:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+15:17930:x1875400222493440:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788521474.634988:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d21c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222493440:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788521474.635289:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788521474.635321:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:0.0:1788521474.635335:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:0.0:1788521474.635349:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:0.0:1788521474.636779:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:0.0:1788521474.636816:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000100:00100000:1.0:1788521474.636869:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+15:17930:x1875400222493440:12345-0@lo:502:mount.lustre.0 Request processed in 791us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521474.636901:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000040:00080000:0.0:1788521474.640026:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:0.0:1788521474.640052:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:0.0:1788521474.640065:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:0.0:1788521474.640076:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:0.0:1788521474.640108:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:0.0:1788521474.640118:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:0.0:1788521474.640127:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:0.0:1788521474.640137:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:0.0:1788521474.640148:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:0.0:1788521474.640159:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:0.0:1788521474.640168:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:0.0:1788521474.640177:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:0.0:1788521474.640191:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:0.0:1788521474.640201:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:0.0:1788521474.640211:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:0.0:1788521474.640220:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:0.0:1788521474.640232:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:0.0:1788521474.640243:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:0.0:1788521474.640252:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:0.0:1788521474.640263:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:0.0:1788521474.640276:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:0.0:1788521474.640288:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:0.0:1788521474.640301:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:0.0:1788521474.640314:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:0.0:1788521474.640327:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:0.0:1788521474.640338:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:0.0:1788521474.640350:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:0.0:1788521474.640363:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:0.0:1788521474.640376:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:0.0:1788521474.640390:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:0.0:1788521474.640402:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:0.0:1788521474.640415:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:0.0:1788521474.640426:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:0.0:1788521474.640446:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:0.0:1788521474.640459:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:0.0:1788521474.640470:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:0.0:1788521474.640480:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:0.0:1788521474.640503:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:0.0:1788521474.640557:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d21c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222493568:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788521474.640636:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521474.640685:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef516a5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788521474.641031:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222493568 00000100:00100000:3.0:1788521474.641038:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222493568 00000100:00100000:3.0:1788521474.641086:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788521474.641095:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+15:17930:x1875400222493568:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788521474.641233:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+15:17930:x1875400222493568:12345-0@lo:502:mount.lustre.0 Request processed in 137us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521474.641240:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788521474.641457:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d21c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222493568:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788521474.641510:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:0.0:1788521474.641521:0:17930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1788521474.642524:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521474.642537:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521474.642540:0:17934:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788521474.642546:0:17934:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788521474.642548:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788521474.642562:0:17934:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8fee42138000) 00000020:00000080:0.0:1788521474.642585:0:17934:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1788521474.642590:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788521474.642680:0:17934:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788521474.642687:0:17934:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x411dd0ee4d2d24e7 00000020:00000080:0.0:1788521474.642879:0:17934:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788521474.643006:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521474.643011:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521474.643012:0:17934:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788521474.643015:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521474.643019:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521474.643021:0:17934:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1788521474.643024:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788521474.643034:0:17934:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8fef6da819c0) 00000020:00000080:0.0:1788521474.643045:0:17934:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1788521474.643049:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788521474.643052:0:17934:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1788521474.643054:0:17934:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1788521474.643061:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788521474.643120:0:17934:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fef7a3b2800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1788521474.643133:0:17934:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8fef6da80000) 00000020:00000080:0.0:1788521474.643142:0:17934:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1788521474.643279:0:17934:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788521474.643285:0:17934:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x411dd0ee4d2d24fc 00000020:00000080:0.0:1788521474.643373:0:17934:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1788521474.643380:0:17934:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788521474.643385:0:17934:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x411dd0ee4d2d2503 00080000:01000000:0.0:1788521474.643390:0:17934:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788521474.643393:0:17934:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x411dd0ee4d2d250a 00010000:00010000:2.0:1788521474.755005:0:17934:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788521474.755525:0:17934:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1788521474.756385:0:17934:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788521474.766616:0:17934:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788521474.766632:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521474.766717:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521474.766720:0:17934:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788521474.766725:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521474.766732:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521474.766733:0:17934:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788521474.766737:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788521474.766743:0:17934:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.141@tcp to nid 0x20000c0a8cb8d (192.168.203.141@tcp) 00000020:00000080:2.0:1788521474.766771:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788521474.766788:0:17934:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8fef7efecd40) 00000020:00000080:2.0:1788521474.766810:0:17934:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1788521474.766815:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788521474.767392:0:17934:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788521474.767402:0:17934:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788521474.767409:0:17934:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x411dd0ee4d2d2518 00010000:00080000:2.0:1788521474.767450:0:17934:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fef7f05a000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.141@tcp at head 00010000:00010000:2.0:1788521474.776455:0:17934:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1788521474.783057:0:17934:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788521474.783073:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788521474.783115:0:17934:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788521474.783134:0:17934:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x411dd0ee4d2d251f 00000100:00080000:0.0:1788521474.783144:0:17934:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788521474.783150:0:17934:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8fef7f05a000 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:0.0:1788521474.783182:0:17934:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee43d21c00 x1875400222493696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788521474.783307:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222493696:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788521474.783375:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521474.783483:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222493696 00000100:00100000:3.0:1788521474.783490:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222493696 00000100:00100000:3.0:1788521474.783527:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788521474.783535:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3642:x1875400222493696:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788521474.783557:0:17205:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 524 last 0 00000020:00000080:3.0:1788521474.783599:0:17205:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x411dd0ee4d2d2526 00000004:00100000:3.0:1788521474.783613:0:17205:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788521474.783618:0:17205:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788521474.784078:0:17934:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1788521474.784153:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521474.784159:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521474.784161:0:17934:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788521474.784164:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788521474.784167:0:17934:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788521474.784169:0:17934:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788521474.784171:0:17934:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788521474.784172:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788521474.784175:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521474.784176:0:17934:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788521474.784178:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521474.784183:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521474.784185:0:17934:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788521474.784278:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788521474.784320:0:17934:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788521474.784335:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521474.784338:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521474.784339:0:17934:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788521474.784342:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788521474.784343:0:17934:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1788521474.784345:0:17934:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788521474.784346:0:17934:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788521474.784348:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788521474.784350:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521474.784351:0:17934:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788521474.784354:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788521474.784357:0:17934:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788521474.784360:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521474.784362:0:17934:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788521474.784365:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788521474.784369:0:17934:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.141@tcp to nid 0x20000c0a8cb8d (192.168.203.141@tcp) 00000020:01000000:0.0:1788521474.784389:0:17934:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788521474.784393:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788521474.784407:0:17934:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8fef6da83380) 00000020:00000080:0.0:1788521474.784420:0:17934:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788521474.784426:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788521474.784548:0:17934:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788521474.784554:0:17934:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788521474.784560:0:17934:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x411dd0ee4d2d2534 00010000:00080000:0.0:1788521474.784586:0:17934:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fef7f05c800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.141@tcp at head 00000100:00080000:2.0:1788521474.784727:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788521474.784732:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788521474.784735:0:37:0:(import.c:65:import_set_state_nolock()) ffff8fef81475000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788521474.784741:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 520 00000100:00080000:2.0:1788521474.784745:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788521474.784749:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8fef81475000 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:2.0:1788521474.784779:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee43599880 x1875400222493824/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1788521474.785081:0:17934:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:0.0:1788521474.786123:0:17934:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788521474.786350:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222493824:0@lo:38:kworker.0 00000100:00100000:1.0:1788521474.786412:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521474.786552:0:17204:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788521474.786567:0:17204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000040:01000000:3.0:1788521474.786625:0:17934:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788521474.788185:0:17934:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788521474.788568:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222493824 00000100:00100000:1.0:1788521474.788577:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222493824 00000040:00080000:3.0:1788521474.788745:0:17934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788521474.789081:0:17934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00100000:0.0:1788521474.789326:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521474.789341:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3642:x1875400222493824:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788521474.789429:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3642:x1875400222493824:12345-0@lo:38:kworker.0 Request processed in 89us (3016us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788521474.789447:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521474.789486:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788521474.789494:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef81475000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788521474.789498:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788521474.789503:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222493824:0@lo:38:kworker.0 00000100:00080000:2.0:1788521474.789825:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788521474.789831:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788521474.789834:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788521474.789837:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788521474.790012:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875400222493952:0@lo:400:kworker.0 00000100:00100000:2.0:1788521474.790053:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521474.790124:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222493952 00000100:00100000:1.0:1788521474.790131:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222493952 00000100:00100000:1.0:1788521474.790173:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788521474.790188:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875400222493952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521474.790243:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875400222493952:12345-0@lo:400:kworker.0 Request processed in 56us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521474.790250:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000040:00080000:0.0:1788521474.790970:0:17941:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788521474.790975:0:17941:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00010000:00080000:2.0:1788521474.791074:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8fef715a3b80 x1875400222493952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521474.791088:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875400222493952:0@lo:400:kworker.0 00000020:00000080:3.0:1788521474.792448:0:17934:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788521474.792462:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788521474.792503:0:17934:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788521474.792525:0:17934:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x411dd0ee4d2d253b 00000100:00080000:3.0:1788521474.792534:0:17934:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788521474.792539:0:17934:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8fef7f05c800 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:3.0:1788521474.792570:0:17934:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fef7f0c8a80 x1875400222494080/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788521474.792587:0:17934:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788521474.792613:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788521474.792618:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788521474.792620:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788521474.792623:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788521474.793524:0:17205:0:(import.c:65:import_set_state_nolock()) ffff8fef6e4e3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788521474.793596:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875400222493696:12345-0@lo:38:llog_process_th.0 Request processed in 10060us (10219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521474.793606:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788521474.793686:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222494080:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788521474.793721:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875400222494080 offset 0 length 520: 4 00000100:00100000:1.0:1788521474.793760:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788521474.793767:0:3642:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788521474.793775:0:3642:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788521474.793779:0:3642:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788521474.793782:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef7f05a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788521474.793802:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222493696:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788521474.794448:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788521474.794459:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222494208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788521474.794495:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521474.794582:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222494208 00000100:00100000:2.0:1788521474.794588:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222494208 00000100:00100000:2.0:1788521474.794630:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788521474.794638:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875400222494208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788521474.794728:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788521474.794818:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875400222494208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 181us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521474.794826:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788521474.794862:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222494208:0@lo:41:osp-pre-0-1.0 00000020:01000000:3.0:1788521474.795181:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521474.795188:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521474.795190:0:17934:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788521474.795193:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788521474.795205:0:17934:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1788521474.795207:0:17934:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788521474.795209:0:17934:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788521474.795211:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788521474.795213:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521474.795221:0:17934:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788521474.795224:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788521474.795229:0:17934:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788521474.795233:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521474.795234:0:17934:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788521474.795237:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788521474.795241:0:17934:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.141@tcp to nid 0x20000c0a8cb8d (192.168.203.141@tcp) 00000020:01000000:3.0:1788521474.795260:0:17934:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788521474.795263:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788521474.795278:0:17934:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8fee426d4d40) 00000020:00000080:3.0:1788521474.795297:0:17934:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1788521474.795302:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788521474.795376:0:17934:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788521474.795383:0:17934:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788521474.795390:0:17934:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x411dd0ee4d2d2549 00010000:00080000:3.0:1788521474.795418:0:17934:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fef6e4db000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.141@tcp at head 00010000:00010000:3.0:1788521474.797816:0:17934:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788521474.797923:0:17934:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788521474.797940:0:17934:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788521474.801546:0:17934:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788521474.803110:0:17934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788521474.803356:0:17934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788521474.803831:0:17943:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788521474.803837:0:17943:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788521474.804613:0:17934:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788521474.804624:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788521474.804731:0:17934:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788521474.804753:0:17934:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x411dd0ee4d2d2550 00000100:00080000:2.0:1788521474.804763:0:17934:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788521474.804769:0:17934:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8fef6e4db000 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:2.0:1788521474.804800:0:17934:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee43598380 x1875400222494336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788521474.804871:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222494336:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788521474.804952:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875400222494336 offset 0 length 520: 4 00000100:00080000:2.0:1788521474.805086:0:17934:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788521474.805144:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521474.805149:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521474.805151:0:17934:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788521474.805154:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521474.805158:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521474.805159:0:17934:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788521474.805162:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788521474.805164:0:17934:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788521474.805166:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521474.805168:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521474.805169:0:17934:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788521474.805172:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521474.805174:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521474.805175:0:17934:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788521474.805178:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00080000:3.0:1788521474.805305:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788521474.805310:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788521474.805313:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788521474.805316:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1788521474.805357:0:17934:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521474.805361:0:17934:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521474.805363:0:17934:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788521474.805366:0:17934:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:3.0:1788521474.805601:0:17930:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1788521474.805631:0:17930:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788521474.805658:0:17930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef4167f400/0x411dd0ee4d2d24d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d24d9 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521474.805682:0:17930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef4167f400/0x411dd0ee4d2d24d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d24d9 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521474.805691:0:17930:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fef7a3b2800 from 1 10000000:01000000:3.0:1788521474.805694:0:17930:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788521474.805722:0:17930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef413fc400/0x411dd0ee4d2d2557 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521474.805731:0:17930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef413fc400/0x411dd0ee4d2d2557 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521474.805743:0:17930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef413fc400/0x411dd0ee4d2d2557 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521474.805761:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0caa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222494464:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788521474.805802:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521474.805826:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee435a1780 going to sleep for 11 seconds 00000100:00100000:0.0:1788521474.806423:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222494464 00000100:00100000:0.0:1788521474.806430:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222494464 00000100:00100000:0.0:1788521474.806520:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788521474.806530:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+15:17930:x1875400222494464:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788521474.806542:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521474.806555:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef7f12c600/0x411dd0ee4d2d255e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d2557 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.806577:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef7f12c600/0x411dd0ee4d2d255e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2557 expref: 16 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.806588:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef7f12c600/0x411dd0ee4d2d255e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2557 expref: 16 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.806605:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef7f12c600, rc 0) 00000100:00100000:0.0:1788521474.806798:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+16:17930:x1875400222494464:12345-0@lo:101:mount.lustre.0 Request processed in 269us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521474.806805:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788521474.806933:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0caa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222494464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521474.806950:0:17930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef413fc400/0x411dd0ee4d2d2557 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d255e expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521474.806969:0:17930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef413fc400/0x411dd0ee4d2d2557 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d255e expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521474.807517:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43599c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222494592:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788521474.807561:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521474.810452:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee433e49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521474.810749:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222494592 00000100:00100000:3.0:1788521474.810760:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222494592 00000100:00100000:3.0:1788521474.810811:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788521474.810819:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+16:17930:x1875400222494592:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788521474.810842:0:17194:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788521474.810866:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788521474.810869:0:17194:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788521474.811636:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+16:17930:x1875400222494592:12345-0@lo:256:mount.lustre.0 Request processed in 814us (4070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521474.811702:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788521474.811950:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43599c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222494592:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788521474.818332:0:17930:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788521474.818362:0:17930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef413fc400/0x411dd0ee4d2d2557 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d255e expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521474.818375:0:17930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef413fc400/0x411dd0ee4d2d2557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d255e expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521474.818968:0:17930:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fef7a3b2800 from 1 10000000:01000000:1.0:1788521474.818972:0:17930:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788521474.819012:0:17930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434aa400/0x411dd0ee4d2d2565 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521474.819023:0:17930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fee434aa400/0x411dd0ee4d2d2565 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521474.819033:0:17930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fee434aa400/0x411dd0ee4d2d2565 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521474.819074:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222494720:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788521474.819138:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521474.819179:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef8147f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521474.819283:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222494720 00000100:00100000:3.0:1788521474.819291:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222494720 00000100:00100000:3.0:1788521474.819341:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788521474.819351:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+16:17930:x1875400222494720:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788521474.819366:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521474.819379:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef413fc800/0x411dd0ee4d2d256c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d2565 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521474.819401:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef413fc800/0x411dd0ee4d2d256c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2565 expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521474.819412:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef413fc800/0x411dd0ee4d2d256c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2565 expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521474.819420:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fc800, rc 0) 00000100:00100000:3.0:1788521474.819479:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+17:17930:x1875400222494720:12345-0@lo:101:mount.lustre.0 Request processed in 129us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521474.819486:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788521474.819761:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222494720:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521474.819775:0:17930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fee434aa400/0x411dd0ee4d2d2565 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d256c expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521474.819785:0:17930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fee434aa400/0x411dd0ee4d2d2565 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d256c expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788521474.819928:0:17930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788521474.819972:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43598a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222494848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521474.820001:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521474.820017:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee433e4900 going to sleep for 11 seconds 00000100:00100000:1.0:1788521474.820078:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222494848 00000100:00100000:1.0:1788521474.820083:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222494848 00000100:00100000:1.0:1788521474.820118:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788521474.820126:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+17:17930:x1875400222494848:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788521474.820213:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+17:17930:x1875400222494848:12345-0@lo:501:mount.lustre.0 Request processed in 88us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521474.820220:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788521474.820444:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43598a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222494848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521474.820482:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43598a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222494976:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788521474.820523:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521474.820549:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee433e4900 going to sleep for 11 seconds 00000100:00100000:1.0:1788521474.820622:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222494976 00000100:00100000:1.0:1788521474.820626:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222494976 00000100:00100000:1.0:1788521474.820748:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788521474.820755:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+17:17930:x1875400222494976:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788521474.820839:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+17:17930:x1875400222494976:12345-0@lo:503:mount.lustre.0 Request processed in 84us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521474.820846:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788521474.820992:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43598a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222494976:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788521474.821314:0:17930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788521474.821389:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43598a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222495104:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788521474.821425:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521474.821962:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee433e4540 going to sleep for 11 seconds 00000100:00100000:3.0:1788521474.822430:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222495104 00000100:00100000:3.0:1788521474.822445:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222495104 00000100:00100000:3.0:1788521474.822488:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788521474.823935:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+17:17930:x1875400222495104:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788521474.824154:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+17:17930:x1875400222495104:12345-0@lo:502:mount.lustre.0 Request processed in 238us (2727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521474.824162:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788521474.824792:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43598a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222495104:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788521474.825022:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788521474.825049:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:2.0:1788521474.825061:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:2.0:1788521474.825071:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:2.0:1788521474.825082:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:2.0:1788521474.825093:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:2.0:1788521474.825103:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:2.0:1788521474.825115:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:2.0:1788521474.825125:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788521474.825136:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:2.0:1788521474.825146:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:2.0:1788521474.825178:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43598a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222495232:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788521474.825239:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521474.825268:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee433e4540 going to sleep for 11 seconds 00000100:00100000:3.0:1788521474.825693:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222495232 00000100:00100000:3.0:1788521474.825700:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222495232 00000100:00100000:3.0:1788521474.825736:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788521474.825743:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+17:17930:x1875400222495232:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788521474.825850:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+17:17930:x1875400222495232:12345-0@lo:502:mount.lustre.0 Request processed in 107us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521474.825857:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788521474.826045:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43598a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222495232:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788521474.826098:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:2.0:1788521474.826107:0:17930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788521474.826700:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521474.826708:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521474.826711:0:17945:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788521474.826716:0:17945:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fef7a3b2800 00000020:00000080:2.0:1788521474.826719:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788521474.826725:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521474.826728:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521474.826729:0:17945:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788521474.826732:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521474.826734:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521474.826735:0:17945:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788521474.826738:0:17945:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fef7a3b2800 00000020:00000080:2.0:1788521474.826740:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788521474.826792:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521474.826794:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521474.826796:0:17945:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788521474.826798:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521474.826800:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521474.826801:0:17945:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788521474.826804:0:17945:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fef7a3b2800 00000020:00000080:2.0:1788521474.826806:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788521474.826820:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521474.826822:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521474.826823:0:17945:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788521474.826825:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521474.826827:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521474.826829:0:17945:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788521474.826832:0:17945:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fef7a3b2800 00000020:00000080:2.0:1788521474.826834:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788521474.826852:0:17945:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521474.826854:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521474.826856:0:17945:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788521474.826858:0:17945:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:2.0:1788521474.826929:0:17930:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788521474.826955:0:17930:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788521474.826971:0:17930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434aa400/0x411dd0ee4d2d2565 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d256c expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521474.826982:0:17930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fee434aa400/0x411dd0ee4d2d2565 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d256c expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521474.827031:0:17930:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788521474.827034:0:17930:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8fef7a3b2800 10000000:01000000:2.0:1788521474.827037:0:17930:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8fef7a3b2800 10000000:01000000:2.0:1788521474.827041:0:17930:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788521474.827045:0:17930:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fef7a3b2800 from 1 10000000:01000000:2.0:1788521474.827051:0:17930:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788521474.827076:0:17930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef4167fe00/0x411dd0ee4d2d2573 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521474.827085:0:17930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef4167fe00/0x411dd0ee4d2d2573 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521474.827093:0:17930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef4167fe00/0x411dd0ee4d2d2573 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521474.827111:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43598a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222495360:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788521474.827157:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521474.827186:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee433e4900 going to sleep for 11 seconds 00000100:00100000:2.0:1788521474.827214:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222495360 00000100:00100000:2.0:1788521474.827219:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222495360 00000100:00100000:2.0:1788521474.827242:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788521474.827249:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+17:17930:x1875400222495360:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521474.827259:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521474.827270:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef4167e800/0x411dd0ee4d2d257a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d2573 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521474.827290:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef4167e800/0x411dd0ee4d2d257a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2573 expref: 18 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521474.827299:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef4167e800/0x411dd0ee4d2d257a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2573 expref: 18 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521474.827308:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef4167e800, rc 0) 00000100:00100000:2.0:1788521474.827341:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:17930:x1875400222495360:12345-0@lo:101:mount.lustre.0 Request processed in 92us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521474.827357:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788521474.827397:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43598a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222495360:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521474.827410:0:17930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef4167fe00/0x411dd0ee4d2d2573 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d257a expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521474.827419:0:17930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef4167fe00/0x411dd0ee4d2d2573 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d257a expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788521474.831492:0:17930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788521474.832722:0:17930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788521474.832970:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788521474.832997:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1788521474.833012:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1788521474.833023:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1788521474.833034:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1788521474.833045:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1788521474.833057:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1788521474.833069:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1788521474.833081:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1788521474.833092:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:2.0:1788521474.833103:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:2.0:1788521474.833114:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:2.0:1788521474.833125:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:2.0:1788521474.833147:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:2.0:1788521474.833157:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:2.0:1788521474.833169:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:2.0:1788521474.833178:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:2.0:1788521474.833187:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:2.0:1788521474.833209:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:2.0:1788521474.833221:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:2.0:1788521474.833240:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:2.0:1788521474.833251:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:2.0:1788521474.833262:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:2.0:1788521474.833275:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:2.0:1788521474.833286:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:2.0:1788521474.833297:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:2.0:1788521474.833309:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:2.0:1788521474.833322:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:2.0:1788521474.833341:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:2.0:1788521474.833346:0:17930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788521474.833446:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43598a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222495488:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521474.833513:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521474.833555:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee433e4300 going to sleep for 11 seconds 00000100:00100000:2.0:1788521474.833586:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222495488 00000100:00100000:2.0:1788521474.833594:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222495488 00000100:00100000:2.0:1788521474.833639:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788521474.836416:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:17930:x1875400222495488:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521474.838112:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:17930:x1875400222495488:12345-0@lo:501:mount.lustre.0 Request processed in 1706us (4591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521474.838124:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788521474.845352:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43598a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222495488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788521474.845417:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222495616:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788521474.845495:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521474.845530:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee433e4300 going to sleep for 11 seconds 00000100:00100000:1.0:1788521474.845556:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222495616 00000100:00100000:1.0:1788521474.845561:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222495616 00000100:00100000:1.0:1788521474.845605:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788521474.845613:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:17930:x1875400222495616:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788521474.846494:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:17930:x1875400222495616:12345-0@lo:503:mount.lustre.0 Request processed in 877us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521474.846503:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788521474.846903:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222495616:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788521474.848158:0:17930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788521474.849820:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d21880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222495744:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788521474.849923:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521474.849959:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee433e4900 going to sleep for 11 seconds 00000100:00100000:2.0:1788521474.850026:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222495744 00000100:00100000:2.0:1788521474.850035:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222495744 00000100:00100000:2.0:1788521474.850088:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788521474.850097:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:17930:x1875400222495744:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788521474.850316:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:17930:x1875400222495744:12345-0@lo:502:mount.lustre.0 Request processed in 219us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521474.850324:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788521474.850382:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d21880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222495744:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788521474.850592:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788521474.850619:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1788521474.850631:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1788521474.851801:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1788521474.851848:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1788521474.851860:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1788521474.851872:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1788521474.851894:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1788521474.851908:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1788521474.851919:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1788521474.851930:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1788521474.851944:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1788521474.851957:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1788521474.851969:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1788521474.851982:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1788521474.851996:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1788521474.852010:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1788521474.852034:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1788521474.852047:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1788521474.852058:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1788521474.852069:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1788521474.852079:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1788521474.852090:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1788521474.852102:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1788521474.852114:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1788521474.852124:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1788521474.852135:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1788521474.852145:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1788521474.852156:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1788521474.852168:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1788521474.852178:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1788521474.852189:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1788521474.852970:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1788521474.853000:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1788521474.853015:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1788521474.853028:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1788521474.853040:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1788521474.853051:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1788521474.853063:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1788521474.853074:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1788521474.853086:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1788521474.853098:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1788521474.853109:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1788521474.853121:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1788521474.853132:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1788521474.853142:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1788521474.853154:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1788521474.853167:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1788521474.854032:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4359b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222495872:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788521474.854111:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521474.855508:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef71e0db40 going to sleep for 11 seconds 00000100:00100000:0.0:1788521474.863476:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222495872 00000100:00100000:0.0:1788521474.863491:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222495872 00000100:00100000:0.0:1788521474.863547:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788521474.863557:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:17930:x1875400222495872:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788521474.863732:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:17930:x1875400222495872:12345-0@lo:502:mount.lustre.0 Request processed in 176us (9620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521474.863740:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788521474.863804:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4359b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222495872:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788521474.864044:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:0.0:1788521474.864071:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:0.0:1788521474.864114:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d21880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222496000:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788521474.864154:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521474.864184:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee433e4900 going to sleep for 11 seconds 00000100:00100000:0.0:1788521474.864206:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222496000 00000100:00100000:0.0:1788521474.864210:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222496000 00000100:00100000:0.0:1788521474.864469:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788521474.864476:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7979b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:17930:x1875400222496000:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788521474.864548:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7979b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:17930:x1875400222496000:12345-0@lo:502:mount.lustre.0 Request processed in 72us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521474.864556:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788521474.864594:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d21880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222496000:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788521474.864631:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:0.0:1788521474.864701:0:17930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788521474.869289:0:17950:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788521474.869307:0:17950:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8fef7ef519c0) 00000020:00000080:1.0:1788521474.869328:0:17950:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788521474.869431:0:17950:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fef7a3b2800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788521474.869445:0:17950:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fef7a3b2800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788521474.869447:0:17950:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fef7a3b2800 3 00010000:00080000:1.0:1788521474.869761:0:17950:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fee41abc800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.141@tcp at head 00010000:00010000:1.0:1788521474.873182:0:17950:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1788521474.873391:0:17950:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788521474.873443:0:17950:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788521474.873457:0:17950:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x411dd0ee4d2d2588 00000100:00080000:1.0:1788521474.873467:0:17950:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788521474.873473:0:17950:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8fee41abc800 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:1.0:1788521474.873506:0:17950:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fef715a3480 x1875400222496128/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788521474.873529:0:17950:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788521474.873557:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788521474.873562:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788521474.873565:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788521474.873568:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788521474.873955:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875400222496128:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788521474.874024:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521474.874314:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222496128 00000100:00100000:1.0:1788521474.874321:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222496128 00000100:00100000:1.0:1788521474.874361:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788521474.874377:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3642:x1875400222496128:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788521474.874399:0:17199:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 524 last 0 00000020:00000080:1.0:1788521474.874428:0:17199:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x411dd0ee4d2d258f 00000004:00100000:1.0:1788521474.874453:0:17199:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788521474.874482:0:17199:0:(import.c:65:import_set_state_nolock()) ffff8fee41abd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788521474.874531:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875400222496128:12345-0@lo:38:llog_process_th.0 Request processed in 153us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521474.874538:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788521474.874749:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8fef715a3480 x1875400222496128/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788521484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521474.874759:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788521474.874766:0:3642:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788521474.874773:0:3642:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788521474.874777:0:3642:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788521474.874779:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fee41abc800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788521474.874785:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875400222496128:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788521474.879225:0:17950:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:0.0:1788521474.885693:0:17930:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788521474.885742:0:17930:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788521474.885761:0:17930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef4167fe00/0x411dd0ee4d2d2573 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d257a expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.885773:0:17930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef4167fe00/0x411dd0ee4d2d2573 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d257a expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788521474.885836:0:17930:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788521474.885838:0:17930:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788521474.885839:0:17930:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788521474.885840:0:17930:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788521474.885842:0:17930:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788521474.885844:0:17930:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788521474.885845:0:17930:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788521474.885847:0:17930:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788521474.885849:0:17930:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788521474.885852:0:17930:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1788521474.885854:0:17930:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788521474.885856:0:17930:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788521474.885857:0:17930:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788521474.885858:0:17930:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788521474.885859:0:17930:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788521474.885860:0:17930:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788521474.885861:0:17930:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788521474.885863:0:17930:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788521474.885864:0:17930:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788521474.885906:0:17930:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788521474.885926:0:17930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d21c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222496256:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788521474.885994:0:17930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521474.886029:0:17930:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee4226b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788521474.886054:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222496256 00000100:00100000:0.0:1788521474.886061:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222496256 00000100:00100000:0.0:1788521474.886100:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788521474.886108:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7979a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:17930:x1875400222496256:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788521474.886133:0:17193:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788521474.886146:0:17193:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1788521474.895209:0:17179:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788521474.895414:0:17193:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788521474.895431:0:17193:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788521474.895836:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7979a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:17930:x1875400222496256:12345-0@lo:253:mount.lustre.0 Request processed in 9723us (9837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521474.895847:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788521474.896036:0:17930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d21c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17930:1875400222496256:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788521474.896048:0:17930:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788521474.896051:0:17930:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788521474.896053:0:17930:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788521474.896055:0:17930:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788521474.896056:0:17930:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788521474.896057:0:17930:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788521474.896059:0:17930:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788521474.896060:0:17930:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788521474.896061:0:17930:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788521474.896063:0:17930:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788521474.896075:0:17930:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1788521474.898344:0:17216:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788521474.898354:0:17216:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788521474.898379:0:17216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fef7f12dc00/0x411dd0ee4d2d2596 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.898406:0:17216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fee434ab800/0x411dd0ee4d2d249a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2493 expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.898413:0:17216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef7f12c600/0x411dd0ee4d2d255e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2557 expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.898420:0:17216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fef7f12dc00/0x411dd0ee4d2d2596 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.898479:0:17216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef7f12c600/0x411dd0ee4d2d255e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d2557 expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.898495:0:17216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fef7f12c600/0x411dd0ee4d2d255e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2557 expref: 17 pid: 17193 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521474.898509:0:17216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d23800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1875400222496384:0@lo:104: 00000100:00100000:0.0:1788521474.898568:0:17216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788521474.898617:0:17216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fee434ab800/0x411dd0ee4d2d249a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d2493 expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.898626:0:17216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fee434ab800/0x411dd0ee4d2d249a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2493 expref: 17 pid: 17193 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521474.898634:0:17216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d22a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1875400222496512:0@lo:104: 00000100:00100000:0.0:1788521474.898786:0:17216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521474.898810:0:17216:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee4226b780 going to sleep for 11 seconds 00000100:00100000:0.0:1788521474.898847:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222496384 00000100:00100000:0.0:1788521474.898854:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222496384 00000100:00100000:0.0:1788521474.898914:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222496512 00000100:00100000:0.0:1788521474.898923:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222496512 00000100:00100000:0.0:1788521474.898943:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788521474.898951:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+4:17216:x1875400222496384:12345-0@lo:104: 00010000:00010000:0.0:1788521474.898963:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef413fc400/0x411dd0ee4d2d2557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d255e expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.899009:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788521474.899014:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+4:17216:x1875400222496384:12345-0@lo:104: Request processed in 65us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521474.899020:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788521474.899033:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521474.899038:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+3:17216:x1875400222496512:12345-0@lo:104: 00010000:00010000:0.0:1788521474.899045:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d600/0x411dd0ee4d2d2493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d249a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.899077:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788521474.899081:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+3:17216:x1875400222496512:12345-0@lo:104: Request processed in 44us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521474.899086:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788521474.899099:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788521474.899105:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef413fc400/0x411dd0ee4d2d2557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d255e expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.899111:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef413fc400 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:0.0:1788521474.899114:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef413fc400/0x411dd0ee4d2d2557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d255e expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.899122:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef413fc400/0x411dd0ee4d2d2557 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d255e expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521474.899139:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef413fc400/0x411dd0ee4d2d2557 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d255e expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521474.899144:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521474.899166:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef413fc400/0x411dd0ee4d2d2557 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d255e expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.899172:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521474.899187:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef413fc400/0x411dd0ee4d2d2557 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d255e expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.899194:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef413fc400/0x411dd0ee4d2d2557 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d255e expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.900903:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521474.900914:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d600/0x411dd0ee4d2d2493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d249a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.900924:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef7f12d600 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:0.0:1788521474.900929:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d600/0x411dd0ee4d2d2493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d249a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.900938:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d600/0x411dd0ee4d2d2493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d249a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521474.900946:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d600/0x411dd0ee4d2d2493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d249a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521474.900951:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521474.900992:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d600/0x411dd0ee4d2d2493 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d249a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.900998:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521474.901028:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d600/0x411dd0ee4d2d2493 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d249a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.901035:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d600/0x411dd0ee4d2d2493 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d249a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.901049:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521474.901051:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521474.901053:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521474.901082:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3646:1875400222496640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521474.901135:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521474.901180:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788521474.901188:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3644:1875400222496768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521474.903510:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521474.903575:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222496640 00000100:00100000:0.0:1788521474.903582:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222496640 00010000:00010000:0.0:1788521474.903609:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef7f12c600/0x411dd0ee4d2d255e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2557 expref: 18 pid: 17193 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521474.903632:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222496768 00000100:00100000:0.0:1788521474.903634:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222496768 00010000:00010000:0.0:1788521474.903643:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fee434ab800/0x411dd0ee4d2d249a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2493 expref: 19 pid: 17193 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521474.903656:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788521474.903663:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+19:3646:x1875400222496640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521474.903691:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521474.903696:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef7f12c600/0x411dd0ee4d2d255e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2557 expref: 19 pid: 17193 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.903707:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef7f12c600/0x411dd0ee4d2d255e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2557 expref: 19 pid: 17193 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.903724:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521474.903760:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+19:3646:x1875400222496640:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (2624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521474.903767:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788521474.903781:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521474.903786:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:3644:x1875400222496768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521474.903793:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521474.903796:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fee434ab800/0x411dd0ee4d2d249a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2493 expref: 18 pid: 17193 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.903805:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fee434ab800/0x411dd0ee4d2d249a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2493 expref: 18 pid: 17193 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.903816:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fef7f12dc00/0x411dd0ee4d2d2596 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.903824:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef7f12dc00/0x411dd0ee4d2d2596 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788521474.903838:0:17185:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013421358s 00010000:00010000:0.0:1788521474.903842:0:17185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fef7f12dc00/0x411dd0ee4d2d2596 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.903858:0:17185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fef7f12dc00/0x411dd0ee4d2d2596 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.903866:0:17185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fef7f12dc00/0x411dd0ee4d2d2596 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.903873:0:17185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fef7f12dc00/0x411dd0ee4d2d2596 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.903879:0:17185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef7f12dc00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:0.0:1788521474.903897:0:17185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fef7f12dc00/0x411dd0ee4d2d2596 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.903906:0:17185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fef7f12dc00/0x411dd0ee4d2d2596 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.903914:0:17185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fef7f12dc00/0x411dd0ee4d2d2596 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.903923:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521474.903948:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:3644:x1875400222496768:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521474.903955:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521474.903985:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3646:1875400222496640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521474.904006:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3644:1875400222496768:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521474.904025:0:17216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef7f12c600/0x411dd0ee4d2d255e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d2557 expref: 17 pid: 17193 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521474.904045:0:17216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d23800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1875400222496384:0@lo:104: 00010000:00010000:0.0:1788521474.904057:0:17216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fee434ab800/0x411dd0ee4d2d249a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d2493 expref: 16 pid: 17193 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521474.904064:0:17216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d22a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1875400222496512:0@lo:104: 00010000:00010000:0.0:1788521474.904077:0:17216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fef7f12dc00/0x411dd0ee4d2d2596 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.904086:0:17216:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fef7f12dc00/0x411dd0ee4d2d2596 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.904092:0:17216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fef7f12dc00/0x411dd0ee4d2d2596 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521474.904099:0:17216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef7f12dc00/0x411dd0ee4d2d2596 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521474.904408:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788521474.923107:0:17930:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1788521474.923222:0:17956:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788521474.923227:0:17956:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788521474.923526:0:17957:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1788521474.924055:0:17957:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1788521474.927068:0:17930:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1788521474.927593:0:17957:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788521474.927799:0:17957:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1788521474.928177:0:17958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4359bb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17958:1875400222496896:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788521474.928255:0:17958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521474.928288:0:17958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee43649000 going to sleep for 11 seconds 00000100:00100000:1.0:1788521474.928753:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222496896 00000100:00100000:1.0:1788521474.928761:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222496896 00000100:00100000:1.0:1788521474.928809:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788521474.928818:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17958:x1875400222496896:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788521474.928998:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17958:x1875400222496896:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 180us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521474.929005:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788521474.929105:0:17958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4359bb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17958:1875400222496896:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788521474.929150:0:17958:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788521474.929182:0:17958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0caa00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17958:1875400222497024:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788521474.929237:0:17958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521474.929260:0:17958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef71dd4480 going to sleep for 11 seconds 00000100:00100000:1.0:1788521474.929449:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222497024 00000100:00100000:1.0:1788521474.929455:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222497024 00000100:00100000:1.0:1788521474.929492:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788521474.929500:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17958:x1875400222497024:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788521474.929598:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17958:x1875400222497024:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 99us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521474.929611:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788521474.930601:0:17958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0caa00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17958:1875400222497024:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788521474.930686:0:17958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0caa00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17958:1875400222497152:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788521474.930726:0:17958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521474.930787:0:17958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef71dd49c0 going to sleep for 11 seconds 00000040:01000000:0.0:1788521474.930998:0:17930:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1788521474.931031:0:17930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788521474.931752:0:17930:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788521474.931762:0:17930:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1788521474.931804:0:17930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788521474.932372:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222497152 00000100:00100000:1.0:1788521474.932381:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222497152 00000040:00080000:0.0:1788521474.933193:0:17930:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788521474.933813:0:17930:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788521474.933846:0:17930:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1788521474.934030:0:17930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788521474.934531:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788521474.934548:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17958:x1875400222497152:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788521474.934649:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17958:x1875400222497152:12345-0@lo:900:lod0001_rec0000.0 Request processed in 97us (3912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521474.934657:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788521474.934813:0:17958:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8fef7f0caa00 x1875400222497152/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788521490 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521474.934829:0:17958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0caa00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17958:1875400222497152:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788521474.934903:0:17958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0caa00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17958:1875400222497280:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788521474.934937:0:17958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521474.934968:0:17958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef71dd4480 going to sleep for 11 seconds 00080000:10000000:0.0:1788521474.936120:0:17930:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:2.0:1788521474.938142:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222497280 00000100:00100000:2.0:1788521474.938152:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222497280 00000100:00100000:2.0:1788521474.938204:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788521474.938213:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17958:x1875400222497280:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788521474.938331:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17958:x1875400222497280:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 119us (3393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521474.938348:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788521474.938967:0:17958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0caa00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17958:1875400222497280:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1788521474.939025:0:17958:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00000004:0.0:1788521474.940727:0:17930:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:2.0:1788521474.946747:0:17958:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788521474.946835:0:17958:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788521474.946841:0:17958:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:0.0:1788521474.959388:0:17930:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788521474.959426:0:17930:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa9e34169b988 00100000:10000000:0.0:1788521474.959445:0:17930:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788521474.961184:0:17930:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788521474.961345:0:17930:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.141@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788521474.961371:0:17930:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788521474.961391:0:17930:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788521474.964094:0:17930:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788521474.964318:0:17930:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788521475.021014:0:17241:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef43200300 going to sleep for 0 seconds 00010000:00010000:2.0:1788521475.533797:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788521475.927358:0:17953:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788521476.046152:0:17241:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef43200300 going to sleep for 0 seconds 00010000:00010000:2.0:1788521476.558303:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788521476.629178:0:17196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788521476.629187:0:17196:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fef7a3b2800 from 8 10000000:01000000:1.0:1788521476.629193:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788521476.629240:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d259d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521476.629252:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d259d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521476.629262:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d259d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521476.629287:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222497408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788521476.629352:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521476.629409:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef484e5240 going to sleep for 11 seconds 00000100:00100000:2.0:1788521476.629622:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222497408 00000100:00100000:2.0:1788521476.629630:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222497408 00000100:00100000:2.0:1788521476.629691:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788521476.629701:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef79799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+16:17196:x1875400222497408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521476.629714:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521476.629729:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef4167e000/0x411dd0ee4d2d25a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d259d expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521476.629763:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef4167e000/0x411dd0ee4d2d25a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d259d expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521476.629773:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef4167e000/0x411dd0ee4d2d25a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d259d expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521476.629782:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef4167e000, rc 0) 00000100:00100000:2.0:1788521476.629827:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef79799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+17:17196:x1875400222497408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521476.629834:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788521476.631198:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222497408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521476.631224:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d259d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d25a4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521476.631235:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d259d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d25a4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521476.631308:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222497536:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788521476.631360:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521476.631691:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef484e5240 going to sleep for 11 seconds 00000100:00100000:3.0:1788521476.634706:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222497536 00000100:00100000:3.0:1788521476.634721:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222497536 00000100:00100000:1.0:1788521476.635601:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788521476.635613:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef79799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+17:17196:x1875400222497536:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788521476.635639:0:17193:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788521476.635655:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788521476.635659:0:17193:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788521476.635790:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef79799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+17:17196:x1875400222497536:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 179us (4429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521476.635799:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788521476.636085:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222497536:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788521476.636144:0:17196:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788521476.636155:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d259d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d25a4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521476.636166:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d259d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d25a4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521476.636177:0:17196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788521476.636186:0:17196:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fef48513800 from 8 10000000:01000000:3.0:1788521476.636189:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788521476.636219:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef413fd200/0x411dd0ee4d2d25ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521476.636227:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef413fd200/0x411dd0ee4d2d25ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521476.636235:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef413fd200/0x411dd0ee4d2d25ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521476.636255:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222497664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788521476.636303:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521476.636335:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef50e2d240 going to sleep for 11 seconds 00000100:00100000:3.0:1788521476.636351:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222497664 00000100:00100000:3.0:1788521476.636356:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222497664 00000100:00100000:3.0:1788521476.638147:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788521476.638163:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7979ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+17:17196:x1875400222497664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521476.638180:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521476.638196:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d25b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d25ab expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521476.638224:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d25b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d25ab expref: 18 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521476.638236:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d25b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d25ab expref: 18 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521476.638245:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fc600, rc 0) 00000100:00100000:3.0:1788521476.638316:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7979ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:17196:x1875400222497664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (2012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521476.638330:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788521476.638507:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222497664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521476.638526:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef413fd200/0x411dd0ee4d2d25ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d25b2 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521476.638536:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef413fd200/0x411dd0ee4d2d25ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d25b2 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521476.638597:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222497792:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788521476.638633:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521476.638916:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef6d98b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788521476.639245:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222497792 00000100:00100000:2.0:1788521476.639259:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222497792 00000100:00100000:2.0:1788521476.639294:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788521476.639302:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef79799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:17196:x1875400222497792:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788521476.639318:0:17194:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788521476.639335:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788521476.639339:0:17194:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788521476.639453:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef79799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:17196:x1875400222497792:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 152us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521476.639461:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788521476.639592:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222497792:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788521476.639640:0:17196:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788521476.639648:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef413fd200/0x411dd0ee4d2d25ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d25b2 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521476.639657:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef413fd200/0x411dd0ee4d2d25ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d25b2 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788521476.943727:0:17953:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788521477.069194:0:17241:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef43200300 going to sleep for 0 seconds 00010000:00010000:0.0:1788521477.581432:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521478.094083:0:17241:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef43200300 going to sleep for 0 seconds 00010000:00010000:0.0:1788521478.606013:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521479.119393:0:17241:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef43200300 going to sleep for 0 seconds 00010000:00010000:0.0:1788521479.632367:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521479.826750:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222497920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788521479.826824:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521479.827143:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222497920 00000100:00100000:1.0:1788521479.827151:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222497920 00000100:00100000:1.0:1788521479.827203:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788521479.827213:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222497920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788521479.827245:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788521479.827306:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222497920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521479.827313:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788521479.827495:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222497920:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1788521480.039132:0:18200:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg341-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788521480.149439:0:17241:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef43200300 going to sleep for 0 seconds 00000100:00080000:3.0:1788521480.336526:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788521480.336533:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788521480.336536:0:8:0:(import.c:65:import_set_state_nolock()) ffff8fef81475000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788521480.336547:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8fef81475000 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:3.0:1788521480.336570:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fef7f0cad80 x1875400222498176/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788521480.336585:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788521480.336588:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788521480.336591:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788521480.336594:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788521480.336614:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788521480.336617:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788521480.336619:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788521480.336622:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788521480.336695:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3645:1875400222498048:0@lo:400:kworker.0 00000100:00100000:0.0:1788521480.336762:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521480.336822:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521480.336828:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222498304:0@lo:400:kworker.0 00000100:00100000:0.0:1788521480.336854:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521480.336900:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222498560:0@lo:400:kworker.0 00000100:00100000:0.0:1788521480.336923:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521480.336940:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788521480.336945:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222498432:0@lo:400:kworker.0 00000100:00100000:0.0:1788521480.336969:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521480.337000:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222498304 00000100:00100000:0.0:1788521480.337007:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222498304 00000100:00100000:0.0:1788521480.337045:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222498560 00000100:00100000:0.0:1788521480.337048:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222498560 00000100:00100000:0.0:1788521480.337064:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521480.337077:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222498304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521480.337124:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222498304:12345-0@lo:400:kworker.0 Request processed in 53us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521480.337130:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521480.337144:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521480.337150:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222498560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521480.337178:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222498560:12345-0@lo:400:kworker.0 Request processed in 29us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521480.337196:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521480.337216:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222498432 00000100:00100000:0.0:1788521480.337220:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222498432 00000100:00100000:0.0:1788521480.337243:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788521480.337248:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222498432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521480.337303:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222498432:12345-0@lo:400:kworker.0 Request processed in 54us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521480.337309:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788521480.337348:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222498432:0@lo:400:kworker.0 00010000:00080000:0.0:1788521480.337361:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fef7f0c8700 x1875400222498560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521480.337370:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222498560:0@lo:400:kworker.0 00010000:00080000:0.0:1788521480.337404:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fef7f0c8000 x1875400222498304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521480.337412:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222498304:0@lo:400:kworker.0 00000100:00100000:3.0:1788521480.338439:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222498048 00000100:00100000:3.0:1788521480.338448:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222498048 00000100:00100000:3.0:1788521480.338487:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788521480.338496:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7979b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:3645:x1875400222498048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521480.338555:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7979b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:3645:x1875400222498048:12345-0@lo:400:kworker.0 Request processed in 60us (1792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521480.338571:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788521480.338618:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3645:1875400222498048:0@lo:400:kworker.0 00000100:00100000:2.0:1788521480.340483:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222498176:0@lo:38:kworker.0 00000100:00100000:2.0:1788521480.340543:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521480.340662:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222498176 00000100:00100000:3.0:1788521480.340669:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222498176 00000100:00100000:3.0:1788521480.340708:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788521480.340715:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3642:x1875400222498176:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788521480.340743:0:17940:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:3.0:1788521480.340779:0:17940:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x411dd0ee4d2d25b9 00000004:00100000:3.0:1788521480.340796:0:17940:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788521480.340802:0:17940:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788521480.380820:0:17940:0:(import.c:65:import_set_state_nolock()) ffff8fef81666800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788521480.394323:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875400222498176:12345-0@lo:38:kworker.0 Request processed in 53599us (53771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521480.394337:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788521480.409797:0:3642:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788521480.409813:0:3642:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788521480.409820:0:3642:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788521480.409824:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef81475000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788521480.409854:0:3642:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000f432654d): req@ffff8fee43d22300 x1875400222491136/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521480.409912:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222498176:0@lo:38:kworker.0 00000100:00100000:0.0:1788521480.410026:0:17241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521480.410064:0:17241:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef43200300 going to sleep for 11 seconds 00000100:00100000:0.0:1788521480.410081:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222491136 00000100:00100000:0.0:1788521480.410087:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222491136 00000100:00100000:0.0:1788521480.410128:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788521480.410137:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17241:x1875400222491136:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788521480.410223:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17241:x1875400222491136:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 87us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521480.410230:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788521480.410268:0:17241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d22300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17241:1875400222491136:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788521480.410299:0:17241:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788521480.410339:0:17241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d22300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17241:1875400222498688:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788521480.410366:0:17241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521480.410384:0:17241:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef50e2d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788521480.410403:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222498688 00000100:00100000:0.0:1788521480.410406:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222498688 00000100:00100000:0.0:1788521480.410427:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788521480.410432:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17241:x1875400222498688:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788521480.410523:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17241:x1875400222498688:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 90us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521480.410530:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788521480.410554:0:17241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d22300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17241:1875400222498688:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788521480.410614:0:17241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d22300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17241:1875400222498816:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788521480.410646:0:17241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521480.410660:0:17241:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef50e2d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788521480.410671:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222498816 00000100:00100000:0.0:1788521480.410674:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222498816 00000100:00100000:0.0:1788521480.410693:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788521480.410698:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17241:x1875400222498816:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788521480.410739:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17241:x1875400222498816:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 41us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521480.410745:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788521480.410769:0:17241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d22300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17241:1875400222498816:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1788521480.410803:0:17241:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788521480.412808:0:17241:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788521480.412907:0:17241:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:0.0:1788521480.412912:0:17241:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:1.0:1788521480.416515:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222498944:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788521480.416598:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521480.427069:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222498944 00000100:00100000:0.0:1788521480.427085:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222498944 00000100:00100000:0.0:1788521480.427137:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788521480.427146:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1875400222498944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788521480.427192:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788521480.427285:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1875400222498944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (10687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521480.427293:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788521480.427348:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222498944:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788521480.653531:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788521481.128514:0:18252:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788521481.130144:0:18252:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788521481.677342:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788521482.128354:0:17234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1788521482.159680:0:18304:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788521482.159963:0:18304:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788521482.701050:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788521483.228562:0:18352:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff0b863ee0 20000000:00000080:2.0:1788521483.228580:0:18352:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8fef45598800 uarg=0000000000000000 20000000:01000000:2.0:1788521483.228617:0:18352:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788521483.228624:0:18352:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788521483.228629:0:18352:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788521483.229212:0:18353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1788521483.230168:0:18352:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788521483.242555:0:18352:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788521483.242749:0:18352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fef413fd800/0x411dd0ee4d2d25c0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521483.242772:0:18352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fee434abc00/0x411dd0ee4d2d2469 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2462 expref: 17 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521483.242782:0:18352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef413fc800/0x411dd0ee4d2d256c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2565 expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521483.242790:0:18352:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fef413fd800/0x411dd0ee4d2d25c0 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521483.242842:0:18352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef413fc800/0x411dd0ee4d2d256c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d2565 expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521483.242857:0:18352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fef413fc800/0x411dd0ee4d2d256c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2565 expref: 17 pid: 17194 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521483.242910:0:18352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18352:1875400222499072:0@lo:104: 00000100:00100000:3.0:1788521483.242966:0:18352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788521483.243014:0:18352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fee434abc00/0x411dd0ee4d2d2469 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d2462 expref: 17 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521483.243022:0:18352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fee434abc00/0x411dd0ee4d2d2469 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2462 expref: 17 pid: 17192 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521483.243030:0:18352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0ca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18352:1875400222499200:0@lo:104: 00000100:00100000:3.0:1788521483.243046:0:18352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521483.243061:0:18352:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef484e9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521483.243144:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222499072 00000100:00100000:1.0:1788521483.243151:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222499072 00000100:00100000:1.0:1788521483.243186:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222499200 00000100:00100000:1.0:1788521483.243188:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222499200 00000100:00100000:1.0:1788521483.243200:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788521483.243208:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+4:18352:x1875400222499072:12345-0@lo:104: 00010000:00010000:1.0:1788521483.243220:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fee434aa400/0x411dd0ee4d2d2565 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d256c expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521483.243289:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788521483.243295:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+4:18352:x1875400222499072:12345-0@lo:104: Request processed in 88us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521483.243311:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788521483.243331:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788521483.243337:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+3:18352:x1875400222499200:12345-0@lo:104: 00010000:00010000:1.0:1788521483.243344:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d800/0x411dd0ee4d2d2462 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d2469 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521483.243373:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788521483.243387:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+3:18352:x1875400222499200:12345-0@lo:104: Request processed in 51us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521483.243393:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788521483.243412:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788521483.243418:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fee434aa400/0x411dd0ee4d2d2565 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d256c expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521483.243437:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa400 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:1.0:1788521483.243441:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fee434aa400/0x411dd0ee4d2d2565 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d256c expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521483.243450:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fee434aa400/0x411dd0ee4d2d2565 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d256c expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521483.243457:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fee434aa400/0x411dd0ee4d2d2565 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d256c expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521483.243463:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788521483.243489:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fee434aa400/0x411dd0ee4d2d2565 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d256c expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521483.243496:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788521483.243512:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fee434aa400/0x411dd0ee4d2d2565 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d256c expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521483.243520:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fee434aa400/0x411dd0ee4d2d2565 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d256c expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521483.243532:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521483.243535:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d800/0x411dd0ee4d2d2462 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d2469 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521483.243540:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef7f12d800 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:1.0:1788521483.243543:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d800/0x411dd0ee4d2d2462 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d2469 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521483.243559:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d800/0x411dd0ee4d2d2462 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d2469 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521483.243566:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d800/0x411dd0ee4d2d2462 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d2469 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521483.243571:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788521483.243583:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d800/0x411dd0ee4d2d2462 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d2469 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521483.243588:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788521483.243601:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d800/0x411dd0ee4d2d2462 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d2469 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521483.243607:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d800/0x411dd0ee4d2d2462 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d2469 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521483.243620:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521483.243623:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521483.243625:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521483.243690:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521483.243708:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3646:1875400222499328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521483.243738:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521483.243778:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788521483.243785:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3644:1875400222499456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521483.243804:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521483.243824:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222499328 00000100:00100000:0.0:1788521483.243828:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222499328 00010000:00010000:0.0:1788521483.243846:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef413fc800/0x411dd0ee4d2d256c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2565 expref: 18 pid: 17194 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521483.243861:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222499456 00000100:00100000:0.0:1788521483.243863:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222499456 00010000:00010000:0.0:1788521483.243871:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fee434abc00/0x411dd0ee4d2d2469 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2462 expref: 19 pid: 17192 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521483.243902:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521483.243908:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+19:3646:x1875400222499328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521483.243917:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521483.243921:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef413fc800/0x411dd0ee4d2d256c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2565 expref: 19 pid: 17194 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521483.243932:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef413fc800/0x411dd0ee4d2d256c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2565 expref: 19 pid: 17194 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521483.243945:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521483.243967:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+19:3646:x1875400222499328:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521483.243973:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521483.243990:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521483.243995:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:3644:x1875400222499456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521483.244001:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521483.244005:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fee434abc00/0x411dd0ee4d2d2469 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2462 expref: 18 pid: 17192 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521483.244014:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fee434abc00/0x411dd0ee4d2d2469 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2462 expref: 18 pid: 17192 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521483.244025:0:17186:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fef413fd800/0x411dd0ee4d2d25c0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521483.244032:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef413fd800/0x411dd0ee4d2d25c0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521483.244046:0:17186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fef413fd800/0x411dd0ee4d2d25c0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521483.244052:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fef413fd800/0x411dd0ee4d2d25c0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521483.244060:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fef413fd800/0x411dd0ee4d2d25c0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521483.244066:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fef413fd800/0x411dd0ee4d2d25c0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521483.244072:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef413fd800 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:0.0:1788521483.244076:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fef413fd800/0x411dd0ee4d2d25c0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521483.244083:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fef413fd800/0x411dd0ee4d2d25c0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521483.244096:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fef413fd800/0x411dd0ee4d2d25c0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521483.244104:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521483.244126:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:3644:x1875400222499456:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521483.244131:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521483.244160:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3644:1875400222499456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521483.244177:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3646:1875400222499328:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788521483.244288:0:18352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef413fc800/0x411dd0ee4d2d256c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d2565 expref: 17 pid: 17194 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521483.244299:0:18352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18352:1875400222499072:0@lo:104: 00010000:00010000:3.0:1788521483.244307:0:18352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fee434abc00/0x411dd0ee4d2d2469 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d2462 expref: 16 pid: 17192 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521483.244314:0:18352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0ca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18352:1875400222499200:0@lo:104: 00010000:00010000:3.0:1788521483.244328:0:18352:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fef413fd800/0x411dd0ee4d2d25c0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521483.244337:0:18352:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fef413fd800/0x411dd0ee4d2d25c0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521483.244343:0:18352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fef413fd800/0x411dd0ee4d2d25c0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521483.244360:0:18352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef413fd800/0x411dd0ee4d2d25c0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521483.730459:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521484.430037:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788521474/real 1788521474] req@ffff8fee43598380 x1875400222494336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521484 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521484.430082:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fee43598380 x1875400222494336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521484 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521484.430093:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788521474/real 1788521474] req@ffff8fef7f0c8a80 x1875400222494080/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521484 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521484.430106:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fef7f0c8a80 x1875400222494080/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521484 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788521484.430124:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef6e4db000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788521484.430144:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788521484.430148:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222494336:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788521484.430153:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef7f05c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788521484.430158:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788521484.430161:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222494080:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788521484.430385:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1788521484.430386:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788521484.430390:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788521484.430392:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788521484.430395:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788521484.430398:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4359b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3643:1875400222499584:0@lo:400:kworker.0 00000100:00100000:1.0:1788521484.430469:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788521484.430484:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788521484.430491:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788521484.430493:0:8:0:(import.c:65:import_set_state_nolock()) ffff8fef7f05c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788521484.430498:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 524 00000100:00080000:2.0:1788521484.430502:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:1.0:1788521484.430506:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4359a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222499968:0@lo:400:kworker.0 00000100:00080000:2.0:1788521484.430508:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8fef7f05c800 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:2.0:1788521484.430528:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee4359aa00 x1875400222500096/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788521484.430531:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788521484.430541:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788521484.430544:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788521484.430546:0:8:0:(import.c:65:import_set_state_nolock()) ffff8fef6e4db000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788521484.430549:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 524 00000100:00080000:2.0:1788521484.430551:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788521484.430554:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8fef6e4db000 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:1.0:1788521484.430559:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222499584 00000100:00100000:2.0:1788521484.430564:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee43598e00 x1875400222500224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788521484.430566:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222499584 00000100:00100000:2.0:1788521484.430595:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222499712:0@lo:400:kworker.0 00000100:00100000:1.0:1788521484.430604:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788521484.430614:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef79798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+16:3643:x1875400222499584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521484.430622:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521484.430640:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788521484.430646:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222499840:0@lo:400:kworker.0 00000100:00100000:1.0:1788521484.430661:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef79798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+16:3643:x1875400222499584:12345-0@lo:400:kworker.0 Request processed in 49us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521484.430666:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521484.430668:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788521484.430800:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222500352:0@lo:400:kworker.0 00000100:00100000:2.0:1788521484.430815:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222499968 00000100:00100000:2.0:1788521484.430818:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222499968 00000100:00100000:0.0:1788521484.430828:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521484.430845:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222499712 00000100:00100000:2.0:1788521484.430848:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222499712 00000100:00100000:2.0:1788521484.430861:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788521484.430866:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788521484.430867:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222499968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521484.430873:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1875400222499712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521484.430929:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1875400222499712:12345-0@lo:400:kworker.0 Request processed in 57us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521484.430936:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788521484.430994:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222499840 00000100:00100000:1.0:1788521484.430998:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222499840 00000100:00100000:1.0:1788521484.431018:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222500352 00000100:00100000:1.0:1788521484.431020:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222500352 00000100:00100000:1.0:1788521484.431033:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788521484.431038:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222499840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521484.431172:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222499840:12345-0@lo:400:kworker.0 Request processed in 132us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521484.431178:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788521484.431191:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788521484.431198:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222500352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521484.431225:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222499968:12345-0@lo:400:kworker.0 Request processed in 357us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521484.431225:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222500352:12345-0@lo:400:kworker.0 Request processed in 27us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521484.431231:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788521484.431232:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788521484.431304:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fee43598380 x1875400222500352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521484.431316:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43598380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222500352:0@lo:400:kworker.0 00010000:00080000:2.0:1788521484.431333:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fee43598700 x1875400222499840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521484.431342:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222499840:0@lo:400:kworker.0 00000100:00100000:2.0:1788521484.431353:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222499712:0@lo:400:kworker.0 00000100:00100000:2.0:1788521484.431385:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4359aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222500096:0@lo:8:kworker.0 00000400:00000100:2.0:1788521484.431775:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875400222500096 offset 0 length 520: 4 00000100:00100000:2.0:1788521484.431802:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222500224:0@lo:8:kworker.0 00000400:00000100:2.0:1788521484.431821:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875400222500224 offset 0 length 520: 4 00000100:00100000:2.0:1788521484.431855:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4359a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222499968:0@lo:400:kworker.0 00000100:00100000:2.0:1788521484.431864:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4359b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3643:1875400222499584:0@lo:400:kworker.0 00010000:00010000:0.0:1788521484.749246:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521484.950440:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4359b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222500480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788521484.950508:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521484.950563:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222500480 00000100:00100000:2.0:1788521484.950571:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222500480 00000100:00100000:2.0:1788521484.950611:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788521484.950620:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222500480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788521484.950652:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788521484.950696:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222500480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521484.950703:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788521484.950760:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4359b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222500480:0@lo:41:osp-pre-0-1.0 10000000:01000000:0.0:1788521485.197557:0:17196:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788521485.197564:0:17196:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fef7a3b2800 from 13 10000000:01000000:0.0:1788521485.197570:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788521485.197616:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef7f12c600/0x411dd0ee4d2d25c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521485.197627:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef7f12c600/0x411dd0ee4d2d25c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521485.197637:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef7f12c600/0x411dd0ee4d2d25c7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521485.197659:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e2b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222500608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788521485.197718:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521485.197755:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef6da1a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521485.197799:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222500608 00000100:00100000:3.0:1788521485.197806:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222500608 00000100:00100000:3.0:1788521485.197852:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788521485.197861:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7979a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+16:17196:x1875400222500608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521485.197873:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521485.197912:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef413fd800/0x411dd0ee4d2d25ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d25c7 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521485.197946:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef413fd800/0x411dd0ee4d2d25ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d25c7 expref: 17 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521485.197957:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef413fd800/0x411dd0ee4d2d25ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d25c7 expref: 17 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521485.197968:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fd800, rc 0) 00000100:00100000:3.0:1788521485.198017:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7979a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+17:17196:x1875400222500608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521485.198024:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788521485.198173:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e2b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222500608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521485.198193:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef7f12c600/0x411dd0ee4d2d25c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d25ce expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521485.198202:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef7f12c600/0x411dd0ee4d2d25c7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d25ce expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521485.198259:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e2b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222500736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521485.198284:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521485.198307:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef6da1a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521485.198337:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222500736 00000100:00100000:1.0:1788521485.198342:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222500736 00000100:00100000:1.0:1788521485.198942:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788521485.198953:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef79798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+17:17196:x1875400222500736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521485.199072:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef79798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+17:17196:x1875400222500736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521485.199079:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788521485.200079:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e2b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222500736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521485.200127:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222500864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521485.200224:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521485.200357:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee4241f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788521485.200400:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222500864 00000100:00100000:0.0:1788521485.200406:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222500864 00000100:00100000:0.0:1788521485.200476:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788521485.200485:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef79798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+17:17196:x1875400222500864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521485.200584:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef79798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+17:17196:x1875400222500864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521485.200590:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788521485.200661:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222500864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788521485.202026:0:18436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788521485.202314:0:17196:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788521485.202339:0:17196:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788521485.202349:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef7f12c600/0x411dd0ee4d2d25c7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d25ce expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521485.202369:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef7f12c600/0x411dd0ee4d2d25c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d25ce expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521485.202379:0:17196:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788521485.202382:0:17196:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fef48513800 from 13 10000000:01000000:1.0:1788521485.202386:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788521485.202416:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434ab000/0x411dd0ee4d2d25d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521485.202424:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fee434ab000/0x411dd0ee4d2d25d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521485.202433:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fee434ab000/0x411dd0ee4d2d25d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521485.202453:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222500992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788521485.202503:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521485.202574:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee4241f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788521485.202617:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222500992 00000100:00100000:0.0:1788521485.202623:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222500992 00000100:00100000:0.0:1788521485.203637:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788521485.203653:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef79799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+17:17196:x1875400222500992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521485.203669:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521485.203685:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef7f12dc00/0x411dd0ee4d2d25dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d25d5 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521485.203718:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef7f12dc00/0x411dd0ee4d2d25dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d25d5 expref: 18 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521485.203748:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef7f12dc00/0x411dd0ee4d2d25dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d25d5 expref: 18 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521485.203845:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef7f12dc00, rc 0) 00000100:00100000:0.0:1788521485.204125:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef79799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:17196:x1875400222500992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 477us (1621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521485.204132:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788521485.204780:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222500992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521485.204801:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fee434ab000/0x411dd0ee4d2d25d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d25dc expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521485.204812:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fee434ab000/0x411dd0ee4d2d25d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d25dc expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521485.204914:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222501120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521485.204963:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521485.204997:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef484e9240 going to sleep for 11 seconds 00000100:00100000:0.0:1788521485.205849:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222501120 00000100:00100000:0.0:1788521485.205857:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222501120 00000100:00100000:0.0:1788521485.205922:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788521485.206089:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7979b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:17196:x1875400222501120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521485.209492:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7979b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:17196:x1875400222501120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3398us (4518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521485.209508:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788521485.213520:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222501120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521485.213585:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222501248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521485.213820:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521485.213912:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee4241fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521485.214170:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222501248 00000100:00100000:0.0:1788521485.214177:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222501248 00000100:00100000:0.0:1788521485.214335:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788521485.214346:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7979a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:17196:x1875400222501248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521485.214476:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7979a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:17196:x1875400222501248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521485.214483:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788521485.214605:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222501248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788521485.218357:0:18438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788521485.221313:0:17196:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788521485.221353:0:17196:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788521485.221374:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434ab000/0x411dd0ee4d2d25d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d25dc expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521485.221386:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fee434ab000/0x411dd0ee4d2d25d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d25dc expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521485.452980:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788521470/real 1788521470] req@ffff8fee43d22d80 x1875400222492160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521485 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521485.453009:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fee43d22d80 x1875400222492160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521485 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521485.453019:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788521470/real 1788521470] req@ffff8fee43d23100 x1875400222492288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521485 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521485.453029:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fee43d23100 x1875400222492288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521485 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788521485.453047:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef48537800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788521485.453066:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788521485.453070:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222492160:0@lo:8:kworker.0 00000100:00080000:2.0:1788521485.453075:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef81580800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788521485.453080:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788521485.453083:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222492288:0@lo:8:kworker.0 00000100:00100000:1.0:1788521485.455345:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222501376:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788521485.455427:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521485.455484:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222501376 00000100:00100000:1.0:1788521485.455492:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222501376 00000100:00100000:1.0:1788521485.455533:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788521485.455542:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875400222501376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788521485.455573:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788521485.455618:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875400222501376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521485.455625:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788521485.455682:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222501376:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1788521485.457938:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788521485.457947:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788521485.457951:0:37:0:(import.c:65:import_set_state_nolock()) ffff8fef48537800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788521485.457969:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 520 00000100:00080000:0.0:1788521485.457976:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788521485.457983:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8fef48537800 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:0.0:1788521485.458020:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee43e2b100 x1875400222501504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788521485.458045:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788521485.458048:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788521485.458050:0:37:0:(import.c:65:import_set_state_nolock()) ffff8fef81580800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788521485.458053:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 520 00000100:00080000:0.0:1788521485.458055:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788521485.458058:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8fef81580800 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:0.0:1788521485.458068:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee43e28000 x1875400222501632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788521485.458092:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788521485.458096:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788521485.458098:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788521485.458100:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788521485.458145:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222501760:0@lo:400:kworker.0 00000100:00100000:0.0:1788521485.458210:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521485.458259:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788521485.458266:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875400222501888:0@lo:400:kworker.0 00000100:00100000:0.0:1788521485.458288:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521485.458320:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222501760 00000100:00100000:0.0:1788521485.458327:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222501760 00000100:00100000:0.0:1788521485.458383:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222501888 00000100:00100000:0.0:1788521485.458387:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222501888 00000100:00100000:0.0:1788521485.458409:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788521485.458417:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222501760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521485.458478:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875400222501760:12345-0@lo:400:kworker.0 Request processed in 62us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521485.458485:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788521485.458500:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788521485.458506:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875400222501888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521485.458530:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875400222501888:12345-0@lo:400:kworker.0 Request processed in 25us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521485.458535:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788521485.458569:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fee43e29c00 x1875400222501888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521485.458581:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875400222501888:0@lo:400:kworker.0 00010000:00080000:0.0:1788521485.458597:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fee43e2aa00 x1875400222501760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521485.458604:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875400222501760:0@lo:400:kworker.0 00000100:00100000:0.0:1788521485.458630:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222501504:0@lo:8:kworker.0 00000400:00000100:0.0:1788521485.458651:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875400222501504 offset 0 length 520: 4 00000100:00100000:0.0:1788521485.458672:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222501632:0@lo:8:kworker.0 00000400:00000100:0.0:1788521485.458687:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875400222501632 offset 0 length 520: 4 00010000:00010000:1.0:1788521485.773144:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788521485.972802:0:17931:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:1.0:1788521486.160111:0:17953:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788521486.797244:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521487.831671:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521488.851446:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521489.869630:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521490.066832:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4359b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222502016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788521490.067762:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521490.068778:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222502016 00000100:00100000:1.0:1788521490.068789:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222502016 00000100:00100000:1.0:1788521490.068846:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788521490.068855:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222502016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788521490.069003:0:17940:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788521490.069070:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222502016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 214us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521490.069078:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788521490.070560:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4359b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222502016:0@lo:41:osp-pre-0-1.0 00000020:01000004:3.0:1788521490.213557:0:18700:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788521490.213561:0:18700:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788521490.213563:0:18700:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788521490.213664:0:18700:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8fef4e7ac800 00000020:01000004:3.0:1788521490.213679:0:18700:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788521490.213692:0:18700:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788521490.213704:0:18700:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8fee426d0000) 00000020:00000080:3.0:1788521490.213718:0:18700:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788521490.272039:0:18700:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788521490.273787:0:18700:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788521490.274742:0:18700:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788521490.275273:0:18700:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788521490.275516:0:18700:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788521490.275729:0:18700:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788521490.276242:0:18700:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:1.0:1788521490.278780:0:18700:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788521490.279426:0:18700:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788521490.279441:0:18700:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788521490.279454:0:18700:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x411dd0ee4d2d25ea 00000020:01000004:1.0:1788521490.279461:0:18700:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788521490.279483:0:18700:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.141@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788521490.279487:0:18700:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788521490.279494:0:18700:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788521490.279499:0:18700:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788521490.279521:0:18700:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8fef46a099c0) 00000020:00000080:1.0:1788521490.279536:0:18700:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1788521490.282277:0:18700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788521490.283361:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788521490.283368:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788521490.291632:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788521490.291648:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788521490.292455:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788521490.292465:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788521490.298003:0:18700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788521490.298318:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788521490.298338:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788521490.303304:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788521490.303325:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788521490.376398:0:18700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788521490.376641:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788521490.376648:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788521490.381495:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788521490.381508:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788521490.382354:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788521490.382363:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788521490.399704:0:18700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521490.400113:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788521490.400120:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788521490.400840:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788521490.400848:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788521490.507759:0:18700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521490.510371:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788521490.510395:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788521490.523067:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788521490.523084:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788521490.524435:0:18700:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788521490.524464:0:18700:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788521490.524470:0:18700:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.141@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000100:00080000:1.0:1788521490.573285:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788521490.573292:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788521490.573296:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788521490.573299:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788521490.573310:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788521490.573321:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788521490.573337:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788521490.573341:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788521490.573379:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222502272:0@lo:400:kworker.0 00000100:00100000:1.0:1788521490.573379:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222502528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788521490.573379:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875400222502400:0@lo:400:kworker.0 00000100:00100000:3.0:1788521490.573963:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3646:1875400222502144:0@lo:400:kworker.0 00000100:00100000:0.0:1788521490.577376:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521490.579092:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521490.579161:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222502272 00000100:00100000:2.0:1788521490.579171:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222502272 00000100:00100000:2.0:1788521490.579225:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788521490.579235:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222502272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521490.579295:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222502272:12345-0@lo:400:kworker.0 Request processed in 62us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521490.579303:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788521490.579380:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222502272:0@lo:400:kworker.0 00000040:01000000:2.0:1788521490.579428:0:18700:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.141@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788521490.579630:0:18700:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.141@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788521490.579634:0:18700:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788521490.579636:0:18700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788521490.579637:0:18700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521490.579638:0:18700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521490.579771:0:18700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521490.579773:0:18700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521490.579774:0:18700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788521490.579776:0:18700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521490.579778:0:18700:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788521490.579781:0:18700:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788521490.579784:0:18700:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788521490.579785:0:18700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788521490.579786:0:18700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521490.579788:0:18700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521490.579789:0:18700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521490.579790:0:18700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521490.579791:0:18700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788521490.579792:0:18700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521490.579793:0:18700:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788521490.580052:0:18700:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788521490.580071:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43598a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222502784:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788521490.580119:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521490.580149:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef42bb2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521490.583780:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521490.583922:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222502784 00000100:00100000:2.0:1788521490.583923:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222502528 00000100:00100000:2.0:1788521490.583933:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222502528 00000100:00100000:1.0:1788521490.583933:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222502784 00000100:00100000:1.0:1788521490.583987:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788521490.583997:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef79798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:18700:x1875400222502784:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788521490.584052:0:17194:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788521490.584056:0:17194:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788521490.584059:0:17194:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788521490.584183:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788521490.584192:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222502528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788521490.584218:0:17940:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788521490.584270:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222502528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521490.584277:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788521490.584336:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222502528:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788521490.584386:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222502400 00000100:00100000:2.0:1788521490.584391:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222502400 00000100:00100000:2.0:1788521490.584435:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788521490.584442:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875400222502400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521490.584477:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875400222502400:12345-0@lo:400:kworker.0 Request processed in 36us (7109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521490.584484:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788521490.585486:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fef715a0000 x1875400222502400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521490.585502:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875400222502400:0@lo:400:kworker.0 00000100:00100000:2.0:1788521490.586388:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef79798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:18700:x1875400222502784:12345-0@lo:253:mount.lustre.0 Request processed in 2389us (6264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521490.586398:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788521490.586633:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43598a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222502784:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788521490.586647:0:18700:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788521490.586650:0:18700:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788521490.586652:0:18700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788521490.586653:0:18700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788521490.586655:0:18700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788521490.586656:0:18700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788521490.586657:0:18700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788521490.586658:0:18700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788521490.586660:0:18700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788521490.586661:0:18700:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788521490.586678:0:18700:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8fef4e7ac800 from lustre-OST0000 10000000:01000000:1.0:1788521490.586708:0:18700:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788521490.586710:0:18700:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788521490.586717:0:18700:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8fee421399c0 local copy 00010000:00010000:1.0:1788521490.586726:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d23a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d23ac expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521490.586848:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222502912:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788521490.586998:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521490.587033:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4853c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788521490.587527:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222502912 00000100:00100000:0.0:1788521490.587535:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222502912 00000100:00100000:0.0:1788521490.587584:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788521490.587593:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a5fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:18700:x1875400222502912:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788521490.587681:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a5fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:18700:x1875400222502912:12345-0@lo:501:mount.lustre.0 Request processed in 89us (683us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788521490.587688:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788521490.587714:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222502912:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788521490.587729:0:18700:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788521490.587749:0:18700:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788521490.587757:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d23a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d23ac expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521490.587766:0:18700:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d23a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d23ac expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521490.587792:0:18700:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8fef4e7ac800 10000000:01000000:1.0:1788521490.587797:0:18700:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788521490.587802:0:18700:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788521490.587804:0:18700:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788521490.587809:0:18700:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788521490.587812:0:18700:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788521490.587838:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434aa400/0x411dd0ee4d2d25f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521490.587846:0:18700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fee434aa400/0x411dd0ee4d2d25f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521490.587856:0:18700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fee434aa400/0x411dd0ee4d2d25f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521490.587982:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222503040:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788521490.588013:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521490.588046:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4853c300 going to sleep for 11 seconds 00000100:00100000:3.0:1788521490.588271:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222503040 00000100:00100000:3.0:1788521490.588277:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222503040 00000100:00100000:3.0:1788521490.588311:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788521490.588319:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+18:18700:x1875400222503040:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788521490.588338:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521490.588352:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef413fce00/0x411dd0ee4d2d25ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d25f8 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521490.588375:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef413fce00/0x411dd0ee4d2d25ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d25f8 expref: 19 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521490.588385:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef413fce00/0x411dd0ee4d2d25ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d25f8 expref: 19 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521490.588393:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fce00, rc 0) 00000100:00100000:3.0:1788521490.588437:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+19:18700:x1875400222503040:12345-0@lo:101:mount.lustre.0 Request processed in 119us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521490.588444:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788521490.588927:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521490.588963:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875400222502656:0@lo:400:kworker.0 00000100:00100000:3.0:1788521490.588992:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222502144 00000100:00100000:3.0:1788521490.588998:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222502144 00000100:00100000:3.0:1788521490.589033:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788521490.589040:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+19:3646:x1875400222502144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521490.589073:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+19:3646:x1875400222502144:12345-0@lo:400:kworker.0 Request processed in 34us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521490.589081:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788521490.589208:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521490.589251:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222502656 00000100:00100000:2.0:1788521490.589256:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222502656 00000100:00100000:2.0:1788521490.589302:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788521490.589311:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875400222502656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521490.589360:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875400222502656:12345-0@lo:400:kworker.0 Request processed in 49us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521490.589375:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788521490.589415:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fef715a0e00 x1875400222502656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521490.589430:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222503040:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788521490.589431:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875400222502656:0@lo:400:kworker.0 00010000:00010000:0.0:1788521490.589456:0:18700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fee434aa400/0x411dd0ee4d2d25f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d25ff expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521490.589462:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3646:1875400222502144:0@lo:400:kworker.0 00010000:00010000:0.0:1788521490.589471:0:18700:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fee434aa400/0x411dd0ee4d2d25f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d25ff expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788521490.594670:0:18700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788521490.595523:0:18700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788521490.601359:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788521490.601419:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788521490.601435:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788521490.601451:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788521490.601464:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788521490.601478:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788521490.601505:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788521490.601511:0:18700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788521490.601637:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43599c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222503168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521490.601703:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521490.601752:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef6dbc2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521490.602209:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222503168 00000100:00100000:1.0:1788521490.602216:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222503168 00000100:00100000:1.0:1788521490.602271:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788521490.602281:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+19:18700:x1875400222503168:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788521490.602440:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+19:18700:x1875400222503168:12345-0@lo:501:mount.lustre.0 Request processed in 160us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521490.602449:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788521490.603070:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43599c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222503168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521490.603235:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43599c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222503296:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788521490.603286:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521490.603317:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef6dbc2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521490.605492:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222503296 00000100:00100000:1.0:1788521490.605505:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222503296 00000100:00100000:1.0:1788521490.605570:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788521490.605581:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+19:18700:x1875400222503296:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788521490.607817:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+19:18700:x1875400222503296:12345-0@lo:503:mount.lustre.0 Request processed in 2231us (4523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521490.607829:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788521490.608012:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43599c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222503296:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788521490.608515:0:18700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788521490.608594:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43599c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222503424:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788521490.608650:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521490.608693:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef6dbc2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521490.609380:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222503424 00000100:00100000:1.0:1788521490.609388:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222503424 00000100:00100000:1.0:1788521490.609439:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788521490.609447:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+19:18700:x1875400222503424:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788521490.611013:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+19:18700:x1875400222503424:12345-0@lo:502:mount.lustre.0 Request processed in 1559us (2355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521490.611026:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788521490.611061:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43599c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222503424:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788521490.611495:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788521490.611528:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788521490.611541:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788521490.611552:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788521490.611562:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788521490.611590:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788521490.611603:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788521490.611613:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788521490.611623:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788521490.611633:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788521490.611642:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788521490.611652:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788521490.611685:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43599c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222503552:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788521490.611728:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521490.611768:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef6dbc2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521490.613171:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222503552 00000100:00100000:1.0:1788521490.613207:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222503552 00000100:00100000:1.0:1788521490.613264:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788521490.613274:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+19:18700:x1875400222503552:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788521490.613457:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+19:18700:x1875400222503552:12345-0@lo:502:mount.lustre.0 Request processed in 183us (1727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521490.613465:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788521490.613601:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43599c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222503552:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788521490.613680:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788521490.613694:0:18700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1788521490.615207:0:18717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788521490.615217:0:18717:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788521490.615224:0:18717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521490.615227:0:18717:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788521490.615233:0:18717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788521490.615248:0:18717:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8fef6da84d40) 00000020:00000080:0.0:1788521490.615275:0:18717:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788521490.615282:0:18717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788521490.615382:0:18717:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fef4e7ac800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788521490.615405:0:18717:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788521490.615412:0:18717:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x411dd0ee4d2d260d 00010000:00010000:1.0:1788521490.619230:0:18717:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1788521490.620012:0:18717:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1788521490.622807:0:18717:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1788521490.629371:0:18717:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788521490.629384:0:18717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521490.629391:0:18717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521490.629393:0:18717:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788521490.629397:0:18717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788521490.629400:0:18717:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1788521490.629401:0:18717:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788521490.629403:0:18717:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788521490.629404:0:18717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788521490.629406:0:18717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521490.629408:0:18717:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788521490.629411:0:18717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521490.629413:0:18717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521490.629414:0:18717:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788521490.629418:0:18717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788521490.629420:0:18717:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788521490.629422:0:18717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521490.629424:0:18717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521490.629425:0:18717:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788521490.629427:0:18717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521490.629430:0:18717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521490.629431:0:18717:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788521490.629434:0:18717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788521490.629463:0:18717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521490.629466:0:18717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521490.629467:0:18717:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788521490.629470:0:18717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788521490.629580:0:18700:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788521490.629613:0:18700:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788521490.629634:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434aa400/0x411dd0ee4d2d25f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d25ff expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521490.629647:0:18700:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fee434aa400/0x411dd0ee4d2d25f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d25ff expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521490.629655:0:18700:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fef4e7ac800 from 1 10000000:01000000:2.0:1788521490.629659:0:18700:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788521490.629693:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef457f2e00/0x411dd0ee4d2d2614 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521490.629711:0:18700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef457f2e00/0x411dd0ee4d2d2614 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521490.629723:0:18700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef457f2e00/0x411dd0ee4d2d2614 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521490.629750:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222503680:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788521490.629814:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521490.629855:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef6dbc2840 going to sleep for 11 seconds 00000100:00100000:1.0:1788521490.629980:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222503680 00000100:00100000:1.0:1788521490.629988:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222503680 00000100:00100000:1.0:1788521490.630032:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788521490.630042:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+19:18700:x1875400222503680:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788521490.630055:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521490.630067:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fee434ab400/0x411dd0ee4d2d261b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d2614 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521490.630090:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fee434ab400/0x411dd0ee4d2d261b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2614 expref: 20 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521490.630102:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fee434ab400/0x411dd0ee4d2d261b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2614 expref: 20 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521490.630110:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434ab400, rc 0) 00000100:00100000:1.0:1788521490.630160:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+20:18700:x1875400222503680:12345-0@lo:101:mount.lustre.0 Request processed in 119us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521490.630168:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788521490.630366:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222503680:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521490.630381:0:18700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef457f2e00/0x411dd0ee4d2d2614 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d261b expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521490.630390:0:18700:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef457f2e00/0x411dd0ee4d2d2614 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d261b expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788521490.632731:0:18700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788521490.633048:0:18700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788521490.634229:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788521490.634266:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788521490.634291:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788521490.634297:0:18700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788521490.634411:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222503808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788521490.634492:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521490.634538:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef50e2d480 going to sleep for 11 seconds 00000100:00100000:2.0:1788521490.634773:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222503808 00000100:00100000:2.0:1788521490.634781:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222503808 00000100:00100000:2.0:1788521490.634877:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788521490.634915:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+20:18700:x1875400222503808:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521490.635029:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+20:18700:x1875400222503808:12345-0@lo:501:mount.lustre.0 Request processed in 117us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521490.635036:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788521490.635131:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222503808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788521490.635164:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222503936:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788521490.635213:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521490.643763:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222503936 00000100:00100000:1.0:1788521490.643793:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222503936 00000100:00100000:1.0:1788521490.643850:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788521490.643858:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+20:18700:x1875400222503936:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788521490.644016:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+20:18700:x1875400222503936:12345-0@lo:503:mount.lustre.0 Request processed in 158us (8801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521490.644025:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788521490.646535:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef50e2d480 going to sleep for 11 seconds 00000100:00100000:3.0:1788521490.646581:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222503936:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788521490.647028:0:18700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788521490.647867:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222504064:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788521490.647973:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521490.648005:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4133a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788521490.648422:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222504064 00000100:00100000:1.0:1788521490.648430:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222504064 00000100:00100000:1.0:1788521490.648482:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788521490.648491:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+20:18700:x1875400222504064:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788521490.648702:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+20:18700:x1875400222504064:12345-0@lo:502:mount.lustre.0 Request processed in 212us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521490.648709:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788521490.648806:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222504064:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788521490.649484:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788521490.649521:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788521490.649536:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788521490.649559:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788521490.649574:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788521490.649590:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788521490.649604:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788521490.649619:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1788521490.649633:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788521490.649647:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1788521490.649662:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1788521490.649695:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222504192:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788521490.649745:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521490.649831:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4133a780 going to sleep for 11 seconds 00000100:00100000:3.0:1788521490.653762:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222504192 00000100:00100000:3.0:1788521490.653778:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222504192 00000100:00100000:3.0:1788521490.654022:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788521490.654047:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+20:18700:x1875400222504192:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788521490.654587:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+20:18700:x1875400222504192:12345-0@lo:502:mount.lustre.0 Request processed in 540us (4840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521490.654596:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788521490.654680:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222504192:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788521490.654768:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1788521490.654782:0:18700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788521490.656018:0:18721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521490.656030:0:18721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521490.656033:0:18721:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788521490.656041:0:18721:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fef4e7ac800 00000020:00000080:0.0:1788521490.656044:0:18721:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788521490.656051:0:18721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521490.656054:0:18721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521490.656055:0:18721:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788521490.656058:0:18721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521490.656060:0:18721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521490.656062:0:18721:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788521490.656065:0:18721:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fef4e7ac800 00000020:00000080:0.0:1788521490.656075:0:18721:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788521490.656146:0:18721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521490.656150:0:18721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521490.656151:0:18721:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788521490.656154:0:18721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521490.656156:0:18721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521490.656158:0:18721:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788521490.656161:0:18721:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fef4e7ac800 00000020:00000080:0.0:1788521490.656163:0:18721:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788521490.656181:0:18721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521490.656183:0:18721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521490.656184:0:18721:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788521490.656187:0:18721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521490.656189:0:18721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521490.656190:0:18721:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788521490.656193:0:18721:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fef4e7ac800 00000020:00000080:0.0:1788521490.656195:0:18721:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788521490.656216:0:18721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521490.656220:0:18721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521490.656221:0:18721:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788521490.656224:0:18721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1788521490.657968:0:18700:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788521490.658013:0:18700:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788521490.658043:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef457f2e00/0x411dd0ee4d2d2614 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d261b expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521490.658056:0:18700:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef457f2e00/0x411dd0ee4d2d2614 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d261b expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521490.658128:0:18700:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788521490.658132:0:18700:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8fef4e7ac800 10000000:01000000:2.0:1788521490.658135:0:18700:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8fef4e7ac800 10000000:01000000:2.0:1788521490.658138:0:18700:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788521490.658144:0:18700:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fef4e7ac800 from 1 10000000:01000000:2.0:1788521490.658146:0:18700:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788521490.658182:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef457f3c00/0x411dd0ee4d2d2622 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521490.658190:0:18700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef457f3c00/0x411dd0ee4d2d2622 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521490.658200:0:18700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef457f3c00/0x411dd0ee4d2d2622 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521490.658225:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222504320:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788521490.658290:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521490.658343:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef6dbc2540 going to sleep for 11 seconds 00000100:00100000:2.0:1788521490.660649:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222504320 00000100:00100000:2.0:1788521490.660662:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222504320 00000100:00100000:2.0:1788521490.660719:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788521490.660729:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+20:18700:x1875400222504320:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521490.660744:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521490.660759:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef457f2800/0x411dd0ee4d2d2629 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d2622 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521490.660793:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef457f2800/0x411dd0ee4d2d2629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2622 expref: 21 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521490.660805:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef457f2800/0x411dd0ee4d2d2629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2622 expref: 21 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521490.660813:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef457f2800, rc 0) 00000100:00100000:2.0:1788521490.660905:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:18700:x1875400222504320:12345-0@lo:101:mount.lustre.0 Request processed in 156us (2593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521490.660912:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788521490.660969:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222504320:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521490.660986:0:18700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef457f3c00/0x411dd0ee4d2d2622 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2629 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521490.660995:0:18700:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef457f3c00/0x411dd0ee4d2d2622 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d2629 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788521490.671238:0:18700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1788521490.671569:0:18700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788521490.671764:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788521490.671789:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788521490.671803:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788521490.671815:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788521490.671827:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788521490.671840:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788521490.671853:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788521490.671879:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788521490.671927:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788521490.671941:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788521490.671954:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788521490.671966:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788521490.671978:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788521490.671990:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788521490.672001:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788521490.672013:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788521490.672024:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788521490.672035:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788521490.672047:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788521490.672058:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788521490.672069:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788521490.672081:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788521490.672106:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788521490.672135:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788521490.672151:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1788521490.672181:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1788521490.672193:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1788521490.672203:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1788521490.672213:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1788521490.672225:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1788521490.672236:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1788521490.672249:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1788521490.672260:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1788521490.672272:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1788521490.672284:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1788521490.672296:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1788521490.672309:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1788521490.672339:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1788521490.672345:0:18700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1788521490.672427:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222504448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788521490.672490:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521490.672538:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4e6cc840 going to sleep for 11 seconds 00000100:00100000:0.0:1788521490.672938:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222504448 00000100:00100000:0.0:1788521490.672946:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222504448 00000100:00100000:0.0:1788521490.672997:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788521490.673006:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:18700:x1875400222504448:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788521490.673206:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:18700:x1875400222504448:12345-0@lo:501:mount.lustre.0 Request processed in 200us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521490.673214:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788521490.673714:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222504448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788521490.673753:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222504576:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788521490.673799:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521490.673836:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4e6cc840 going to sleep for 11 seconds 00000100:00100000:0.0:1788521490.674418:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222504576 00000100:00100000:0.0:1788521490.674426:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222504576 00000100:00100000:0.0:1788521490.674461:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788521490.674470:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:18700:x1875400222504576:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788521490.674583:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:18700:x1875400222504576:12345-0@lo:503:mount.lustre.0 Request processed in 113us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521490.674590:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788521490.674676:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222504576:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788521490.676250:0:18700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788521490.676357:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222504704:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788521490.676424:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521490.676458:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef6dbc2540 going to sleep for 11 seconds 00000100:00100000:3.0:1788521490.676808:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222504704 00000100:00100000:3.0:1788521490.676817:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222504704 00000100:00100000:3.0:1788521490.676863:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788521490.676874:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:18700:x1875400222504704:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788521490.677023:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:18700:x1875400222504704:12345-0@lo:502:mount.lustre.0 Request processed in 150us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521490.677031:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788521490.677258:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222504704:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788521490.677477:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788521490.677505:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788521490.677532:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788521490.677546:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788521490.677558:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788521490.677571:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788521490.677585:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788521490.677598:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788521490.677626:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788521490.677642:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788521490.677656:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788521490.677670:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788521490.677684:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788521490.677698:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788521490.677712:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788521490.677727:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788521490.677741:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788521490.677757:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788521490.677771:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788521490.677786:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788521490.677800:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788521490.677814:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788521490.677828:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788521490.677840:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788521490.677863:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788521490.677877:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788521490.680418:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788521490.680444:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788521490.680455:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788521490.680467:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788521490.680477:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788521490.680488:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788521490.680498:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788521490.680509:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788521490.680520:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788521490.680542:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788521490.680555:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788521490.680568:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788521490.680579:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788521490.680589:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788521490.680615:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788521490.680627:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788521490.680638:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788521490.680648:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788521490.680658:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788521490.680667:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788521490.680678:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788521490.680688:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788521490.680743:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222504832:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788521490.680813:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521490.680857:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef51dce540 going to sleep for 11 seconds 00000100:00100000:2.0:1788521490.680929:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222504832 00000100:00100000:2.0:1788521490.680935:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222504832 00000100:00100000:2.0:1788521490.680974:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788521490.680981:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:18700:x1875400222504832:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788521490.681084:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:18700:x1875400222504832:12345-0@lo:502:mount.lustre.0 Request processed in 102us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521490.681092:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788521490.681144:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222504832:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788521490.681298:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788521490.681318:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788521490.681353:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222504960:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788521490.681385:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521490.681406:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef51dce540 going to sleep for 11 seconds 00000100:00100000:0.0:1788521490.681481:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222504960 00000100:00100000:0.0:1788521490.681485:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222504960 00000100:00100000:0.0:1788521490.681516:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788521490.681522:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:18700:x1875400222504960:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788521490.681591:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:18700:x1875400222504960:12345-0@lo:502:mount.lustre.0 Request processed in 69us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521490.681597:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788521490.683488:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222504960:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788521490.683574:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788521490.683586:0:18700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788521490.693970:0:18727:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788521490.693988:0:18727:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8fef46a0b380) 00000020:00000080:1.0:1788521490.694012:0:18727:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1788521490.694083:0:18727:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fef4e7ac800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788521490.694087:0:18727:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fef4e7ac800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788521490.694089:0:18727:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fef4e7ac800 3 00010000:00080000:1.0:1788521490.694121:0:18727:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fef5a9e9800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.141@tcp at head 00010000:00010000:1.0:1788521490.695712:0:18727:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1788521490.695947:0:18727:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788521490.695985:0:18727:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788521490.696001:0:18727:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x411dd0ee4d2d2637 00000100:00080000:1.0:1788521490.696011:0:18727:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788521490.696017:0:18727:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8fef5a9e9800 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:1.0:1788521490.696050:0:18727:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fef715a2d80 x1875400222505088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788521490.696108:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875400222505088:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788521490.696184:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521490.696249:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222505088 00000100:00100000:1.0:1788521490.696256:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222505088 00000100:00100000:1.0:1788521490.696283:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788521490.696289:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875400222505088:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788521490.696310:0:17201:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:1.0:1788521490.696351:0:17201:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x411dd0ee4d2d263e 00000004:00100000:1.0:1788521490.696366:0:17201:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788521490.696396:0:17201:0:(import.c:65:import_set_state_nolock()) ffff8fef58328000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788521490.696441:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875400222505088:12345-0@lo:38:llog_process_th.0 Request processed in 150us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521490.696449:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788521490.696485:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fef715a2d80 x1875400222505088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788521500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521490.696495:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788521490.696502:0:3642:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788521490.696509:0:3642:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788521490.696512:0:3642:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788521490.696514:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef5a9e9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788521490.696519:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3642:1875400222505088:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788521490.696537:0:18727:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788521490.696558:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788521490.696563:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788521490.696571:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788521490.696574:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788521490.696577:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788521490.696581:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788521490.696583:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788521490.696586:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:1.0:1788521490.711935:0:18727:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788521490.711952:0:18727:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8fef46a0cd40) 00000020:00000080:1.0:1788521490.711976:0:18727:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1788521490.712063:0:18727:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fef4e7ac800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788521490.712067:0:18727:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fef4e7ac800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788521490.712070:0:18727:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fef4e7ac800 3 00010000:00080000:1.0:1788521490.712101:0:18727:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fef5832a000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.141@tcp at head 00010000:00010000:1.0:1788521490.713754:0:18727:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1788521490.714010:0:18727:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788521490.714055:0:18727:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788521490.714070:0:18727:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x411dd0ee4d2d264c 00000100:00080000:1.0:1788521490.714080:0:18727:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788521490.714087:0:18727:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8fef5832a000 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:1.0:1788521490.714123:0:18727:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fef715a2d80 x1875400222505216/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788521490.714151:0:18727:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788521490.714187:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788521490.714191:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788521490.714194:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788521490.714203:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788521490.714206:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788521490.714209:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788521490.714211:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788521490.714214:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788521490.717177:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1875400222505216:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788521490.717267:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521490.717350:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222505216 00000100:00100000:0.0:1788521490.717358:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222505216 00000100:00100000:0.0:1788521490.717390:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521490.717398:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875400222505216:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788521490.717430:0:17200:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:0.0:1788521490.717468:0:17200:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x411dd0ee4d2d2653 00000004:00100000:0.0:1788521490.717485:0:17200:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788521490.717519:0:17200:0:(import.c:65:import_set_state_nolock()) ffff8fee437dd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788521490.717574:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875400222505216:12345-0@lo:38:llog_process_th.0 Request processed in 174us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521490.717581:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788521490.717626:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fef715a2d80 x1875400222505216/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788521500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521490.717650:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788521490.717659:0:3642:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788521490.717666:0:3642:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788521490.717670:0:3642:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788521490.717673:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef5832a000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788521490.717680:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3642:1875400222505216:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788521490.718471:0:18727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1788521490.718693:0:18700:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788521490.718721:0:18700:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788521490.718743:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef457f3c00/0x411dd0ee4d2d2622 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2629 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521490.718754:0:18700:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef457f3c00/0x411dd0ee4d2d2622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2629 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788521490.718803:0:18700:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788521490.718806:0:18700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788521490.718807:0:18700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521490.718808:0:18700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521490.718810:0:18700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521490.718811:0:18700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521490.718813:0:18700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788521490.718814:0:18700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521490.718816:0:18700:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788521490.718820:0:18700:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788521490.718822:0:18700:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788521490.718823:0:18700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788521490.718824:0:18700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521490.718825:0:18700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521490.718826:0:18700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521490.718827:0:18700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521490.718828:0:18700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788521490.718829:0:18700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521490.718830:0:18700:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788521490.718852:0:18700:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788521490.718868:0:18700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222505344:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788521490.718941:0:18700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521490.718969:0:18700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee43649a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521490.719033:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222505344 00000100:00100000:0.0:1788521490.719041:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222505344 00000100:00100000:0.0:1788521490.719089:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788521490.719097:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:18700:x1875400222505344:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788521490.719123:0:17192:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788521490.719139:0:17192:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788521490.731940:0:17192:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788521490.731963:0:17192:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788521490.732002:0:17216:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788521490.732007:0:17216:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788521490.732031:0:17216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fee434aac00/0x411dd0ee4d2d265a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521490.732051:0:17216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef4167e000/0x411dd0ee4d2d25a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d259d expref: 21 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521490.732059:0:17216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d25b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d25ab expref: 21 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521490.732066:0:17216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fee434aac00/0x411dd0ee4d2d265a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521490.732115:0:17216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d25b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d25ab expref: 21 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521490.732129:0:17216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d25b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d25ab expref: 21 pid: 17192 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521490.732145:0:17216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1875400222505472:0@lo:104: 00000100:00100000:1.0:1788521490.732385:0:17216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521490.732427:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:18700:x1875400222505344:12345-0@lo:253:mount.lustre.0 Request processed in 13328us (13484us total) trans 0 rc 0/0 00010000:00010000:1.0:1788521490.732437:0:17216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef4167e000/0x411dd0ee4d2d25a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d259d expref: 21 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521490.732438:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:1.0:1788521490.732456:0:17216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fef4167e000/0x411dd0ee4d2d25a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d259d expref: 20 pid: 17194 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521490.732465:0:17216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1875400222505600:0@lo:104: 00000100:00100000:0.0:1788521490.732485:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222505472 00000100:00100000:1.0:1788521490.732488:0:17216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521490.732491:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222505472 00000100:00100000:1.0:1788521490.732504:0:17216:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef71e0d480 going to sleep for 11 seconds 00000100:00100000:1.0:1788521490.732522:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222505600 00000100:00100000:0.0:1788521490.732523:0:17182:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788521490.732525:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222505600 00000100:00100000:0.0:1788521490.732533:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788521490.732541:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+4:17216:x1875400222505472:12345-0@lo:104: 00010000:00010000:0.0:1788521490.732554:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef413fd200/0x411dd0ee4d2d25ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d25b2 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521490.732616:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788521490.732623:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+4:17216:x1875400222505472:12345-0@lo:104: Request processed in 83us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521490.732629:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788521490.732642:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788521490.732648:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef6ddc9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+3:17216:x1875400222505600:12345-0@lo:104: 00010000:00010000:0.0:1788521490.732655:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d259d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d25a4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521490.732684:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788521490.732689:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef6ddc9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+3:17216:x1875400222505600:12345-0@lo:104: Request processed in 42us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521490.732695:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788521490.732711:0:17216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1875400222505472:0@lo:104: 00000100:00100000:1.0:1788521490.732719:0:17216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1875400222505600:0@lo:104: 00010000:00010000:0.0:1788521490.732729:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788521490.732734:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef413fd200/0x411dd0ee4d2d25ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d25b2 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521490.732735:0:17216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fee434aac00/0x411dd0ee4d2d265a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521490.732741:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef413fd200 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:0.0:1788521490.732745:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef413fd200/0x411dd0ee4d2d25ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d25b2 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521490.732753:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef413fd200/0x411dd0ee4d2d25ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d25b2 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521490.732761:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef413fd200/0x411dd0ee4d2d25ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d25b2 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521490.732767:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521490.732810:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef413fd200/0x411dd0ee4d2d25ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d25b2 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521490.732817:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521490.732836:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef413fd200/0x411dd0ee4d2d25ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d25b2 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521490.732844:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef413fd200/0x411dd0ee4d2d25ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d25b2 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521490.732859:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521490.732862:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d259d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d25a4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521490.732867:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434ab800 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:0.0:1788521490.732870:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d259d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d25a4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521490.732876:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d259d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d25a4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521490.732903:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d259d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d25a4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521490.732909:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521490.732926:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d259d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d25a4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521490.732931:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521490.732937:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d259d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d25a4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521490.732953:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fee434ab800/0x411dd0ee4d2d259d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d25a4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521490.732969:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521490.732971:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521490.732972:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521490.732978:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521490.732992:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3643:1875400222505728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521490.733021:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521490.733054:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788521490.733060:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3643:1875400222505856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521490.733081:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521490.733115:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222505728 00000100:00100000:0.0:1788521490.733119:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222505728 00010000:00010000:0.0:1788521490.733136:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d25b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d25ab expref: 21 pid: 17192 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521490.733155:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222505856 00000100:00100000:0.0:1788521490.733158:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222505856 00010000:00010000:0.0:1788521490.733170:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef4167e000/0x411dd0ee4d2d25a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d259d expref: 22 pid: 17194 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521490.733181:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788521490.733206:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+22:3643:x1875400222505728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521490.733215:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521490.733221:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d25b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d25ab expref: 22 pid: 17192 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521490.733235:0:17185:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788521490.733241:0:17185:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1788521490.733241:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d25b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d25ab expref: 22 pid: 17192 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521490.733253:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d25b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d25ab expref: 22 pid: 17192 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521490.733266:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521490.733293:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:3643:x1875400222505728:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521490.733299:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788521490.733312:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788521490.733317:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7effc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+20:3643:x1875400222505856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521490.733336:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521490.733340:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef4167e000/0x411dd0ee4d2d25a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d259d expref: 20 pid: 17194 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521490.733348:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef4167e000/0x411dd0ee4d2d25a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d259d expref: 20 pid: 17194 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521490.733357:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef4167e000/0x411dd0ee4d2d25a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d259d expref: 20 pid: 17194 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521490.733368:0:17184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fee434aac00/0x411dd0ee4d2d265a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521490.733376:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fee434aac00/0x411dd0ee4d2d265a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788521490.733386:0:17184:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013421358s 00010000:00010000:0.0:1788521490.733396:0:17184:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fee434aac00/0x411dd0ee4d2d265a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521490.733404:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fee434aac00/0x411dd0ee4d2d265a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521490.733410:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fee434aac00/0x411dd0ee4d2d265a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521490.733417:0:17184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fee434aac00/0x411dd0ee4d2d265a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521490.733422:0:17184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aac00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:0.0:1788521490.733426:0:17184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fee434aac00/0x411dd0ee4d2d265a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521490.733433:0:17184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fee434aac00/0x411dd0ee4d2d265a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521490.733447:0:17184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fee434aac00/0x411dd0ee4d2d265a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521490.733455:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521490.733477:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7effc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+19:3643:x1875400222505856:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521490.733483:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788521490.733523:0:17216:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fee434aac00/0x411dd0ee4d2d265a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521490.733532:0:17216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fee434aac00/0x411dd0ee4d2d265a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521490.733548:0:17216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fee434aac00/0x411dd0ee4d2d265a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521490.733579:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3643:1875400222505856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521490.733588:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3643:1875400222505728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788521490.733792:0:18700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:18700:1875400222505344:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788521490.733803:0:18700:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788521490.733806:0:18700:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788521490.733808:0:18700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788521490.733809:0:18700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521490.733811:0:18700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521490.733812:0:18700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521490.733814:0:18700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521490.733816:0:18700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788521490.733818:0:18700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521490.733819:0:18700:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788521490.733830:0:18700:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:3.0:1788521490.744019:0:18700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788521490.764682:0:18700:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788521490.764691:0:18700:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788521490.764726:0:18700:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788521490.764773:0:18700:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.141@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788521490.764790:0:18700:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788521490.764818:0:18700:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788521490.773949:0:18700:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788521490.774272:0:18700:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788521490.893054:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788521491.665472:0:18781:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788521491.665677:0:18781:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788521491.919898:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788521492.109447:0:17196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788521492.109454:0:17196:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fef7a3b2800 from 9 10000000:01000000:0.0:1788521492.109459:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788521492.109504:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d000/0x411dd0ee4d2d2661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521492.109516:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d000/0x411dd0ee4d2d2661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521492.109525:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d000/0x411dd0ee4d2d2661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521492.109550:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222505984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788521492.109624:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521492.109697:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef42bb2840 going to sleep for 11 seconds 00000100:00100000:1.0:1788521492.109699:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222505984 00000100:00100000:1.0:1788521492.109707:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222505984 00000100:00100000:1.0:1788521492.109760:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788521492.109769:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+19:17196:x1875400222505984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521492.109780:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521492.109793:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fee434aaa00/0x411dd0ee4d2d2668 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d2661 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521492.109816:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fee434aaa00/0x411dd0ee4d2d2668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2661 expref: 20 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521492.109826:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fee434aaa00/0x411dd0ee4d2d2668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2661 expref: 20 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521492.109845:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee434aaa00, rc 0) 00000100:00100000:1.0:1788521492.109901:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+20:17196:x1875400222505984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521492.109907:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788521492.110938:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222505984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521492.110957:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d000/0x411dd0ee4d2d2661 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2668 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521492.110970:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d000/0x411dd0ee4d2d2661 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d2668 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521492.111020:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222506112:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788521492.111059:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521492.111085:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef42bb2840 going to sleep for 11 seconds 00000100:00100000:3.0:1788521492.111266:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222506112 00000100:00100000:3.0:1788521492.111272:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222506112 00000100:00100000:3.0:1788521492.111325:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788521492.111333:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+20:17196:x1875400222506112:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788521492.111348:0:17192:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788521492.111364:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788521492.111367:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1788521492.111432:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+20:17196:x1875400222506112:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 99us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521492.111439:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788521492.111714:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222506112:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788521492.111765:0:17196:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788521492.111772:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d000/0x411dd0ee4d2d2661 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2668 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521492.111781:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d000/0x411dd0ee4d2d2661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2668 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521492.111790:0:17196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788521492.111792:0:17196:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fef48513800 from 9 10000000:01000000:0.0:1788521492.111794:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788521492.111814:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d600/0x411dd0ee4d2d266f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521492.111821:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d600/0x411dd0ee4d2d266f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521492.111829:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d600/0x411dd0ee4d2d266f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521492.111847:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222506240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788521492.111870:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521492.111919:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef506a29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521492.114387:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222506240 00000100:00100000:3.0:1788521492.114400:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222506240 00000100:00100000:3.0:1788521492.114456:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788521492.114466:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+20:17196:x1875400222506240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521492.114482:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521492.114499:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d2676 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d266f expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521492.114524:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d2676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d266f expref: 21 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521492.114535:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d2676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d266f expref: 21 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521492.114544:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef413fc600, rc 0) 00000100:00100000:3.0:1788521492.114623:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:17196:x1875400222506240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (2752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521492.114640:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788521492.115036:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222506240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521492.115054:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d600/0x411dd0ee4d2d266f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2676 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521492.115064:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d600/0x411dd0ee4d2d266f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d2676 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521492.115126:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222506368:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788521492.115167:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521492.115205:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef8147f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788521492.115485:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222506368 00000100:00100000:2.0:1788521492.115491:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222506368 00000100:00100000:2.0:1788521492.115527:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788521492.115535:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:17196:x1875400222506368:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788521492.115551:0:17194:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788521492.115566:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788521492.115569:0:17194:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1788521492.115677:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:17196:x1875400222506368:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 142us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521492.115684:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788521492.115734:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222506368:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788521492.115792:0:17196:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788521492.115799:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d600/0x411dd0ee4d2d266f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2676 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521492.115809:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d600/0x411dd0ee4d2d266f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2676 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788521492.372384:0:17234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788521492.942316:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521493.965097:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521494.991497:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521495.183017:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788521495.183037:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222506496:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788521495.183290:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521495.183360:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222506496 00000100:00100000:3.0:1788521495.183368:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222506496 00000100:00100000:3.0:1788521495.183416:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788521495.183425:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222506496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788521495.183458:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788521495.183504:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222506496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521495.183510:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788521495.183713:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222506496:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788521495.698937:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788521495.698958:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222506624:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788521495.699022:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521495.699079:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222506624 00000100:00100000:1.0:1788521495.699086:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222506624 00000100:00100000:1.0:1788521495.699125:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788521495.699134:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222506624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788521495.699166:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788521495.699206:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222506624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521495.699212:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788521495.699256:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222506624:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788521496.013328:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788521496.207144:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788521496.207150:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788521496.207152:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788521496.207155:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788521496.207173:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788521496.207176:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788521496.207179:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788521496.207182:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788521496.207334:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3643:1875400222506752:0@lo:400:kworker.0 00000100:00100000:2.0:1788521496.207510:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222507136:0@lo:400:kworker.0 00000100:00100000:2.0:1788521496.207577:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521496.207783:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521496.207871:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222506752 00000100:00100000:0.0:1788521496.207902:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222506752 00000100:00100000:0.0:1788521496.207954:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788521496.207963:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:3643:x1875400222506752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521496.208018:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:3643:x1875400222506752:12345-0@lo:400:kworker.0 Request processed in 56us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521496.208025:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788521496.208484:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788521496.208503:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875400222507008:0@lo:400:kworker.0 00000100:00100000:2.0:1788521496.208541:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521496.208569:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222507136 00000100:00100000:2.0:1788521496.208574:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222507136 00000100:00100000:2.0:1788521496.208601:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788521496.208809:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222507008 00000100:00100000:1.0:1788521496.208814:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222507008 00000100:00100000:1.0:1788521496.208846:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788521496.208853:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875400222507008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521496.208912:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875400222507008:12345-0@lo:400:kworker.0 Request processed in 60us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521496.208918:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788521496.208968:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3643:1875400222506752:0@lo:400:kworker.0 00000100:00100000:1.0:1788521496.208976:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875400222507264:0@lo:400:kworker.0 00000100:00100000:1.0:1788521496.209004:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521496.209057:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222507264 00000100:00100000:1.0:1788521496.209061:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222507264 00000100:00100000:1.0:1788521496.209083:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788521496.209089:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875400222507264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521496.209123:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875400222507264:12345-0@lo:400:kworker.0 Request processed in 35us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521496.209130:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788521496.209159:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef7f0cbb80 x1875400222507264/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521496.209170:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875400222507264:0@lo:400:kworker.0 00010000:00080000:1.0:1788521496.209196:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef7f0cb100 x1875400222507008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521496.209205:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875400222507008:0@lo:400:kworker.0 00000100:00100000:1.0:1788521496.209211:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875400222507520:0@lo:400:kworker.0 00000100:00100000:2.0:1788521496.209356:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222507136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521496.209394:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222507136:12345-0@lo:400:kworker.0 Request processed in 53us (1817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521496.209401:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788521496.210003:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222506880:0@lo:400:kworker.0 00000100:00100000:3.0:1788521496.210045:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521496.210068:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875400222507392:0@lo:400:kworker.0 00000100:00100000:3.0:1788521496.210093:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521496.210148:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222506880 00000100:00100000:3.0:1788521496.210155:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222506880 00000100:00100000:3.0:1788521496.210190:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788521496.210196:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222506880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521496.210249:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222506880:12345-0@lo:400:kworker.0 Request processed in 53us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521496.210256:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788521496.210324:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222506880:0@lo:400:kworker.0 00000100:00100000:3.0:1788521496.210354:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222507392 00000100:00100000:3.0:1788521496.210358:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222507392 00000100:00100000:3.0:1788521496.210392:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788521496.210399:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875400222507392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521496.210432:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875400222507392:12345-0@lo:400:kworker.0 Request processed in 35us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521496.210438:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788521496.210465:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788521496.210483:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef7f0ca680 x1875400222507392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521496.210493:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875400222507392:0@lo:400:kworker.0 00000100:00100000:1.0:1788521496.210909:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521496.210937:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222507136:0@lo:400:kworker.0 00000100:00100000:1.0:1788521496.210957:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222507520 00000100:00100000:1.0:1788521496.210960:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222507520 00000100:00100000:1.0:1788521496.210989:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788521496.210995:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875400222507520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521496.211028:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875400222507520:12345-0@lo:400:kworker.0 Request processed in 34us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521496.211034:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788521496.211048:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788521496.211067:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef7f0c8a80 x1875400222507520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521496.211083:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875400222507520:0@lo:400:kworker.0 00000040:00080000:2.0:1788521496.400713:0:17953:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788521497.039039:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788521497.667053:0:19071:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg341-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788521498.066740:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788521498.629174:0:19123:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788521498.632984:0:19123:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788521499.085182:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788521499.657395:0:19173:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788521499.657633:0:19173:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788521499.919542:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788521484/real 1788521484] req@ffff8fee4359aa00 x1875400222500096/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521499 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521499.919598:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fee4359aa00 x1875400222500096/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521499 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521499.919608:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788521484/real 1788521484] req@ffff8fee43598e00 x1875400222500224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521499 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521499.919618:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fee43598e00 x1875400222500224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521499 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788521499.919658:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef7f05c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788521499.919697:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788521499.919701:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4359aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222500096:0@lo:8:kworker.0 00000100:00080000:2.0:1788521499.919707:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef6e4db000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788521499.919712:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788521499.919850:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43598e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222500224:0@lo:8:kworker.0 00000100:00080000:1.0:1788521499.919927:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:3.0:1788521499.919931:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3646:1875400222507648:0@lo:400:kworker.0 00000100:00080000:1.0:1788521499.919933:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788521499.919939:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788521499.919943:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788521499.919966:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788521499.919970:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788521499.919973:0:8:0:(import.c:65:import_set_state_nolock()) ffff8fef7f05c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788521499.919979:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 534 00000100:00080000:1.0:1788521499.919985:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788521499.919992:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8fef7f05c800 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:3.0:1788521499.920001:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521499.920013:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fef715a3480 x1875400222508160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788521499.920027:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788521499.920030:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788521499.920032:0:8:0:(import.c:65:import_set_state_nolock()) ffff8fef6e4db000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788521499.920036:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 534 00000100:00080000:1.0:1788521499.920039:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788521499.920044:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8fef6e4db000 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:3.0:1788521499.920049:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788521499.920057:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee43d4e300 x1875400222508288/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788521499.920058:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222508032:0@lo:400:kworker.0 00000100:00100000:3.0:1788521499.920088:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521499.920127:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875400222508416:0@lo:400:kworker.0 00000100:00100000:3.0:1788521499.920153:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521499.920231:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222507776:0@lo:400:kworker.0 00000100:00100000:2.0:1788521499.920257:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521499.920288:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875400222508544:0@lo:400:kworker.0 00000100:00100000:2.0:1788521499.920315:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222508160:0@lo:8:kworker.0 00000100:00100000:0.0:1788521499.920347:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222508032 00000100:00100000:2.0:1788521499.920350:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521499.920358:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222508032 00000100:00100000:2.0:1788521499.920371:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222508288:0@lo:8:kworker.0 00000100:00100000:2.0:1788521499.920394:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521499.920406:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222507776 00000100:00100000:0.0:1788521499.920411:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222507776 00000100:00100000:0.0:1788521499.920431:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788521499.920441:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788521499.920443:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222508032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521499.920455:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222507776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521499.920504:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222508032:12345-0@lo:400:kworker.0 Request processed in 65us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521499.920515:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788521499.920516:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222507776:12345-0@lo:400:kworker.0 Request processed in 59us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521499.920526:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788521499.920966:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222508032:0@lo:400:kworker.0 00000100:00100000:3.0:1788521499.920995:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875400222507904:0@lo:400:kworker.0 00000100:00100000:3.0:1788521499.921035:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521499.921225:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222508160 00000100:00100000:0.0:1788521499.921231:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222508160 00000100:00100000:0.0:1788521499.921269:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222508288 00000100:00100000:0.0:1788521499.921272:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222508288 00000100:00100000:0.0:1788521499.921284:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788521499.921289:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1875400222508160:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788521499.921336:0:18704:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 549 last 0 00000020:00000080:0.0:1788521499.921364:0:18704:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x411dd0ee4d2d267d 00002000:00100000:0.0:1788521499.921378:0:18704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8fee437dc800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788521499.921383:0:18704:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1788521499.921385:0:18704:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788521499.921549:0:18704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788521499.921573:0:18704:0:(import.c:65:import_set_state_nolock()) ffff8fee437dc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788521499.921636:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1875400222508160:12345-0@lo:8:kworker.0 Request processed in 344us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521499.921642:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788521499.921655:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788521499.921660:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1875400222508288:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788521499.921671:0:18704:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788521499.922951:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875400222508672:0@lo:400:kworker.0 00000100:00100000:3.0:1788521499.922999:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521499.925713:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222508416 00000100:00100000:1.0:1788521499.926825:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222508416 00000100:00100000:1.0:1788521499.926916:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222507904 00000100:00100000:1.0:1788521499.926920:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222507904 00000100:00100000:1.0:1788521499.926939:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788521499.926948:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875400222508416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521499.927273:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875400222508416:12345-0@lo:400:kworker.0 Request processed in 324us (7117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521499.927281:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788521499.927300:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788521499.927307:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875400222507904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521499.927675:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875400222507904:12345-0@lo:400:kworker.0 Request processed in 369us (6639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521499.927683:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788521499.927943:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee43d4dc00 x1875400222508416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521499.927958:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875400222508416:0@lo:400:kworker.0 00000100:00100000:3.0:1788521499.927989:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222507648 00000100:00100000:3.0:1788521499.927994:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222507648 00000100:00100000:3.0:1788521499.928044:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788521499.928051:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:3646:x1875400222507648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521499.928091:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:3646:x1875400222507648:12345-0@lo:400:kworker.0 Request processed in 40us (8090us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521499.928097:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788521499.928137:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521499.928186:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222507776:0@lo:400:kworker.0 00000100:00100000:3.0:1788521499.928208:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3646:1875400222507648:0@lo:400:kworker.0 00010000:00080000:3.0:1788521499.928241:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef715a3800 x1875400222507904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521499.928250:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875400222507904:0@lo:400:kworker.0 00000100:00100000:1.0:1788521499.930873:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222508672 00000100:00100000:1.0:1788521499.930905:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222508672 00000100:00100000:1.0:1788521499.930963:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222508544 00000100:00100000:1.0:1788521499.930966:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222508544 00000100:00100000:1.0:1788521499.930987:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788521499.930997:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875400222508672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521499.931104:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875400222508672:12345-0@lo:400:kworker.0 Request processed in 109us (8104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521499.931111:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788521499.931128:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788521499.931134:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875400222508544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521499.931272:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875400222508544:12345-0@lo:400:kworker.0 Request processed in 35us (3030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521499.931294:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788521499.931346:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee43d4f800 x1875400222508544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521499.931360:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3643:1875400222508544:0@lo:400:kworker.0 00010000:00080000:1.0:1788521499.931431:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee43d4d880 x1875400222508672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521499.931441:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875400222508672:0@lo:400:kworker.0 00000100:00080000:3.0:1788521499.933158:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788521499.933167:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788521499.933401:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef715a3480 x1875400222508160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788521519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521499.933412:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788521499.933421:0:3642:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788521499.933429:0:3642:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788521499.933435:0:3642:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788521499.933438:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef7f05c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788521499.933458:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788521499.933463:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222508160:0@lo:8:kworker.0 00000004:00080000:2.0:1788521499.936188:0:17942:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788521499.936214:0:17942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4359b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17942:1875400222508928:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1788521499.936284:0:17942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521499.936312:0:17942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee410b3900 going to sleep for 11 seconds 00000100:00100000:3.0:1788521499.936506:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222508800:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788521499.936541:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521499.936672:0:18707:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788521499.936679:0:18707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788521499.936993:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222508800 00000100:00100000:1.0:1788521499.937001:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222508800 00000100:00100000:1.0:1788521499.937054:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788521499.937063:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875400222508800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788521499.937087:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788521499.937134:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875400222508800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521499.937141:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788521499.937245:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788521499.937285:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee43598a80 x1875400222508800/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521499.937302:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43598a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222508800:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788521499.938127:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222508928 00000100:00100000:3.0:1788521499.938133:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222508928 00000004:00080000:2.0:1788521499.938681:0:17941:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788521499.938871:0:17941:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 550004986364ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788521499.938878:0:17941:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788521499.939298:0:19185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788521499.939310:0:19185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17942:x1875400222508928:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788521499.941072:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3642:x1875400222508288:12345-0@lo:8:kworker.0 Request processed in 19407us (20673us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788521499.941084:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788521499.941135:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef6e4db000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788521499.941140:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788521499.941144:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222508288:0@lo:8:kworker.0 00002000:00080000:1.0:1788521499.946209:0:19185:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788521499.946218:0:19185:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788521499.946318:0:19185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43598380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17942:x1875400222508928:12345-0@lo:7:osp-pre-0-1.0 Request processed in 7007us (10029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521499.946329:0:19185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788521499.950057:0:17942:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee4359b100 x1875400222508928/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788521515 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521499.950077:0:17942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4359b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17942:1875400222508928:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788521499.950091:0:17942:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788521499.950134:0:17942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17942:1875400222509056:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788521499.950185:0:17942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521499.950216:0:17942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef461b0840 going to sleep for 11 seconds 00000100:00100000:3.0:1788521499.950426:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222509056 00000100:00100000:3.0:1788521499.950433:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222509056 00000100:00100000:3.0:1788521499.950952:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788521499.950966:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17942:x1875400222509056:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788521499.950993:0:18707:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1788521499.951048:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17942:x1875400222509056:12345-0@lo:5:osp-pre-0-1.0 Request processed in 85us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521499.951055:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788521499.951145:0:17942:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee43d4d880 x1875400222509056/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788521515 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521499.951157:0:17942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17942:1875400222509056:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788521499.951168:0:17942:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788521499.951195:0:17942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17942:1875400222509184:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788521499.951222:0:17942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521499.951238:0:17942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef461b0840 going to sleep for 11 seconds 00000100:00100000:0.0:1788521499.951478:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222509184 00000100:00100000:0.0:1788521499.951484:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222509184 00000100:00100000:0.0:1788521499.951520:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521499.951528:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17942:x1875400222509184:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788521499.951570:0:18706:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000004:00080000:3.0:1788521499.966289:0:17931:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000001:00080000:2.0:1788521499.984921:0:18701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1788521499.984936:0:18701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788521499.985422:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17942:x1875400222509184:12345-0@lo:5:osp-pre-0-1.0 Request processed in 33890us (34195us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788521499.985434:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788521499.985609:0:17942:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee43d4d880 x1875400222509184/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788521515 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521499.985632:0:17942:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788521499.985639:0:17942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17942:1875400222509184:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788521499.985655:0:17942:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1788521499.985704:0:17942:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4359b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17942:1875400222509312:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788521499.985739:0:17942:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521499.985770:0:17942:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee410b3900 going to sleep for 11 seconds 00000100:00100000:1.0:1788521499.985918:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222509312 00000100:00100000:1.0:1788521499.985929:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222509312 00000100:00100000:1.0:1788521499.985974:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788521499.985982:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17942:x1875400222509312:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788521499.986135:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17942:x1875400222509312:12345-0@lo:900:osp-pre-0-1.0 Request processed in 153us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521499.986141:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788521499.989716:0:17942:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee4359b100 x1875400222509312/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788521515 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521499.989743:0:17942:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4359b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17942:1875400222509312:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1788521500.109403:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521500.301163:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222509440:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788521500.301233:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521500.301375:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222509440 00000100:00100000:0.0:1788521500.301393:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222509440 00000100:00100000:1.0:1788521500.301519:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788521500.301531:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222509440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788521500.301580:0:17940:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788521500.301629:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222509440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521500.301637:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788521500.301653:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222509440:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788521500.813142:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788521500.813167:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222509568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788521500.813236:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521500.813690:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222509568 00000100:00100000:3.0:1788521500.813698:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222509568 00000100:00100000:3.0:1788521500.813753:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788521500.813762:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222509568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788521500.813792:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788521500.813846:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222509568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521500.813852:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788521500.813914:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222509568:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788521501.141546:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521502.158366:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788521502.671094:0:17234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788521503.180992:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521504.206131:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521505.044394:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788521485/real 1788521485] req@ffff8fee43e2b100 x1875400222501504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521505 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521505.044421:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fee43e2b100 x1875400222501504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521505 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521505.044431:0:3642:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788521485/real 1788521485] req@ffff8fee43e28000 x1875400222501632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521505 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521505.044441:0:3642:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fee43e28000 x1875400222501632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521505 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788521505.044458:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef48537800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788521505.044478:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788521505.044482:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222501504:0@lo:8:kworker.0 00000100:00080000:2.0:1788521505.044488:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef81580800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788521505.044502:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788521505.044506:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222501632:0@lo:8:kworker.0 00000100:00080000:2.0:1788521505.044594:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788521505.044597:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788521505.044600:0:37:0:(import.c:65:import_set_state_nolock()) ffff8fef48537800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788521505.044605:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 535 00000100:00080000:2.0:1788521505.044610:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788521505.044616:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8fef48537800 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:2.0:1788521505.044636:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee43d22680 x1875400222509952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788521505.044648:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788521505.044650:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788521505.044652:0:37:0:(import.c:65:import_set_state_nolock()) ffff8fef81580800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788521505.044655:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 535 00000100:00080000:2.0:1788521505.044657:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788521505.044660:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8fef81580800 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:2.0:1788521505.044669:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee43d22300 x1875400222510080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788521505.044693:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788521505.044696:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788521505.044698:0:37:0:(import.c:65:import_set_state_nolock()) ffff8fef6e4db000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788521505.044701:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 549 00000100:00080000:2.0:1788521505.044703:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788521505.044706:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8fef6e4db000 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:2.0:1788521505.044725:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee43d22d80 x1875400222510592/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788521505.044784:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3644:1875400222509696:0@lo:400:kworker.0 00000100:00100000:2.0:1788521505.044846:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521505.044906:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222510464:0@lo:400:kworker.0 00000100:00100000:2.0:1788521505.044932:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521505.044953:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788521505.044959:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222510336:0@lo:400:kworker.0 00000100:00100000:2.0:1788521505.044981:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521505.044999:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee436ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875400222510976:0@lo:400:kworker.0 00000100:00100000:2.0:1788521505.045027:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521505.045052:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222509824:0@lo:400:kworker.0 00000100:00100000:2.0:1788521505.045075:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521505.045093:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee436cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222510720:0@lo:400:kworker.0 00000100:00100000:2.0:1788521505.045111:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521505.045126:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788521505.045131:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222510208:0@lo:400:kworker.0 00000100:00100000:2.0:1788521505.045831:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521505.045857:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee436cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875400222510848:0@lo:400:kworker.0 00000100:00100000:2.0:1788521505.045899:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521505.045929:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222509696 00000100:00100000:2.0:1788521505.045936:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222509696 00000100:00100000:2.0:1788521505.045978:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788521505.045986:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:3644:x1875400222509696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521505.046034:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:3644:x1875400222509696:12345-0@lo:400:kworker.0 Request processed in 48us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521505.046048:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788521505.046082:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222510464 00000100:00100000:2.0:1788521505.046086:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222510464 00000100:00100000:2.0:1788521505.046130:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788521505.046137:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222510464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521505.046169:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222510464:12345-0@lo:400:kworker.0 Request processed in 34us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521505.046176:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788521505.046193:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222510336 00000100:00100000:2.0:1788521505.046197:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222510336 00000100:00100000:2.0:1788521505.046234:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222509824 00000100:00100000:2.0:1788521505.046238:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222509824 00000100:00100000:2.0:1788521505.046253:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788521505.046259:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222510336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521505.046290:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222510336:12345-0@lo:400:kworker.0 Request processed in 32us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521505.046296:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788521505.046309:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788521505.046314:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222509824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521505.046344:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222509824:12345-0@lo:400:kworker.0 Request processed in 30us (1268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521505.046349:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788521505.046368:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222510976 00000100:00100000:2.0:1788521505.046371:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222510976 00000100:00100000:2.0:1788521505.046388:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222510720 00000100:00100000:2.0:1788521505.046390:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222510720 00000100:00100000:2.0:1788521505.046398:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222510208 00000100:00100000:2.0:1788521505.046406:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222510208 00000100:00100000:2.0:1788521505.046418:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222510848 00000100:00100000:2.0:1788521505.046421:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222510848 00000100:00100000:2.0:1788521505.046434:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788521505.046440:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875400222510976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521505.046468:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875400222510976:12345-0@lo:400:kworker.0 Request processed in 28us (1440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521505.046474:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788521505.046485:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788521505.046490:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222510720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521505.046514:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222510720:12345-0@lo:400:kworker.0 Request processed in 24us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521505.046519:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788521505.046529:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788521505.046534:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222510208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521505.046558:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222510208:12345-0@lo:400:kworker.0 Request processed in 24us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521505.046563:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788521505.046575:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788521505.046580:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875400222510848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521505.046605:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875400222510848:12345-0@lo:400:kworker.0 Request processed in 25us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521505.046610:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1788521505.046630:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788521505.046634:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788521505.046636:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521505.046664:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222509952:0@lo:8:kworker.0 00000100:00100000:2.0:1788521505.046704:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521505.046722:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222510080:0@lo:8:kworker.0 00000100:00100000:2.0:1788521505.046744:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521505.046756:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222510592:0@lo:8:kworker.0 00000100:00100000:2.0:1788521505.046774:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521505.046798:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222509952 00000100:00100000:2.0:1788521505.046802:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222509952 00000100:00100000:2.0:1788521505.046814:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222510080 00000100:00100000:2.0:1788521505.046816:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222510080 00000100:00100000:2.0:1788521505.046822:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222510592 00000100:00100000:2.0:1788521505.046825:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222510592 00000100:00100000:2.0:1788521505.046833:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788521505.046837:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1875400222509952:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788521505.046859:0:18707:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 555 last 0 00000020:00000080:2.0:1788521505.046905:0:18707:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x411dd0ee4d2d2684 00002000:00100000:2.0:1788521505.046920:0:18707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8fef484a6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788521505.046925:0:18707:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788521505.046927:0:18707:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788521505.046997:0:18707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788521505.047021:0:18707:0:(import.c:65:import_set_state_nolock()) ffff8fef484a5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788521505.047057:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875400222509952:12345-0@lo:8:kworker.0 Request processed in 219us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521505.047064:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788521505.047078:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788521505.047081:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1875400222510080:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788521505.047092:0:18707:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788521505.051750:0:19185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788521505.051764:0:19185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3642:x1875400222510592:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788521505.051788:0:19185:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788521505.051863:0:19185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3642:x1875400222510592:12345-0@lo:8:kworker.0 Request processed in 100us (5087us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788521505.051870:0:19185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788521505.055059:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee43d20a80 x1875400222510208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521505.055076:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222510208:0@lo:400:kworker.0 00010000:00080000:0.0:1788521505.055098:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee436cce00 x1875400222510848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521505.055106:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee436cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875400222510848:0@lo:400:kworker.0 00000100:00100000:0.0:1788521505.055118:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222509824:0@lo:400:kworker.0 00010000:00080000:0.0:1788521505.055130:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee436cf480 x1875400222510720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521505.055138:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee436cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222510720:0@lo:400:kworker.0 00000100:00100000:0.0:1788521505.055186:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222510336:0@lo:400:kworker.0 00010000:00080000:0.0:1788521505.055199:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee436ce300 x1875400222510976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521505.055207:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee436ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875400222510976:0@lo:400:kworker.0 00000100:00100000:0.0:1788521505.055354:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3644:1875400222509696:0@lo:400:kworker.0 00010000:00080000:0.0:1788521505.055372:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee43d23100 x1875400222510464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521505.055381:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222510464:0@lo:400:kworker.0 00010000:00080000:0.0:1788521505.055414:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee43d22680 x1875400222509952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788521530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521505.055437:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788521505.055446:0:3642:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788521505.055454:0:3642:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788521505.055461:0:3642:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788521505.055464:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef48537800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788521505.055490:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788521505.055497:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222509952:0@lo:8:kworker.0 00000100:00080000:0.0:1788521505.055512:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef6e4db000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788521505.055516:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788521505.055519:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222510592:0@lo:8:kworker.0 00000004:00080000:0.0:1788521505.055540:0:17224:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788521505.055624:0:17224:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 555121739247ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788521505.055630:0:17224:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1788521505.055735:0:17225:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:1.0:1788521505.055757:0:17225:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17225:1875400222511232:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788521505.055817:0:17225:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521505.055843:0:17225:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a68f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788521505.056014:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788521505.056024:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222511104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788521505.056051:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521505.056086:0:19185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222511232 00000100:00100000:1.0:1788521505.056092:0:19185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222511232 00000100:00100000:1.0:1788521505.056141:0:19185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788521505.056150:0:19185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17225:x1875400222511232:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788521505.056384:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222511104 00000100:00100000:1.0:1788521505.056389:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222511104 00000100:00100000:1.0:1788521505.056416:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788521505.056423:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875400222511104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788521505.056440:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788521505.056481:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875400222511104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521505.056487:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788521505.056523:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee43d4f100 x1875400222511104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521521 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521505.056538:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222511104:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788521505.056555:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788521505.070433:0:17179:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:3.0:1788521505.073662:0:19185:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788521505.073677:0:19185:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1788521505.073683:0:19185:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00000100:00100000:2.0:1788521505.091627:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1875400222510080:12345-0@lo:8:kworker.0 Request processed in 44539us (44877us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788521505.091640:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788521505.092065:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef81580800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788521505.092071:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788521505.092075:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222510080:0@lo:8:kworker.0 00002000:00010000:3.0:1788521505.121910:0:19185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788521505.121923:0:19185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff501c36/0x411dd0ee4d2d268b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.121939:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1788521505.121944:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521505.121950:0:19185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff501c36/0x411dd0ee4d2d268b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.121968:0:19185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff501c36/0x411dd0ee4d2d268b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.121977:0:19185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff501c36/0x411dd0ee4d2d268b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.121992:0:19185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff501c36/0x411dd0ee4d2d268b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.122016:0:19185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788521505.122264:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521505.122272:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff501c36/0x411dd0ee4d2d268b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.122281:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef413fd200 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:1.0:1788521505.122285:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff501c36/0x411dd0ee4d2d268b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.122295:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff501c36/0x411dd0ee4d2d268b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.122327:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff501c36/0x411dd0ee4d2d268b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.122335:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff501c36/0x411dd0ee4d2d268b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.122359:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521505.122362:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521505.122365:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521505.124106:0:19185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788521505.124118:0:19185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044f479e5/0x411dd0ee4d2d2692 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.124133:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1788521505.124137:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521505.124144:0:19185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044f479e5/0x411dd0ee4d2d2692 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.124157:0:19185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044f479e5/0x411dd0ee4d2d2692 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.124173:0:19185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044f479e5/0x411dd0ee4d2d2692 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.124190:0:19185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044f479e5/0x411dd0ee4d2d2692 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.124220:0:19185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521505.124437:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521505.124445:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044f479e5/0x411dd0ee4d2d2692 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.124455:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef413fc400 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:2.0:1788521505.124459:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044f479e5/0x411dd0ee4d2d2692 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.124470:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044f479e5/0x411dd0ee4d2d2692 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.124488:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044f479e5/0x411dd0ee4d2d2692 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.124496:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044f479e5/0x411dd0ee4d2d2692 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.124515:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521505.124517:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521505.124519:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521505.124915:0:19185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788521505.124922:0:19185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003059679e/0x411dd0ee4d2d2699 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.124937:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1788521505.124940:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521505.124945:0:19185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003059679e/0x411dd0ee4d2d2699 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.124956:0:19185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003059679e/0x411dd0ee4d2d2699 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.124964:0:19185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003059679e/0x411dd0ee4d2d2699 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.124971:0:19185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003059679e/0x411dd0ee4d2d2699 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.124991:0:19185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788521505.125302:0:19185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788521505.125309:0:19185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026f9be1f/0x411dd0ee4d2d26a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.125329:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1788521505.125333:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521505.125338:0:19185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026f9be1f/0x411dd0ee4d2d26a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.125349:0:19185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026f9be1f/0x411dd0ee4d2d26a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.125371:0:19185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026f9be1f/0x411dd0ee4d2d26a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.125378:0:19185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026f9be1f/0x411dd0ee4d2d26a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.125398:0:19185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788521505.125605:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788521505.125612:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003059679e/0x411dd0ee4d2d2699 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.125620:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef4167e000 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:0.0:1788521505.125624:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003059679e/0x411dd0ee4d2d2699 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.125633:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003059679e/0x411dd0ee4d2d2699 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.125656:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003059679e/0x411dd0ee4d2d2699 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.125663:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003059679e/0x411dd0ee4d2d2699 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.125680:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521505.125683:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026f9be1f/0x411dd0ee4d2d26a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.125689:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef4167fa00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:0.0:1788521505.125692:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026f9be1f/0x411dd0ee4d2d26a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.125699:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026f9be1f/0x411dd0ee4d2d26a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.125708:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026f9be1f/0x411dd0ee4d2d26a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.125714:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026f9be1f/0x411dd0ee4d2d26a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.125726:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521505.125728:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521505.125734:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521505.125788:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521505.125857:0:19185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788521505.125863:0:19185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e1fa15/0x411dd0ee4d2d26a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.125871:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1788521505.125874:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521505.125878:0:19185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1fa15/0x411dd0ee4d2d26a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.125947:0:19185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1e1fa15/0x411dd0ee4d2d26a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.125956:0:19185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1e1fa15/0x411dd0ee4d2d26a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.125964:0:19185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1e1fa15/0x411dd0ee4d2d26a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.126710:0:19185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521505.126721:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521505.126726:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1e1fa15/0x411dd0ee4d2d26a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.126735:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6a00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:3.0:1788521505.126740:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e1fa15/0x411dd0ee4d2d26a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.126749:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1e1fa15/0x411dd0ee4d2d26a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.126761:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1e1fa15/0x411dd0ee4d2d26a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.126769:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1e1fa15/0x411dd0ee4d2d26a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.126785:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521505.126786:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521505.126788:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521505.128535:0:19185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788521505.128547:0:19185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1c19d94/0x411dd0ee4d2d26ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.128562:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1788521505.128576:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521505.128583:0:19185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1c19d94/0x411dd0ee4d2d26ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.128596:0:19185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1c19d94/0x411dd0ee4d2d26ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.128608:0:19185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1c19d94/0x411dd0ee4d2d26ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.128616:0:19185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1c19d94/0x411dd0ee4d2d26ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.128634:0:19185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521505.128644:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521505.128649:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1c19d94/0x411dd0ee4d2d26ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.128656:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6c00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:3.0:1788521505.128661:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1c19d94/0x411dd0ee4d2d26ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.128669:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1c19d94/0x411dd0ee4d2d26ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.128684:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1c19d94/0x411dd0ee4d2d26ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.128704:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1c19d94/0x411dd0ee4d2d26ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.128721:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521505.128723:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521505.128724:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521505.131329:0:19185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788521505.131341:0:19185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004138fec4/0x411dd0ee4d2d26b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.131356:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1788521505.131361:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521505.131368:0:19185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004138fec4/0x411dd0ee4d2d26b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.131382:0:19185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004138fec4/0x411dd0ee4d2d26b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.131393:0:19185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004138fec4/0x411dd0ee4d2d26b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.131401:0:19185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004138fec4/0x411dd0ee4d2d26b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.131427:0:19185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788521505.131779:0:19185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788521505.131791:0:19185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffb15fd5/0x411dd0ee4d2d26bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.131800:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1788521505.131804:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521505.131808:0:19185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffb15fd5/0x411dd0ee4d2d26bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.131818:0:19185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffb15fd5/0x411dd0ee4d2d26bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.131826:0:19185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffb15fd5/0x411dd0ee4d2d26bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.131834:0:19185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffb15fd5/0x411dd0ee4d2d26bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.131849:0:19185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788521505.131922:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788521505.131931:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004138fec4/0x411dd0ee4d2d26b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.131941:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7e00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:0.0:1788521505.131946:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004138fec4/0x411dd0ee4d2d26b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.131956:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004138fec4/0x411dd0ee4d2d26b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.131971:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004138fec4/0x411dd0ee4d2d26b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.131979:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004138fec4/0x411dd0ee4d2d26b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.131997:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521505.132000:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffb15fd5/0x411dd0ee4d2d26bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.132007:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6400 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:0.0:1788521505.132010:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffb15fd5/0x411dd0ee4d2d26bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.132018:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffb15fd5/0x411dd0ee4d2d26bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.132036:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffb15fd5/0x411dd0ee4d2d26bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.132044:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffb15fd5/0x411dd0ee4d2d26bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.132056:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521505.132058:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521505.132060:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521505.132207:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521505.132288:0:19185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788521505.132294:0:19185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006049afa3/0x411dd0ee4d2d26c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.132315:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1788521505.132318:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521505.132324:0:19185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006049afa3/0x411dd0ee4d2d26c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.132334:0:19185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006049afa3/0x411dd0ee4d2d26c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.132350:0:19185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006049afa3/0x411dd0ee4d2d26c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.132358:0:19185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006049afa3/0x411dd0ee4d2d26c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.132378:0:19185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788521505.132826:0:19185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788521505.132832:0:19185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c4c3490/0x411dd0ee4d2d26ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.132843:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1788521505.132846:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521505.132850:0:19185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c4c3490/0x411dd0ee4d2d26ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.132860:0:19185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c4c3490/0x411dd0ee4d2d26ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.132869:0:19185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c4c3490/0x411dd0ee4d2d26ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.132876:0:19185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c4c3490/0x411dd0ee4d2d26ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.132921:0:19185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788521505.132929:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788521505.132933:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006049afa3/0x411dd0ee4d2d26c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.132940:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7a00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:3.0:1788521505.132944:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006049afa3/0x411dd0ee4d2d26c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.132954:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006049afa3/0x411dd0ee4d2d26c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.132966:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006049afa3/0x411dd0ee4d2d26c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.132974:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006049afa3/0x411dd0ee4d2d26c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.133106:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521505.133111:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c4c3490/0x411dd0ee4d2d26ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.133119:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6600 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:3.0:1788521505.133123:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c4c3490/0x411dd0ee4d2d26ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.133142:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c4c3490/0x411dd0ee4d2d26ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.133153:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c4c3490/0x411dd0ee4d2d26ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.133172:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c4c3490/0x411dd0ee4d2d26ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.133187:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521505.133189:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521505.133191:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521505.134292:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521505.134465:0:19185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788521505.134474:0:19185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f10ff3d/0x411dd0ee4d2d26d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.134486:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1788521505.134491:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521505.134496:0:19185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f10ff3d/0x411dd0ee4d2d26d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.134506:0:19185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f10ff3d/0x411dd0ee4d2d26d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.134795:0:19185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f10ff3d/0x411dd0ee4d2d26d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.134811:0:19185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f10ff3d/0x411dd0ee4d2d26d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.134838:0:19185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788521505.135863:0:19185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788521505.135872:0:19185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d60ab4c/0x411dd0ee4d2d26d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.135905:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1788521505.135910:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521505.135915:0:19185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d60ab4c/0x411dd0ee4d2d26d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.135928:0:19185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d60ab4c/0x411dd0ee4d2d26d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.135937:0:19185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d60ab4c/0x411dd0ee4d2d26d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.135945:0:19185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d60ab4c/0x411dd0ee4d2d26d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.135967:0:19185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788521505.136036:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788521505.136047:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f10ff3d/0x411dd0ee4d2d26d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.136056:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6200 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:0.0:1788521505.136061:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f10ff3d/0x411dd0ee4d2d26d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.136071:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f10ff3d/0x411dd0ee4d2d26d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.136087:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f10ff3d/0x411dd0ee4d2d26d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.136095:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f10ff3d/0x411dd0ee4d2d26d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.136127:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521505.136132:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d60ab4c/0x411dd0ee4d2d26d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.136140:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7400 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:0.0:1788521505.136143:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d60ab4c/0x411dd0ee4d2d26d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.136151:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d60ab4c/0x411dd0ee4d2d26d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.136161:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d60ab4c/0x411dd0ee4d2d26d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.136169:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d60ab4c/0x411dd0ee4d2d26d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.136180:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521505.136182:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521505.136183:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521505.136722:0:19185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788521505.136730:0:19185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003663fef7/0x411dd0ee4d2d26df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.136746:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1788521505.136749:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521505.136755:0:19185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003663fef7/0x411dd0ee4d2d26df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.136765:0:19185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003663fef7/0x411dd0ee4d2d26df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.136773:0:19185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003663fef7/0x411dd0ee4d2d26df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.136781:0:19185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003663fef7/0x411dd0ee4d2d26df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.136802:0:19185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788521505.137243:0:19185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788521505.137249:0:19185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017b18b78/0x411dd0ee4d2d26e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.137267:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1788521505.137270:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521505.137275:0:19185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017b18b78/0x411dd0ee4d2d26e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.137284:0:19185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017b18b78/0x411dd0ee4d2d26e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.137312:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521505.137319:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003663fef7/0x411dd0ee4d2d26df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.137328:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7600 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:0.0:1788521505.137337:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003663fef7/0x411dd0ee4d2d26df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.137346:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003663fef7/0x411dd0ee4d2d26df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.137359:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003663fef7/0x411dd0ee4d2d26df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.137366:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003663fef7/0x411dd0ee4d2d26df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.137382:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521505.137384:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521505.137386:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521505.137636:0:19185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017b18b78/0x411dd0ee4d2d26e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.137646:0:19185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017b18b78/0x411dd0ee4d2d26e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.137669:0:19185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788521505.138044:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521505.138049:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017b18b78/0x411dd0ee4d2d26e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.138057:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7c00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:0.0:1788521505.138061:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017b18b78/0x411dd0ee4d2d26e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.138069:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017b18b78/0x411dd0ee4d2d26e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.138081:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017b18b78/0x411dd0ee4d2d26e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.138096:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017b18b78/0x411dd0ee4d2d26e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788521505.138109:0:19185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788521505.138113:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521505.138116:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521505.138117:0:19185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0d6740f/0x411dd0ee4d2d26ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.138119:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521505.138129:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1788521505.138131:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521505.138137:0:19185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0d6740f/0x411dd0ee4d2d26ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.138147:0:19185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0d6740f/0x411dd0ee4d2d26ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.138155:0:19185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0d6740f/0x411dd0ee4d2d26ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.138174:0:19185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0d6740f/0x411dd0ee4d2d26ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.138203:0:19185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788521505.138292:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521505.138297:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0d6740f/0x411dd0ee4d2d26ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.138304:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7200 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:0.0:1788521505.138307:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0d6740f/0x411dd0ee4d2d26ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.138315:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0d6740f/0x411dd0ee4d2d26ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.138327:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0d6740f/0x411dd0ee4d2d26ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.138339:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0d6740f/0x411dd0ee4d2d26ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.138354:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521505.138356:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521505.138358:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521505.138587:0:19185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788521505.138594:0:19185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e4a62ee/0x411dd0ee4d2d26f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.138603:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1788521505.138607:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521505.138611:0:19185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e4a62ee/0x411dd0ee4d2d26f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.138620:0:19185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e4a62ee/0x411dd0ee4d2d26f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.138629:0:19185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e4a62ee/0x411dd0ee4d2d26f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.138637:0:19185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e4a62ee/0x411dd0ee4d2d26f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.138658:0:19185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788521505.138738:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521505.138743:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e4a62ee/0x411dd0ee4d2d26f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.138750:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6000 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:0.0:1788521505.138754:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e4a62ee/0x411dd0ee4d2d26f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.138761:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e4a62ee/0x411dd0ee4d2d26f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.138771:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e4a62ee/0x411dd0ee4d2d26f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.138778:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e4a62ee/0x411dd0ee4d2d26f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.138792:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521505.138794:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521505.138796:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521505.138950:0:19185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788521505.138957:0:19185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5de83ac/0x411dd0ee4d2d26fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.138965:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1788521505.138975:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521505.138980:0:19185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5de83ac/0x411dd0ee4d2d26fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.139096:0:19185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5de83ac/0x411dd0ee4d2d26fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.139106:0:19185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5de83ac/0x411dd0ee4d2d26fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.139115:0:19185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5de83ac/0x411dd0ee4d2d26fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.139133:0:19185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788521505.139161:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521505.139166:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5de83ac/0x411dd0ee4d2d26fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.139174:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7000 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:0.0:1788521505.139178:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5de83ac/0x411dd0ee4d2d26fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.139198:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5de83ac/0x411dd0ee4d2d26fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.139210:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5de83ac/0x411dd0ee4d2d26fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.139237:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5de83ac/0x411dd0ee4d2d26fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.139255:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521505.139257:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521505.139259:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788521505.139709:0:19185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788521505.139717:0:19185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003909eba3/0x411dd0ee4d2d2702 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.139728:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1788521505.139731:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521505.139737:0:19185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003909eba3/0x411dd0ee4d2d2702 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.139748:0:19185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003909eba3/0x411dd0ee4d2d2702 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.139757:0:19185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003909eba3/0x411dd0ee4d2d2702 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.139772:0:19185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003909eba3/0x411dd0ee4d2d2702 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.139794:0:19185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788521505.140016:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521505.140022:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003909eba3/0x411dd0ee4d2d2702 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.140030:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6800 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:0.0:1788521505.140034:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003909eba3/0x411dd0ee4d2d2702 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.140043:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003909eba3/0x411dd0ee4d2d2702 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.140056:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003909eba3/0x411dd0ee4d2d2702 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.140074:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003909eba3/0x411dd0ee4d2d2702 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.140091:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521505.140093:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521505.140095:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521505.140653:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521505.142011:0:19185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788521505.142022:0:19185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a77e722f/0x411dd0ee4d2d2709 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.142036:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1788521505.142041:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521505.142047:0:19185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a77e722f/0x411dd0ee4d2d2709 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.142061:0:19185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a77e722f/0x411dd0ee4d2d2709 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.142071:0:19185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a77e722f/0x411dd0ee4d2d2709 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.142091:0:19185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a77e722f/0x411dd0ee4d2d2709 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.142107:0:19185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788521505.142361:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521505.142368:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a77e722f/0x411dd0ee4d2d2709 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.142376:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aac00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:0.0:1788521505.142381:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a77e722f/0x411dd0ee4d2d2709 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.142390:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a77e722f/0x411dd0ee4d2d2709 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.142405:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a77e722f/0x411dd0ee4d2d2709 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.142413:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a77e722f/0x411dd0ee4d2d2709 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.142428:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521505.142430:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521505.142431:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521505.143361:0:19185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788521505.143370:0:19185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc6cc799/0x411dd0ee4d2d2710 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.143382:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1788521505.143387:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521505.143392:0:19185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc6cc799/0x411dd0ee4d2d2710 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.143403:0:19185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc6cc799/0x411dd0ee4d2d2710 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.143412:0:19185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc6cc799/0x411dd0ee4d2d2710 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.143420:0:19185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc6cc799/0x411dd0ee4d2d2710 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.143444:0:19185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521505.143563:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521505.143571:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc6cc799/0x411dd0ee4d2d2710 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.143581:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434ab800 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:3.0:1788521505.143585:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc6cc799/0x411dd0ee4d2d2710 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.143594:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc6cc799/0x411dd0ee4d2d2710 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.143608:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc6cc799/0x411dd0ee4d2d2710 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.143615:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc6cc799/0x411dd0ee4d2d2710 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.143629:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521505.143631:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521505.143633:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521505.143810:0:19185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788521505.143816:0:19185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093a00922/0x411dd0ee4d2d2717 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.143830:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1788521505.143833:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521505.143837:0:19185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093a00922/0x411dd0ee4d2d2717 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.143847:0:19185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093a00922/0x411dd0ee4d2d2717 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.143855:0:19185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093a00922/0x411dd0ee4d2d2717 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.143862:0:19185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093a00922/0x411dd0ee4d2d2717 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.143904:0:19185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788521505.144054:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521505.144060:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093a00922/0x411dd0ee4d2d2717 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.144067:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434abc00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:0.0:1788521505.144071:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093a00922/0x411dd0ee4d2d2717 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.144078:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093a00922/0x411dd0ee4d2d2717 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.144089:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093a00922/0x411dd0ee4d2d2717 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.144096:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093a00922/0x411dd0ee4d2d2717 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.144110:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521505.144111:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521505.144113:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521505.144341:0:19185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788521505.144347:0:19185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024ccfe76/0x411dd0ee4d2d271e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.144356:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1788521505.144359:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521505.144363:0:19185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024ccfe76/0x411dd0ee4d2d271e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.144372:0:19185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024ccfe76/0x411dd0ee4d2d271e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.144391:0:19185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024ccfe76/0x411dd0ee4d2d271e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.144397:0:19185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024ccfe76/0x411dd0ee4d2d271e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.144419:0:19185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521505.144561:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521505.144567:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024ccfe76/0x411dd0ee4d2d271e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.144581:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa000 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:3.0:1788521505.144585:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024ccfe76/0x411dd0ee4d2d271e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.144594:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024ccfe76/0x411dd0ee4d2d271e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.144606:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024ccfe76/0x411dd0ee4d2d271e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.144613:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024ccfe76/0x411dd0ee4d2d271e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.144626:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521505.144628:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521505.144630:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521505.145019:0:19185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788521505.145026:0:19185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad43823c/0x411dd0ee4d2d2725 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.145035:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1788521505.145038:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521505.145042:0:19185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad43823c/0x411dd0ee4d2d2725 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.145051:0:19185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad43823c/0x411dd0ee4d2d2725 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.145059:0:19185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad43823c/0x411dd0ee4d2d2725 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.145065:0:19185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad43823c/0x411dd0ee4d2d2725 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.145126:0:19185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788521505.146334:0:19185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788521505.146344:0:19185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d272c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.146355:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1788521505.146359:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521505.146364:0:19185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d272c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.146375:0:19185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d272c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.146383:0:19185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d272c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.146390:0:19185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d272c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.148344:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788521505.148357:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad43823c/0x411dd0ee4d2d2725 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.148369:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa800 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:0.0:1788521505.148374:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad43823c/0x411dd0ee4d2d2725 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.148399:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad43823c/0x411dd0ee4d2d2725 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.148418:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad43823c/0x411dd0ee4d2d2725 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.148426:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad43823c/0x411dd0ee4d2d2725 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.148576:0:19185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788521505.148588:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521505.148593:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d272c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.148599:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434aa600 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:1.0:1788521505.148609:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d272c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.148618:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d272c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.148629:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d272c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.148636:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7f19744/0x411dd0ee4d2d272c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.148650:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521505.148652:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521505.148675:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521505.148696:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521505.149566:0:19185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788521505.149574:0:19185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007b49d87/0x411dd0ee4d2d2733 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.149587:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1788521505.149592:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521505.149599:0:19185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007b49d87/0x411dd0ee4d2d2733 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.149611:0:19185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007b49d87/0x411dd0ee4d2d2733 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.149621:0:19185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007b49d87/0x411dd0ee4d2d2733 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.149636:0:19185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007b49d87/0x411dd0ee4d2d2733 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.149693:0:19185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788521505.150099:0:19185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788521505.150105:0:19185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003acec12e/0x411dd0ee4d2d273a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.150115:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1788521505.150118:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521505.150122:0:19185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003acec12e/0x411dd0ee4d2d273a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.150131:0:19185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003acec12e/0x411dd0ee4d2d273a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.150140:0:19185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003acec12e/0x411dd0ee4d2d273a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.150147:0:19185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003acec12e/0x411dd0ee4d2d273a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.150267:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788521505.150275:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007b49d87/0x411dd0ee4d2d2733 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.150282:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434ab600 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:0.0:1788521505.150286:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007b49d87/0x411dd0ee4d2d2733 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.150296:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007b49d87/0x411dd0ee4d2d2733 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.150310:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007b49d87/0x411dd0ee4d2d2733 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.150318:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007b49d87/0x411dd0ee4d2d2733 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.150455:0:19185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788521505.150464:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521505.150468:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003acec12e/0x411dd0ee4d2d273a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.150493:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434abe00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:1.0:1788521505.150497:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003acec12e/0x411dd0ee4d2d273a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.150505:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003acec12e/0x411dd0ee4d2d273a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.150516:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003acec12e/0x411dd0ee4d2d273a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.150525:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003acec12e/0x411dd0ee4d2d273a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.150540:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521505.150541:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521505.150655:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521505.150678:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521505.151123:0:19185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788521505.151131:0:19185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004701b9f7/0x411dd0ee4d2d2741 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.151140:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1788521505.151144:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521505.151148:0:19185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004701b9f7/0x411dd0ee4d2d2741 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.151158:0:19185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004701b9f7/0x411dd0ee4d2d2741 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.151300:0:19185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004701b9f7/0x411dd0ee4d2d2741 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.151307:0:19185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004701b9f7/0x411dd0ee4d2d2741 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.151360:0:19185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788521505.151706:0:19185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788521505.151713:0:19185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005259ea25/0x411dd0ee4d2d2748 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.151722:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=555s v=(0 0) 00010000:00010000:1.0:1788521505.151725:0:19185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521505.151729:0:19185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005259ea25/0x411dd0ee4d2d2748 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.151738:0:19185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005259ea25/0x411dd0ee4d2d2748 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.151746:0:19185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005259ea25/0x411dd0ee4d2d2748 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.151754:0:19185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005259ea25/0x411dd0ee4d2d2748 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.151801:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788521505.151808:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004701b9f7/0x411dd0ee4d2d2741 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.151815:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef821dc200 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:0.0:1788521505.151819:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004701b9f7/0x411dd0ee4d2d2741 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.151827:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004701b9f7/0x411dd0ee4d2d2741 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.151841:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004701b9f7/0x411dd0ee4d2d2741 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.151847:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004701b9f7/0x411dd0ee4d2d2741 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.151865:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521505.151869:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005259ea25/0x411dd0ee4d2d2748 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.151875:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef821dde00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:0.0:1788521505.151878:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005259ea25/0x411dd0ee4d2d2748 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.151932:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005259ea25/0x411dd0ee4d2d2748 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.151944:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005259ea25/0x411dd0ee4d2d2748 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.151952:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521505.151954:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521505.151956:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521505.152340:0:19185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788521505.152346:0:19185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005259ea25/0x411dd0ee4d2d2748 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788521505.152408:0:19185:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:1.0:1788521505.152497:0:19185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17225:x1875400222511232:12345-0@lo:5:osp-pre-0-0.0 Request processed in 96344us (96677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521505.152506:0:19185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788521505.152598:0:17225:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17225:1875400222511232:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788521505.152614:0:17225:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:2.0:1788521505.152669:0:17225:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee436ced80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17225:1875400222511360:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788521505.152708:0:17225:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521505.152739:0:17225:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee4241f900 going to sleep for 11 seconds 00000100:00100000:1.0:1788521505.152793:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222511360 00000100:00100000:1.0:1788521505.152800:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222511360 00000100:00100000:1.0:1788521505.152847:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788521505.152856:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17225:x1875400222511360:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788521505.152918:0:18704:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:0.0:1788521505.156021:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788521505.163114:0:18701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1788521505.163157:0:18701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788521505.163768:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17225:x1875400222511360:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10909us (11055us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788521505.163780:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788521505.163850:0:17225:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1788521505.163858:0:17225:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee436ced80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17225:1875400222511360:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788521505.163873:0:17225:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:3.0:1788521505.232792:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521505.422834:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788521505.422859:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222511488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788521505.422961:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521505.423028:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222511488 00000100:00100000:1.0:1788521505.423035:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222511488 00000100:00100000:1.0:1788521505.423077:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788521505.423085:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222511488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788521505.423114:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788521505.423152:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222511488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521505.423165:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788521505.423231:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222511488:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788521505.424095:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521505.424110:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee436ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222511616:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788521505.424185:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521505.424551:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222511616 00000100:00100000:2.0:1788521505.424558:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222511616 00000100:00100000:2.0:1788521505.424594:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788521505.424602:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222511616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788521505.424622:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788521505.424664:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222511616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521505.424671:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521505.424751:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee436ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222511616:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788521505.933187:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788521505.933211:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222511744:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788521505.933304:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521505.933438:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222511744 00000100:00100000:1.0:1788521505.933445:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222511744 00000100:00100000:1.0:1788521505.933493:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788521505.933502:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222511744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788521505.933533:0:17940:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788521505.933592:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222511744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521505.933600:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788521505.933645:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222511744:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788521506.268420:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788521506.637480:0:17953:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1788521506.774146:0:19519:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788521506.774150:0:19519:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788521506.774151:0:19519:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788521506.774297:0:19519:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8fef7a3bc000 00000020:01000004:1.0:1788521506.774313:0:19519:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788521506.774327:0:19519:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788521506.774339:0:19519:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8fef46a08000) 00000020:00000080:1.0:1788521506.774355:0:19519:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788521506.862242:0:19519:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788521506.872849:0:19519:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788521506.873879:0:19519:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788521506.874339:0:19519:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788521506.874644:0:19519:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788521506.875598:0:19519:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788521506.876269:0:19519:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:3.0:1788521506.883648:0:19519:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788521506.884339:0:19519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788521506.884514:0:19519:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788521506.884530:0:19519:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x411dd0ee4d2d2756 00000020:01000004:3.0:1788521506.884538:0:19519:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788521506.884569:0:19519:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.141@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788521506.884573:0:19519:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788521506.884579:0:19519:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788521506.884615:0:19519:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788521506.884623:0:19519:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.141@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788521506.910104:0:19519:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.141@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788521506.910154:0:19519:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.141@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788521506.910159:0:19519:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788521506.910160:0:19519:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788521506.910162:0:19519:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788521506.910163:0:19519:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788521506.910164:0:19519:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788521506.910166:0:19519:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788521506.910167:0:19519:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788521506.910169:0:19519:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788521506.910170:0:19519:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788521506.910174:0:19519:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788521506.910177:0:19519:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788521506.910178:0:19519:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788521506.910179:0:19519:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788521506.910180:0:19519:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788521506.910181:0:19519:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788521506.910182:0:19519:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788521506.910183:0:19519:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788521506.910184:0:19519:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788521506.910185:0:19519:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788521506.910224:0:19519:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788521506.910246:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222511872:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788521506.910316:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521506.910361:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef42bb7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788521506.910421:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222511872 00000100:00100000:1.0:1788521506.910429:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222511872 00000100:00100000:1.0:1788521506.910484:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788521506.910493:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:19519:x1875400222511872:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788521506.910521:0:17192:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788521506.910524:0:17192:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788521506.910528:0:17192:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788521506.910864:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:19519:x1875400222511872:12345-0@lo:253:mount.lustre.0 Request processed in 372us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521506.910880:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788521506.911195:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222511872:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788521506.911207:0:19519:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788521506.911209:0:19519:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788521506.911219:0:19519:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788521506.911221:0:19519:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788521506.911222:0:19519:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788521506.911223:0:19519:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788521506.911225:0:19519:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788521506.911226:0:19519:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788521506.911227:0:19519:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788521506.911228:0:19519:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788521506.911253:0:19519:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8fef7a3bc000 from lustre-OST0001 10000000:01000000:3.0:1788521506.911277:0:19519:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788521506.911279:0:19519:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788521506.911287:0:19519:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8fee421399c0 local copy 00010000:00010000:3.0:1788521506.911297:0:19519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d23a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d23ac expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521506.911377:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222512000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788521506.911410:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521506.911502:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee410b3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788521506.913413:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222512000 00000100:00100000:2.0:1788521506.913498:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222512000 00000100:00100000:2.0:1788521506.913560:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788521506.913570:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:19519:x1875400222512000:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521506.913902:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:19519:x1875400222512000:12345-0@lo:501:mount.lustre.0 Request processed in 312us (2469us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788521506.913911:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788521506.913945:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222512000:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788521506.913968:0:19519:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788521506.913991:0:19519:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788521506.914000:0:19519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d23a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d23ac expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521506.914011:0:19519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fee434ab200/0x411dd0ee4d2d23a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d23ac expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521506.914041:0:19519:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8fef7a3bc000 10000000:01000000:3.0:1788521506.914047:0:19519:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788521506.914052:0:19519:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788521506.914055:0:19519:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788521506.914059:0:19519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788521506.914062:0:19519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788521506.914088:0:19519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6600/0x411dd0ee4d2d275d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521506.914108:0:19519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6600/0x411dd0ee4d2d275d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521506.914191:0:19519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6600/0x411dd0ee4d2d275d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521506.914211:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222512128:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788521506.914251:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521506.914284:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee410b3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788521506.914389:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222512128 00000100:00100000:1.0:1788521506.914393:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222512128 00000100:00100000:1.0:1788521506.914481:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788521506.914489:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:19519:x1875400222512128:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788521506.914498:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521506.914509:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef821dd800/0x411dd0ee4d2d2764 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d275d expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521506.914529:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef821dd800/0x411dd0ee4d2d2764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d275d expref: 22 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521506.914748:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef821dd800/0x411dd0ee4d2d2764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d275d expref: 22 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521506.914757:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef821dd800, rc 0) 00000100:00100000:1.0:1788521506.914793:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+22:19519:x1875400222512128:12345-0@lo:101:mount.lustre.0 Request processed in 306us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521506.914799:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788521506.914860:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222512128:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788521506.914872:0:19519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6600/0x411dd0ee4d2d275d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2764 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521506.914880:0:19519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6600/0x411dd0ee4d2d275d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d2764 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788521506.919063:0:19519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788521506.922395:0:19519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788521506.928349:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788521506.928404:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788521506.930598:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788521506.930649:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788521506.930667:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788521506.930681:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788521506.930711:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788521506.930718:0:19519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788521506.930825:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222512256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788521506.930908:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521506.930955:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee410b3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521506.931165:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222512256 00000100:00100000:2.0:1788521506.931174:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222512256 00000100:00100000:2.0:1788521506.931234:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788521506.931244:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+22:19519:x1875400222512256:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521506.931396:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+22:19519:x1875400222512256:12345-0@lo:501:mount.lustre.0 Request processed in 153us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521506.931403:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788521506.932451:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222512256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788521506.932516:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222512384:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788521506.932568:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521506.933289:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee410b3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521506.937295:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222512384 00000100:00100000:1.0:1788521506.937310:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222512384 00000100:00100000:1.0:1788521506.937381:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788521506.937392:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+22:19519:x1875400222512384:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788521506.938457:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+22:19519:x1875400222512384:12345-0@lo:503:mount.lustre.0 Request processed in 1063us (5885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521506.938468:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788521506.938590:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222512384:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788521506.941827:0:19519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788521506.941973:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222512512:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788521506.942060:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521506.942093:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4810f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521506.942312:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222512512 00000100:00100000:1.0:1788521506.942327:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222512512 00000100:00100000:1.0:1788521506.942377:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788521506.942386:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+22:19519:x1875400222512512:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788521506.943001:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+22:19519:x1875400222512512:12345-0@lo:502:mount.lustre.0 Request processed in 615us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521506.943010:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788521506.943255:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222512512:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788521506.943510:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788521506.943540:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788521506.943567:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788521506.943579:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788521506.943591:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788521506.943602:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788521506.943614:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788521506.943625:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788521506.943653:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788521506.943684:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222512640:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788521506.943728:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521506.943764:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee41a689c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521506.943964:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222512640 00000100:00100000:2.0:1788521506.943970:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222512640 00000100:00100000:2.0:1788521506.944010:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788521506.944017:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+22:19519:x1875400222512640:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788521506.944129:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+22:19519:x1875400222512640:12345-0@lo:502:mount.lustre.0 Request processed in 105us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521506.944137:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788521506.944156:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222512640:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788521506.944198:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788521506.944207:0:19519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1788521506.952403:0:19523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788521506.952414:0:19523:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788521506.952420:0:19523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521506.952422:0:19523:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788521506.952430:0:19523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788521506.952445:0:19523:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8fef7efe8000) 00000020:00000080:2.0:1788521506.952472:0:19523:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788521506.952479:0:19523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788521506.952586:0:19523:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fef7a3bc000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788521506.952595:0:19523:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788521506.952602:0:19523:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x411dd0ee4d2d2772 00010000:00010000:0.0:1788521506.964805:0:19523:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1788521506.965798:0:19523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1788521506.972268:0:19523:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1788521506.978610:0:19523:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788521506.978623:0:19523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521506.978630:0:19523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521506.978632:0:19523:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788521506.978635:0:19523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521506.978639:0:19523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521506.978641:0:19523:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788521506.978643:0:19523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788521506.978645:0:19523:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788521506.978647:0:19523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521506.978649:0:19523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521506.978651:0:19523:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788521506.978653:0:19523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521506.978656:0:19523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521506.978657:0:19523:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788521506.978660:0:19523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788521506.978685:0:19523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521506.978688:0:19523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521506.978689:0:19523:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788521506.978692:0:19523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1788521506.987509:0:19519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788521506.987569:0:19519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788521506.987586:0:19519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6600/0x411dd0ee4d2d275d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2764 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521506.987599:0:19519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6600/0x411dd0ee4d2d275d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2764 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521506.987607:0:19519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fef7a3bc000 from 1 10000000:01000000:1.0:1788521506.987609:0:19519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788521506.987646:0:19519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef821dd200/0x411dd0ee4d2d2779 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521506.987654:0:19519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef821dd200/0x411dd0ee4d2d2779 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521506.987664:0:19519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef821dd200/0x411dd0ee4d2d2779 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521506.987686:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222512768:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788521506.987760:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521506.987803:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef51dced80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521506.991805:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222512768 00000100:00100000:2.0:1788521506.991817:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222512768 00000100:00100000:2.0:1788521506.991870:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788521506.991880:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+22:19519:x1875400222512768:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521506.991913:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521506.991933:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef457f3a00/0x411dd0ee4d2d2780 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d2779 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521506.991958:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef457f3a00/0x411dd0ee4d2d2780 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2779 expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521506.992003:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef457f3a00/0x411dd0ee4d2d2780 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2779 expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521506.992012:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef457f3a00, rc 0) 00000100:00100000:2.0:1788521506.992080:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+23:19519:x1875400222512768:12345-0@lo:101:mount.lustre.0 Request processed in 202us (4320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521506.992087:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788521506.993369:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222512768:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788521506.993393:0:19519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef821dd200/0x411dd0ee4d2d2779 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2780 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521506.993404:0:19519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef821dd200/0x411dd0ee4d2d2779 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d2780 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788521506.995829:0:19519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788521506.997084:0:19519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788521506.997355:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788521506.997380:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788521506.997414:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788521506.997432:0:19519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788521506.997508:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222512896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788521506.997577:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521506.997620:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee433e4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521506.998924:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222512896 00000100:00100000:2.0:1788521506.998935:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222512896 00000100:00100000:2.0:1788521506.998985:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788521506.999006:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+23:19519:x1875400222512896:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521506.999149:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+23:19519:x1875400222512896:12345-0@lo:501:mount.lustre.0 Request processed in 145us (1572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521506.999156:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788521506.999522:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222512896:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788521506.999584:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222513024:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788521506.999639:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521506.999675:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef43200d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521506.999718:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222513024 00000100:00100000:0.0:1788521506.999724:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222513024 00000100:00100000:0.0:1788521506.999757:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788521506.999763:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+23:19519:x1875400222513024:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788521506.999855:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+23:19519:x1875400222513024:12345-0@lo:503:mount.lustre.0 Request processed in 92us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521506.999862:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788521507.000189:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222513024:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788521507.000597:0:19519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788521507.000661:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222513152:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788521507.000706:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521507.000741:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef42bb7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788521507.002185:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222513152 00000100:00100000:0.0:1788521507.002196:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222513152 00000100:00100000:0.0:1788521507.002251:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788521507.002260:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+23:19519:x1875400222513152:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788521507.002414:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+23:19519:x1875400222513152:12345-0@lo:502:mount.lustre.0 Request processed in 154us (1707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521507.002432:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788521507.002717:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222513152:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788521507.002943:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788521507.003004:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788521507.003019:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788521507.003032:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788521507.003044:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788521507.003056:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788521507.003074:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788521507.003086:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1788521507.003099:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788521507.003117:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1788521507.003131:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1788521507.003170:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222513280:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788521507.003227:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521507.003254:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef51dced80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521507.004052:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222513280 00000100:00100000:1.0:1788521507.004060:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222513280 00000100:00100000:1.0:1788521507.004094:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788521507.004101:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+23:19519:x1875400222513280:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788521507.004390:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+23:19519:x1875400222513280:12345-0@lo:502:mount.lustre.0 Request processed in 288us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521507.004398:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788521507.005598:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222513280:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788521507.005680:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1788521507.005694:0:19519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788521507.010506:0:19527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521507.010522:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521507.010524:0:19527:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788521507.010613:0:19527:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fef7a3bc000 00000020:00000080:3.0:1788521507.010617:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788521507.010626:0:19527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521507.010629:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521507.010630:0:19527:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788521507.010632:0:19527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521507.010635:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521507.010636:0:19527:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788521507.010639:0:19527:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fef7a3bc000 00000020:00000080:3.0:1788521507.010641:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788521507.010759:0:19527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521507.010764:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521507.010765:0:19527:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788521507.010768:0:19527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521507.010770:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521507.010772:0:19527:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788521507.010775:0:19527:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fef7a3bc000 00000020:00000080:3.0:1788521507.010777:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788521507.014473:0:19527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521507.014485:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521507.014487:0:19527:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788521507.014492:0:19527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521507.014502:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521507.014503:0:19527:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788521507.014508:0:19527:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fef7a3bc000 00000020:00000080:3.0:1788521507.014510:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788521507.016113:0:19527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521507.016121:0:19527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521507.016123:0:19527:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788521507.016128:0:19527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1788521507.021256:0:19519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788521507.021304:0:19519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788521507.021319:0:19519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef821dd200/0x411dd0ee4d2d2779 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2780 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521507.021340:0:19519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef821dd200/0x411dd0ee4d2d2779 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2780 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521507.021528:0:19519:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788521507.021531:0:19519:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8fef7a3bc000 10000000:01000000:1.0:1788521507.021535:0:19519:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8fef7a3bc000 10000000:01000000:1.0:1788521507.021540:0:19519:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788521507.021546:0:19519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fef7a3bc000 from 1 10000000:01000000:1.0:1788521507.021550:0:19519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788521507.021590:0:19519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef821dd400/0x411dd0ee4d2d2787 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521507.021598:0:19519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef821dd400/0x411dd0ee4d2d2787 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521507.021608:0:19519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef821dd400/0x411dd0ee4d2d2787 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521507.021632:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222513408:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788521507.021702:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521507.021740:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222513408 00000100:00100000:1.0:1788521507.021746:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222513408 00000100:00100000:1.0:1788521507.021786:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788521507.021795:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+23:19519:x1875400222513408:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788521507.021806:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521507.021818:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef821dd000/0x411dd0ee4d2d278e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d2787 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521507.021852:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef821dd000/0x411dd0ee4d2d278e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2787 expref: 24 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521507.021862:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef821dd000/0x411dd0ee4d2d278e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2787 expref: 24 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521507.021871:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef821dd000, rc 0) 00000100:00100000:1.0:1788521507.021919:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:19519:x1875400222513408:12345-0@lo:101:mount.lustre.0 Request processed in 125us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521507.021926:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788521507.022257:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef42bb2840 going to sleep for 11 seconds 00000100:00100000:1.0:1788521507.022280:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222513408:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788521507.022296:0:19519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef821dd400/0x411dd0ee4d2d2787 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d278e expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521507.022307:0:19519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef821dd400/0x411dd0ee4d2d2787 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d278e expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788521507.031700:0:19519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1788521507.033308:0:19519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788521507.033547:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788521507.033575:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788521507.033589:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788521507.033602:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788521507.033613:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788521507.033626:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788521507.033640:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788521507.033653:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788521507.033678:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788521507.033692:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788521507.033705:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788521507.033716:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788521507.034539:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788521507.034558:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788521507.034568:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788521507.034579:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788521507.034589:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788521507.034603:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788521507.034616:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788521507.034629:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788521507.034641:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788521507.034653:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788521507.034665:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788521507.034679:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788521507.034694:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1788521507.034706:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1788521507.034724:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1788521507.034739:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1788521507.034770:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1788521507.034786:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1788521507.034798:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1788521507.034809:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1788521507.034821:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1788521507.034833:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1788521507.034845:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1788521507.034856:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1788521507.034867:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1788521507.034879:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1788521507.034911:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1788521507.034926:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1788521507.034940:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1788521507.034978:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1788521507.034990:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1788521507.035002:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1788521507.035036:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1788521507.035051:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1788521507.035084:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1788521507.035089:0:19519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1788521507.035190:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222513536:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788521507.035269:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521507.035315:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4e6cc240 going to sleep for 11 seconds 00000100:00100000:0.0:1788521507.035686:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222513536 00000100:00100000:0.0:1788521507.035700:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222513536 00000100:00100000:0.0:1788521507.035753:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788521507.035762:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:19519:x1875400222513536:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788521507.035923:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:19519:x1875400222513536:12345-0@lo:501:mount.lustre.0 Request processed in 161us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521507.035933:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788521507.037324:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222513536:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788521507.037379:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222513664:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788521507.037440:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521507.037482:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef6d98b540 going to sleep for 11 seconds 00000100:00100000:0.0:1788521507.037506:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222513664 00000100:00100000:0.0:1788521507.037512:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222513664 00000100:00100000:0.0:1788521507.037562:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788521507.037572:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:19519:x1875400222513664:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788521507.037687:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:19519:x1875400222513664:12345-0@lo:503:mount.lustre.0 Request processed in 115us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521507.037694:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788521507.037747:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222513664:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788521507.038171:0:19519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788521507.038269:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222513792:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788521507.038308:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521507.038327:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef42bb2840 going to sleep for 11 seconds 00000100:00100000:0.0:1788521507.038342:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222513792 00000100:00100000:0.0:1788521507.038347:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222513792 00000100:00100000:0.0:1788521507.038372:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788521507.038378:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:19519:x1875400222513792:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788521507.038463:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:19519:x1875400222513792:12345-0@lo:502:mount.lustre.0 Request processed in 84us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521507.038469:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788521507.038510:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222513792:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788521507.039402:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788521507.039448:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788521507.039461:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788521507.039475:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788521507.039489:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788521507.039501:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788521507.039513:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788521507.039526:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788521507.039755:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788521507.039784:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788521507.039800:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788521507.039814:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788521507.039827:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788521507.039840:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788521507.039853:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788521507.039867:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788521507.040158:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788521507.040185:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788521507.040200:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788521507.040329:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788521507.040347:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788521507.040361:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788521507.040375:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788521507.040389:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788521507.040401:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1788521507.040485:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1788521507.040509:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1788521507.040523:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1788521507.040798:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1788521507.040817:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1788521507.040831:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1788521507.040847:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1788521507.040862:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1788521507.040875:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1788521507.040927:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1788521507.040944:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1788521507.040960:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1788521507.040973:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1788521507.041004:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1788521507.041016:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1788521507.041028:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1788521507.041052:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1788521507.041064:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1788521507.041074:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1788521507.041084:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1788521507.041094:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1788521507.041103:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1788521507.041113:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1788521507.041175:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222513920:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788521507.041255:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521507.041293:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef42bb2840 going to sleep for 11 seconds 00000100:00100000:2.0:1788521507.043002:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222513920 00000100:00100000:2.0:1788521507.043012:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222513920 00000100:00100000:2.0:1788521507.043069:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788521507.043080:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:19519:x1875400222513920:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788521507.043250:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:19519:x1875400222513920:12345-0@lo:502:mount.lustre.0 Request processed in 172us (1995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521507.043258:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788521507.043315:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222513920:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788521507.043532:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1788521507.043558:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1788521507.043593:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222514048:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788521507.043639:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521507.043677:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef4e6cc6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521507.044644:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222514048 00000100:00100000:2.0:1788521507.044653:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222514048 00000100:00100000:2.0:1788521507.044691:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788521507.044700:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:19519:x1875400222514048:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788521507.044804:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:19519:x1875400222514048:12345-0@lo:502:mount.lustre.0 Request processed in 106us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521507.044818:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788521507.044877:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222514048:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788521507.044959:0:19519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788521507.044969:0:19519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788521507.047756:0:19532:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788521507.047773:0:19532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8fef6e3a4d40) 00000020:00000080:2.0:1788521507.047799:0:19532:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1788521507.047873:0:19532:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fef7a3bc000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788521507.047877:0:19532:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fef7a3bc000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788521507.047879:0:19532:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fef7a3bc000 3 00010000:00080000:1.0:1788521507.048270:0:19532:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fee4376f800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.141@tcp at head 00010000:00010000:1.0:1788521507.051915:0:19532:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788521507.052624:0:19532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788521507.052682:0:19532:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788521507.052698:0:19532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x411dd0ee4d2d279c 00000100:00080000:1.0:1788521507.052709:0:19532:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788521507.052714:0:19532:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8fee4376f800 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:1.0:1788521507.053307:0:19532:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee43d4c380 x1875400222514176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788521507.053335:0:19532:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788521507.053415:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1788521507.053416:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875400222514176:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788521507.053424:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788521507.053429:0:37:0:(import.c:65:import_set_state_nolock()) ffff8fef81580800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788521507.053434:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 555 00000100:00080000:3.0:1788521507.053437:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788521507.053444:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8fef81580800 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:3.0:1788521507.053473:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fef7f0cbb80 x1875400222514560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788521507.053491:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788521507.053509:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788521507.053513:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788521507.053516:0:37:0:(import.c:65:import_set_state_nolock()) ffff8fef6e4db000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788521507.053520:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 555 00000100:00080000:3.0:1788521507.053522:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788521507.053527:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8fef6e4db000 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:3.0:1788521507.053539:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fef715a0e00 x1875400222515072/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788521507.053551:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222514560:0@lo:8:kworker.0 00000100:00100000:1.0:1788521507.053572:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222514176 00000100:00100000:1.0:1788521507.053585:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222514176 00000100:00100000:0.0:1788521507.053585:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521507.053592:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222514304:0@lo:400:kworker.0 00000100:00100000:0.0:1788521507.053614:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222515072:0@lo:8:kworker.0 00000100:00100000:1.0:1788521507.053627:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788521507.053633:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521507.053639:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875400222514176:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788521507.053654:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521507.053663:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222514944:0@lo:400:kworker.0 00010000:00080000:1.0:1788521507.053666:0:17200:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 557 last 0 00000100:00100000:0.0:1788521507.053692:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222514432:0@lo:400:kworker.0 00000100:00100000:3.0:1788521507.053708:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1788521507.053710:0:17200:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x411dd0ee4d2d27a3 00000100:00100000:0.0:1788521507.053727:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00100000:1.0:1788521507.053729:0:17200:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1788521507.053738:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788521507.053752:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222515200:0@lo:400:kworker.0 00000100:00100000:3.0:1788521507.053760:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222514816:0@lo:400:kworker.0 00000100:00100000:0.0:1788521507.053775:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521507.053793:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521507.053797:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788521507.053804:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222514688:0@lo:400:kworker.0 00000100:00100000:3.0:1788521507.053819:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875400222515456:0@lo:400:kworker.0 00000100:00100000:0.0:1788521507.053833:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788521507.053837:0:17200:0:(import.c:65:import_set_state_nolock()) ffff8fee4376e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788521507.053852:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875400222515328:0@lo:400:kworker.0 00000100:00100000:3.0:1788521507.053854:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521507.053922:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222514304 00000100:00100000:3.0:1788521507.053926:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222514304 00000100:00100000:3.0:1788521507.053964:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222514816 00000100:00100000:3.0:1788521507.053968:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222514816 00000100:00100000:3.0:1788521507.053998:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788521507.055316:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222514304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521507.057417:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222514560 00000100:00100000:2.0:1788521507.057430:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222514560 00000100:00100000:2.0:1788521507.057458:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222515072 00000100:00100000:2.0:1788521507.057461:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222515072 00000100:00100000:2.0:1788521507.057487:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222514944 00000100:00100000:2.0:1788521507.057490:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222514944 00000100:00100000:2.0:1788521507.057654:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222514432 00000100:00100000:2.0:1788521507.057658:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222514432 00000100:00100000:2.0:1788521507.057681:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788521507.057689:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222514944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521507.062093:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521507.064150:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521507.064182:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222514432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521507.064294:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222514432:12345-0@lo:400:kworker.0 Request processed in 122us (10567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521507.064301:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521507.064328:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788521507.064333:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1875400222514560:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788521507.064385:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1875400222514560:12345-0@lo:8:kworker.0 Request processed in 51us (10800us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788521507.064391:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788521507.064405:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788521507.064410:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1875400222515072:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788521507.064441:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1875400222515072:12345-0@lo:8:kworker.0 Request processed in 30us (10789us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788521507.064447:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788521507.064490:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788521507.064500:0:17201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788521507.064522:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788521507.064667:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222514304:12345-0@lo:400:kworker.0 Request processed in 10661us (11034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521507.064675:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788521507.064723:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222514304:0@lo:400:kworker.0 00000100:00100000:0.0:1788521507.064896:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222514816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521507.064943:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222514816:12345-0@lo:400:kworker.0 Request processed in 414us (11150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521507.064949:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788521507.065076:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788521507.065084:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef6e4db000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788521507.065088:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788521507.065091:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222515072:0@lo:8:kworker.0 00000100:00100000:0.0:1788521507.065102:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788521507.065105:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef81580800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788521507.065108:0:3642:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788521507.065110:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222514560:0@lo:8:kworker.0 00000100:00100000:0.0:1788521507.065155:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222514432:0@lo:400:kworker.0 00000100:00100000:0.0:1788521507.065513:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222515200 00000100:00100000:0.0:1788521507.065520:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222515200 00000100:00100000:3.0:1788521507.065665:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222514816:0@lo:400:kworker.0 00000100:00100000:0.0:1788521507.066092:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788521507.066101:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222514688 00000100:00100000:0.0:1788521507.066104:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222514688 00000100:00100000:0.0:1788521507.066117:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788521507.066121:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222515456 00000100:00100000:0.0:1788521507.066124:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222515456 00000100:00100000:0.0:1788521507.066138:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788521507.066142:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222515328 00000100:00100000:0.0:1788521507.066145:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222515328 00000100:00100000:0.0:1788521507.066156:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788521507.066273:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788521507.066283:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222515200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521507.066352:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222515200:12345-0@lo:400:kworker.0 Request processed in 71us (12576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521507.066358:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788521507.066372:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788521507.066378:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788521507.066383:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222514688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521507.066407:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222514688:12345-0@lo:400:kworker.0 Request processed in 24us (12575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521507.066412:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788521507.066420:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788521507.066426:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788521507.066431:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875400222515456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521507.066472:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875400222515456:12345-0@lo:400:kworker.0 Request processed in 40us (12619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521507.066479:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788521507.066492:0:17201:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00010000:00080000:3.0:1788521507.066493:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee43c65f80 x1875400222515456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521507.066502:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788521507.066514:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875400222515456:0@lo:400:kworker.0 00000100:00100000:0.0:1788521507.066515:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875400222515328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521507.067085:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875400222515328:12345-0@lo:400:kworker.0 Request processed in 572us (4999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521507.067093:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788521507.067127:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef7f0c9180 x1875400222514688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521507.067139:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222514688:0@lo:400:kworker.0 00010000:00080000:0.0:1788521507.067275:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef715a1880 x1875400222515328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521507.067286:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875400222515328:0@lo:400:kworker.0 00010000:00080000:0.0:1788521507.067300:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fef715a0000 x1875400222515200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521507.067308:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222515200:0@lo:400:kworker.0 00000100:00100000:1.0:1788521507.068591:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875400222514176:12345-0@lo:38:llog_process_th.0 Request processed in 14949us (15096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521507.068602:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788521507.068632:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788521507.068637:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788521507.068640:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:1.0:1788521507.068767:0:19532:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788521507.068793:0:19532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8fee41b58000) 00000020:00000080:1.0:1788521507.068818:0:19532:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788521507.068937:0:19532:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fef7a3bc000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788521507.068941:0:19532:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fef7a3bc000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788521507.068944:0:19532:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fef7a3bc000 3 00010000:00080000:1.0:1788521507.068989:0:19532:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fee4376e800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.141@tcp at head 00010000:00080000:0.0:1788521507.071976:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee43d4c380 x1875400222514176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788521517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521507.072002:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788521507.072011:0:3642:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788521507.072021:0:3642:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788521507.072028:0:3642:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788521507.072031:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fee4376f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788521507.072038:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3642:1875400222514176:0@lo:38:llog_process_th.0 00010000:00010000:1.0:1788521507.072176:0:19532:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1788521507.072387:0:19532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788521507.072435:0:19532:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788521507.072448:0:19532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x411dd0ee4d2d27b1 00000100:00080000:1.0:1788521507.072455:0:19532:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788521507.072461:0:19532:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8fee4376e800 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:1.0:1788521507.072490:0:19532:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee43d4c000 x1875400222515584/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788521507.072527:0:19532:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788521507.072551:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1875400222515584:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788521507.072613:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521507.072693:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222515584 00000100:00100000:1.0:1788521507.072700:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222515584 00000100:00100000:0.0:1788521507.072740:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788521507.072748:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3642:x1875400222515584:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788521507.072772:0:19535:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:0.0:1788521507.072798:0:19535:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x411dd0ee4d2d27b8 00000004:00100000:0.0:1788521507.072811:0:19535:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788521507.072837:0:19535:0:(import.c:65:import_set_state_nolock()) ffff8fef44a9a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788521507.072904:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875400222515584:12345-0@lo:38:llog_process_th.0 Request processed in 133us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521507.072918:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788521507.072950:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fee43d4c000 x1875400222515584/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788521517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521507.072959:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788521507.072963:0:3642:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788521507.072967:0:3642:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788521507.072970:0:3642:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788521507.072972:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fee4376e800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788521507.072976:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3642:1875400222515584:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788521507.073486:0:19532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1788521507.073601:0:19519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788521507.073630:0:19519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788521507.073644:0:19519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef821dd400/0x411dd0ee4d2d2787 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d278e expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521507.073655:0:19519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef821dd400/0x411dd0ee4d2d2787 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d278e expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788521507.073705:0:19519:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788521507.073708:0:19519:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788521507.073710:0:19519:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788521507.073711:0:19519:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788521507.073712:0:19519:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788521507.073714:0:19519:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788521507.073717:0:19519:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788521507.073719:0:19519:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788521507.073721:0:19519:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788521507.073724:0:19519:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788521507.073726:0:19519:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788521507.073728:0:19519:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788521507.073729:0:19519:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788521507.073730:0:19519:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788521507.073731:0:19519:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788521507.074339:0:19519:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788521507.074341:0:19519:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788521507.074343:0:19519:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788521507.074344:0:19519:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788521507.074368:0:19519:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788521507.074388:0:19519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222515712:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788521507.074459:0:19519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521507.074508:0:19519:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee435a1180 going to sleep for 11 seconds 00000100:00100000:3.0:1788521507.075310:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222515712 00000100:00100000:3.0:1788521507.075320:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222515712 00000100:00100000:3.0:1788521507.075377:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788521507.075389:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:19519:x1875400222515712:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788521507.075418:0:17193:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788521507.075441:0:17193:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788521507.075631:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222514944:12345-0@lo:400:kworker.0 Request processed in 17941us (21922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521507.075641:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788521507.075687:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222514944:0@lo:400:kworker.0 20000000:01000000:2.0:1788521507.089329:0:17193:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788521507.089339:0:17193:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788521507.089654:0:17216:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788521507.089658:0:17216:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788521507.089679:0:17216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fef7f12c000/0x411dd0ee4d2d27bf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521507.089699:0:17216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fee434aaa00/0x411dd0ee4d2d2668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2661 expref: 24 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521507.089707:0:17216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d2676 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d266f expref: 24 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521507.089715:0:17216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fef7f12c000/0x411dd0ee4d2d27bf lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521507.089754:0:17216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d2676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d266f expref: 24 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521507.089769:0:17216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d2676 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d266f expref: 24 pid: 17193 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521507.089801:0:17216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e2b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1875400222515840:0@lo:104: 00000100:00100000:0.0:1788521507.089861:0:17216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788521507.089940:0:17216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fee434aaa00/0x411dd0ee4d2d2668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d2661 expref: 24 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521507.089948:0:17216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fee434aaa00/0x411dd0ee4d2d2668 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2661 expref: 24 pid: 17194 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521507.089956:0:17216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e2b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1875400222515968:0@lo:104: 00000100:00100000:0.0:1788521507.089993:0:17216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521507.090013:0:17216:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee43649780 going to sleep for 11 seconds 00000100:00100000:1.0:1788521507.090121:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222515840 00000100:00100000:1.0:1788521507.090128:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222515840 00000100:00100000:1.0:1788521507.090172:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222515968 00000100:00100000:1.0:1788521507.090176:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222515968 00000100:00100000:1.0:1788521507.090191:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788521507.090198:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+4:17216:x1875400222515840:12345-0@lo:104: 00010000:00010000:1.0:1788521507.090222:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d600/0x411dd0ee4d2d266f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d2676 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521507.090289:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788521507.090297:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+4:17216:x1875400222515840:12345-0@lo:104: Request processed in 98us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521507.090305:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788521507.090327:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788521507.090334:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+3:17216:x1875400222515968:12345-0@lo:104: 00010000:00010000:1.0:1788521507.090343:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d000/0x411dd0ee4d2d2661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d2668 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521507.090385:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788521507.090391:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:19519:x1875400222515712:12345-0@lo:253:mount.lustre.0 Request processed in 15002us (15929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521507.090394:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+3:17216:x1875400222515968:12345-0@lo:104: Request processed in 60us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521507.090405:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788521507.090408:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00010000:3.0:1788521507.090484:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788521507.090490:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d600/0x411dd0ee4d2d266f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d2676 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521507.090498:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef7f12d600 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:3.0:1788521507.090502:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d600/0x411dd0ee4d2d266f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d2676 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521507.090510:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d600/0x411dd0ee4d2d266f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d2676 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521507.090517:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d600/0x411dd0ee4d2d266f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d2676 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521507.090523:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1788521507.091089:0:19519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:19519:1875400222515712:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788521507.091101:0:19519:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788521507.091104:0:19519:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788521507.091114:0:19519:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788521507.091115:0:19519:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521507.091116:0:19519:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521507.091117:0:19519:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521507.091129:0:19519:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521507.091132:0:19519:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788521507.091134:0:19519:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521507.091135:0:19519:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788521507.091150:0:19519:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788521507.091720:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d600/0x411dd0ee4d2d266f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d2676 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521507.091728:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521507.091750:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d600/0x411dd0ee4d2d266f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d2676 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521507.091757:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d600/0x411dd0ee4d2d266f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d2676 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521507.091772:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521507.091783:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d000/0x411dd0ee4d2d2661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d2668 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521507.091789:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef7f12d000 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:3.0:1788521507.091793:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d000/0x411dd0ee4d2d2661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d2668 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521507.091801:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d000/0x411dd0ee4d2d2661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d2668 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521507.091807:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d000/0x411dd0ee4d2d2661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d2668 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521507.091813:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788521507.091828:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d000/0x411dd0ee4d2d2661 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d2668 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521507.091834:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521507.091850:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d000/0x411dd0ee4d2d2661 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d2668 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521507.091857:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d000/0x411dd0ee4d2d2661 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d2668 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521507.091871:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521507.091873:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521507.091875:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521507.091912:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788521507.091928:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3643:1875400222516096:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521507.092058:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521507.092087:0:17216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e2b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1875400222515840:0@lo:104: 00000100:00100000:0.0:1788521507.092097:0:17216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e2b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17216:1875400222515968:0@lo:104: 00010000:00010000:0.0:1788521507.092116:0:17216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fef7f12c000/0x411dd0ee4d2d27bf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521507.098103:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521507.098206:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3645:1875400222516224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521507.098286:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521507.098487:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222516096 00000100:00100000:0.0:1788521507.098496:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222516096 00010000:00010000:0.0:1788521507.098541:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d2676 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d266f expref: 24 pid: 17193 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521507.098578:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222516224 00000100:00100000:0.0:1788521507.098581:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222516224 00010000:00010000:0.0:1788521507.098594:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fee434aaa00/0x411dd0ee4d2d2668 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2661 expref: 25 pid: 17194 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521507.102956:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788521507.102981:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+25:3643:x1875400222516096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788521507.103002:0:18731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521507.103013:0:18731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d2676 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d266f expref: 25 pid: 17193 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521507.104929:0:18731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d2676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d266f expref: 25 pid: 17193 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521507.104951:0:18731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef413fc600/0x411dd0ee4d2d2676 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d266f expref: 25 pid: 17193 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521507.104968:0:18731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521507.105136:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:3643:x1875400222516096:12345-0@lo:103:ldlm_bl.0 Request processed in 2166us (13157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521507.105146:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788521507.105182:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788521507.105193:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+23:3645:x1875400222516224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788521507.105207:0:18731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521507.105225:0:18731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fee434aaa00/0x411dd0ee4d2d2668 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2661 expref: 23 pid: 17194 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521507.105236:0:18731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fee434aaa00/0x411dd0ee4d2d2668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2661 expref: 23 pid: 17194 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521507.105246:0:18731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fee434aaa00/0x411dd0ee4d2d2668 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d2661 expref: 23 pid: 17194 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521507.105258:0:18731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fef7f12c000/0x411dd0ee4d2d27bf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521507.105267:0:18731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef7f12c000/0x411dd0ee4d2d27bf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788521507.105283:0:18731:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015625055s 00010000:00010000:1.0:1788521507.105294:0:18731:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fef7f12c000/0x411dd0ee4d2d27bf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521507.107099:0:18731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fef7f12c000/0x411dd0ee4d2d27bf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521507.107118:0:18731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fef7f12c000/0x411dd0ee4d2d27bf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521507.107127:0:18731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fef7f12c000/0x411dd0ee4d2d27bf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521507.107133:0:18731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef7f12c000 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:1.0:1788521507.107137:0:18731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fef7f12c000/0x411dd0ee4d2d27bf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521507.107147:0:18731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fef7f12c000/0x411dd0ee4d2d27bf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521507.107168:0:18731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fef7f12c000/0x411dd0ee4d2d27bf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521507.107182:0:18731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521507.107264:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+22:3645:x1875400222516224:12345-0@lo:103:ldlm_bl.0 Request processed in 2072us (8975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521507.107273:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788521507.107938:0:17216:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fef7f12c000/0x411dd0ee4d2d27bf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521507.107963:0:17216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fef7f12c000/0x411dd0ee4d2d27bf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521507.107980:0:17216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef7f12c000/0x411dd0ee4d2d27bf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521507.109388:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3645:1875400222516224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521507.109435:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3643:1875400222516096:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1788521507.118708:0:19519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788521507.125485:0:19519:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788521507.125496:0:19519:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788521507.125601:0:19519:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788521507.125645:0:19519:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.141@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788521507.125664:0:19519:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788521507.125690:0:19519:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788521507.130599:0:19519:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788521507.130866:0:19519:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788521507.278624:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788521508.221947:0:19586:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788521508.222257:0:19586:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788521508.311033:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788521508.622073:0:17196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788521508.622082:0:17196:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fef7a3b2800 from 10 10000000:01000000:0.0:1788521508.622088:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788521508.622135:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d800/0x411dd0ee4d2d27c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521508.622147:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d800/0x411dd0ee4d2d27c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521508.622159:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d800/0x411dd0ee4d2d27c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521508.622183:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222516352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788521508.622269:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521508.622313:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee43649900 going to sleep for 11 seconds 00000100:00100000:2.0:1788521508.622455:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222516352 00000100:00100000:2.0:1788521508.622464:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222516352 00000100:00100000:2.0:1788521508.622537:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788521508.622547:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+22:17196:x1875400222516352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521508.622560:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521508.622574:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef457f3800/0x411dd0ee4d2d27cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d27c6 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521508.622597:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef457f3800/0x411dd0ee4d2d27cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d27c6 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521508.622606:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef457f3800/0x411dd0ee4d2d27cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d27c6 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521508.622616:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef457f3800, rc 0) 00000100:00100000:2.0:1788521508.622667:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+23:17196:x1875400222516352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521508.622701:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788521508.623658:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222516352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521508.623678:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d800/0x411dd0ee4d2d27c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d27cd expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521508.623702:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d800/0x411dd0ee4d2d27c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d27cd expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521508.623817:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222516480:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788521508.623860:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521508.623936:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee43649900 going to sleep for 11 seconds 00000100:00100000:1.0:1788521508.624146:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222516480 00000100:00100000:1.0:1788521508.624154:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222516480 00000100:00100000:1.0:1788521508.624208:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788521508.624225:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+23:17196:x1875400222516480:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788521508.624245:0:17193:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788521508.624597:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788521508.624602:0:17193:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1788521508.624707:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+23:17196:x1875400222516480:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 484us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521508.624715:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788521508.624866:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222516480:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788521508.625822:0:17196:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788521508.625833:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d800/0x411dd0ee4d2d27c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d27cd expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521508.625845:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef7f12d800/0x411dd0ee4d2d27c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d27cd expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521508.625855:0:17196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788521508.625858:0:17196:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fef48513800 from 10 10000000:01000000:0.0:1788521508.625861:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788521508.625921:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef7f12c200/0x411dd0ee4d2d27d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521508.625930:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef7f12c200/0x411dd0ee4d2d27d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521508.625940:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef7f12c200/0x411dd0ee4d2d27d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521508.625960:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222516608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788521508.626371:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521508.626414:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee43649900 going to sleep for 11 seconds 00000100:00100000:1.0:1788521508.626603:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222516608 00000100:00100000:1.0:1788521508.626611:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222516608 00000100:00100000:1.0:1788521508.626707:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788521508.626717:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+23:17196:x1875400222516608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521508.626729:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521508.626754:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef821dc200/0x411dd0ee4d2d27db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d27d4 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521508.626776:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef821dc200/0x411dd0ee4d2d27db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d27d4 expref: 24 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521508.626787:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef821dc200/0x411dd0ee4d2d27db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d27d4 expref: 24 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521508.626796:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef821dc200, rc 0) 00000100:00100000:1.0:1788521508.626839:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:17196:x1875400222516608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521508.626845:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788521508.626917:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222516608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521508.626931:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef7f12c200/0x411dd0ee4d2d27d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d27db expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521508.626940:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef7f12c200/0x411dd0ee4d2d27d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d27db expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521508.627004:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222516736:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788521508.627039:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521508.635932:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee43649900 going to sleep for 11 seconds 00000100:00100000:2.0:1788521508.637985:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222516736 00000100:00100000:2.0:1788521508.638000:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222516736 00000100:00100000:2.0:1788521508.638046:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788521508.638056:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:17196:x1875400222516736:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788521508.638082:0:17192:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788521508.638103:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788521508.638106:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1788521508.638246:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:17196:x1875400222516736:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 191us (11205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521508.638265:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788521508.638320:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222516736:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788521508.638401:0:17196:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788521508.638411:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef7f12c200/0x411dd0ee4d2d27d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d27db expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521508.638420:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef7f12c200/0x411dd0ee4d2d27d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d27db expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521509.324953:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521510.351262:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521510.543720:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521510.543746:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222516864:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788521510.543814:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521510.543926:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222516864 00000100:00100000:0.0:1788521510.543933:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222516864 00000100:00100000:0.0:1788521510.544331:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788521510.544342:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222516864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788521510.544381:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788521510.544430:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222516864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521510.544436:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788521510.544461:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222516992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788521510.544489:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521510.545208:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222516992 00000100:00100000:0.0:1788521510.545216:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222516992 00000100:00100000:0.0:1788521510.545258:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521510.545267:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222516992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788521510.545288:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788521510.546350:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222516864:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1788521510.546400:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521510.546503:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222516992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1235us (2011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521510.546636:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788521510.546844:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222516992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788521510.549999:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521510.550021:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee436cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222517120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521510.550204:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521510.550253:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222517120 00000100:00100000:2.0:1788521510.550259:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222517120 00000100:00100000:2.0:1788521510.550303:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788521510.550373:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222517120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788521510.550405:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788521510.550444:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222517120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521510.550450:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788521510.550469:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521510.550631:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee436cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222517120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521511.053516:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee436cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222517248:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788521511.053586:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521511.053645:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222517248 00000100:00100000:2.0:1788521511.053663:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222517248 00000100:00100000:2.0:1788521511.053712:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788521511.053720:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222517248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788521511.053762:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788521511.053804:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222517248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521511.053810:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788521511.053855:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee436cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222517248:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788521511.373262:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788521512.077320:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788521512.077327:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788521512.077330:0:37:0:(import.c:65:import_set_state_nolock()) ffff8fef81580800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788521512.077343:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8fef81580800 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:3.0:1788521512.077364:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee43c64700 x1875400222517760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788521512.077396:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788521512.077400:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788521512.077402:0:37:0:(import.c:65:import_set_state_nolock()) ffff8fef6e4db000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788521512.077406:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8fef6e4db000 using connection 192.168.203.141@tcp/0@lo 00000100:00100000:3.0:1788521512.077416:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fee43c64380 x1875400222518272/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788521512.077486:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3646:1875400222517376:0@lo:400:kworker.0 00000100:00100000:3.0:1788521512.077640:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521512.077683:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222518016:0@lo:400:kworker.0 00000100:00100000:3.0:1788521512.077711:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521512.077739:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875400222518656:0@lo:400:kworker.0 00000100:00100000:3.0:1788521512.077786:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521512.077813:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788521512.077819:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875400222517888:0@lo:400:kworker.0 00000100:00100000:3.0:1788521512.077840:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521512.077872:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875400222518528:0@lo:400:kworker.0 00000100:00100000:3.0:1788521512.077924:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521512.077952:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222517504:0@lo:400:kworker.0 00000100:00100000:3.0:1788521512.077974:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521512.077989:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222518144:0@lo:400:kworker.0 00000100:00100000:3.0:1788521512.078046:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521512.078062:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222518784:0@lo:400:kworker.0 00000100:00100000:3.0:1788521512.078086:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521512.078101:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788521512.078107:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222517632:0@lo:400:kworker.0 00000100:00100000:3.0:1788521512.078125:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521512.078137:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875400222518400:0@lo:400:kworker.0 00000100:00100000:3.0:1788521512.078154:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521512.078163:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875400222518912:0@lo:400:kworker.0 00000100:00100000:3.0:1788521512.078194:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521512.078216:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222517376 00000100:00100000:3.0:1788521512.078222:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222517376 00000100:00100000:0.0:1788521512.078455:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222517760:0@lo:8:kworker.0 00000100:00100000:0.0:1788521512.078486:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521512.078504:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222518272:0@lo:8:kworker.0 00000100:00100000:0.0:1788521512.078522:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521512.078548:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222518016 00000100:00100000:0.0:1788521512.078552:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222518016 00000100:00100000:0.0:1788521512.078586:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222517504 00000100:00100000:0.0:1788521512.078589:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222517504 00000100:00100000:0.0:1788521512.078603:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788521512.078610:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222518016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521512.078660:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222518016:12345-0@lo:400:kworker.0 Request processed in 50us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521512.078668:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788521512.078682:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788521512.078688:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222517504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521512.078716:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222517504:12345-0@lo:400:kworker.0 Request processed in 29us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521512.078739:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788521512.078761:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222518144 00000100:00100000:0.0:1788521512.078776:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222518144 00000100:00100000:0.0:1788521512.078806:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222517632 00000100:00100000:0.0:1788521512.078809:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222517632 00000100:00100000:0.0:1788521512.078820:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222517760 00000100:00100000:0.0:1788521512.078822:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222517760 00000100:00100000:0.0:1788521512.078830:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222518272 00000100:00100000:0.0:1788521512.078832:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222518272 00000100:00100000:0.0:1788521512.078842:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521512.078847:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222518144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521512.078876:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222518144:12345-0@lo:400:kworker.0 Request processed in 29us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521512.078905:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521512.078917:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521512.078923:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76716300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222517632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521512.078948:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76716300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222517632:12345-0@lo:400:kworker.0 Request processed in 26us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521512.078954:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521512.078965:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788521512.078969:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1875400222517760:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788521512.078995:0:18707:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 562 last 0 00000020:00000080:0.0:1788521512.079023:0:18707:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x411dd0ee4d2d27e2 00002000:00100000:0.0:1788521512.079039:0:18707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8fef58329000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788521512.079043:0:18707:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788521512.079046:0:18707:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788521512.079352:0:18707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788521512.079382:0:18707:0:(import.c:65:import_set_state_nolock()) ffff8fef5832f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788521512.079426:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875400222517760:12345-0@lo:8:kworker.0 Request processed in 455us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521512.079441:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788521512.079455:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788521512.079459:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3642:x1875400222518272:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788521512.079474:0:18707:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 562 last 0 00000020:00000080:0.0:1788521512.079489:0:18707:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x411dd0ee4d2d27e9 00002000:00100000:0.0:1788521512.079496:0:18707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8fef58329800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788521512.079499:0:18707:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1788521512.079501:0:18707:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788521512.079525:0:18707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1788521512.079538:0:18707:0:(import.c:65:import_set_state_nolock()) ffff8fef44a9f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788521512.079566:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3642:x1875400222518272:12345-0@lo:8:kworker.0 Request processed in 105us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521512.079572:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788521512.079595:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222518656 00000100:00100000:0.0:1788521512.079599:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222518656 00000100:00100000:0.0:1788521512.079622:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222517888 00000100:00100000:0.0:1788521512.079624:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222517888 00000100:00100000:0.0:1788521512.079635:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222518528 00000100:00100000:0.0:1788521512.079638:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222518528 00000100:00100000:0.0:1788521512.079649:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222518784 00000100:00100000:0.0:1788521512.079651:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222518784 00000100:00100000:0.0:1788521512.079662:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222518400 00000100:00100000:0.0:1788521512.079665:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222518400 00000100:00100000:0.0:1788521512.079675:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222518912 00000100:00100000:0.0:1788521512.079677:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222518912 00000100:00100000:0.0:1788521512.079690:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788521512.079696:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875400222518656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521512.079725:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875400222518656:12345-0@lo:400:kworker.0 Request processed in 30us (1939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521512.079738:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788521512.079752:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788521512.079757:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875400222517888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521512.079785:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875400222517888:12345-0@lo:400:kworker.0 Request processed in 29us (1945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521512.079792:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788521512.079804:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788521512.079810:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875400222518528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521512.079835:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875400222518528:12345-0@lo:400:kworker.0 Request processed in 26us (1911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521512.079840:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788521512.079851:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788521512.079856:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222518784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521512.079880:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222518784:12345-0@lo:400:kworker.0 Request processed in 25us (1793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521512.079909:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788521512.079921:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788521512.079926:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875400222518400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521512.079951:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875400222518400:12345-0@lo:400:kworker.0 Request processed in 26us (1796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521512.079957:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788521512.079967:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788521512.079972:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875400222518912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521512.079995:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875400222518912:12345-0@lo:400:kworker.0 Request processed in 23us (1801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521512.080007:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788521512.080051:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788521512.080054:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788521512.080056:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788521512.080088:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43c64700 x1875400222517760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788521537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788521512.080103:0:3642:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788521512.080110:0:3642:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788521512.080116:0:3642:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788521512.080118:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef81580800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788521512.080134:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788521512.080141:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3642:1875400222517760:0@lo:8:kworker.0 00010000:00080000:0.0:1788521512.080155:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43c64380 x1875400222518272/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788521537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788521512.080163:0:3642:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788521512.080168:0:3642:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788521512.080170:0:3642:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788521512.080173:0:3642:0:(import.c:65:import_set_state_nolock()) ffff8fef6e4db000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788521512.080194:0:3642:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788521512.080198:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3642:1875400222518272:0@lo:8:kworker.0 00000004:00080000:0.0:1788521512.080224:0:17226:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788521512.080365:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788521512.080372:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7979b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:3646:x1875400222517376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521512.080407:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7979b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:3646:x1875400222517376:12345-0@lo:400:kworker.0 Request processed in 36us (2856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521512.080412:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000004:00080000:0.0:1788521512.082483:0:17226:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 562148597271ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788521512.082492:0:17226:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1788521512.082577:0:17944:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788521512.082606:0:17944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c64700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17944:1875400222519168:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1788521512.082666:0:17944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521512.082708:0:17944:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee410b3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788521512.083127:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222519040:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788521512.083165:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521512.083221:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222519040 00000100:00100000:3.0:1788521512.083242:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222519040 00000100:00100000:3.0:1788521512.083293:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788521512.083303:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76714e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875400222519040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788521512.083329:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788521512.083372:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76714e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875400222519040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521512.083379:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788521512.083402:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788521512.083428:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43c64380 x1875400222519040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521528 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521512.083445:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222519040:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1788521512.083534:0:17943:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788521512.083590:0:17943:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 562149705442ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788521512.083595:0:17943:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788521512.083631:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222517632:0@lo:400:kworker.0 00010000:00080000:0.0:1788521512.083645:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43c65c00 x1875400222518400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521512.083654:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875400222518400:0@lo:400:kworker.0 00010000:00080000:0.0:1788521512.083666:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef7f0c9180 x1875400222518912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521512.083673:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3643:1875400222518912:0@lo:400:kworker.0 00000100:00100000:0.0:1788521512.083684:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222517504:0@lo:400:kworker.0 00000100:00100000:0.0:1788521512.083696:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222518144:0@lo:400:kworker.0 00010000:00080000:0.0:1788521512.083707:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43c66a00 x1875400222518784/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521512.083715:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222518784:0@lo:400:kworker.0 00010000:00080000:0.0:1788521512.083772:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43c67800 x1875400222517888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521512.083782:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875400222517888:0@lo:400:kworker.0 00010000:00080000:0.0:1788521512.083793:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43c65500 x1875400222518528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521512.083801:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875400222518528:0@lo:400:kworker.0 00000100:00100000:0.0:1788521512.083823:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3646:1875400222517376:0@lo:400:kworker.0 00000100:00100000:0.0:1788521512.083834:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222518016:0@lo:400:kworker.0 00010000:00080000:0.0:1788521512.083846:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43c65f80 x1875400222518656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521512.083854:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875400222518656:0@lo:400:kworker.0 00000100:00100000:0.0:1788521512.083907:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222519168 00000100:00100000:0.0:1788521512.083911:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222519168 00000100:00100000:0.0:1788521512.083940:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788521512.083946:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17944:x1875400222519168:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788521512.086543:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:1.0:1788521512.086608:0:17227:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:1.0:1788521512.086641:0:17227:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17227:1875400222519424:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788521512.086720:0:17227:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521512.086761:0:17227:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef484e5540 going to sleep for 11 seconds 00000100:00100000:0.0:1788521512.087306:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222519424 00000100:00100000:0.0:1788521512.087314:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222519424 00000100:00100000:0.0:1788521512.087372:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788521512.087382:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17227:x1875400222519424:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:0.0:1788521512.088062:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1788521512.092799:0:18707:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1788521512.092810:0:18707:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788521512.092930:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17944:x1875400222519168:12345-0@lo:7:osp-pre-1-1.0 Request processed in 8978us (10258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521512.092940:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00002000:00080000:0.0:1788521512.094331:0:18704:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788521512.094342:0:18704:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788521512.094348:0:18704:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00010000:00080000:2.0:1788521512.096039:0:17944:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43c64700 x1875400222519168/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788521528 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521512.096058:0:17944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c64700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17944:1875400222519168:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1788521512.096074:0:17944:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1788521512.096122:0:17944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee436cdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17944:1875400222519552:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1788521512.096192:0:17944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521512.096222:0:17944:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef8147fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521512.096549:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222519296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521512.096584:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521512.097518:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222519296 00000100:00100000:3.0:1788521512.097527:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222519296 00000100:00100000:3.0:1788521512.097572:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788521512.097582:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875400222519296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788521512.097604:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788521512.097657:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875400222519296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521512.097664:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788521512.101243:0:19185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222519552 00000100:00100000:1.0:1788521512.101256:0:19185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222519552 00000100:00100000:1.0:1788521512.101313:0:19185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788521512.101322:0:19185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17944:x1875400222519552:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788521512.101353:0:19185:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1788521512.101431:0:19185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17944:x1875400222519552:12345-0@lo:5:osp-pre-1-1.0 Request processed in 110us (5239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521512.101438:0:19185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788521512.101477:0:17944:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee436cdc00 x1875400222519552/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788521528 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521512.101490:0:17944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee436cdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17944:1875400222519552:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788521512.101504:0:17944:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788521512.101549:0:17944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17944:1875400222519680:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788521512.101583:0:17944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521512.101605:0:17944:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef484e9600 going to sleep for 11 seconds 00000100:00100000:1.0:1788521512.101621:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222519680 00000100:00100000:1.0:1788521512.101624:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222519680 00000100:00100000:1.0:1788521512.101645:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788521512.101651:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17944:x1875400222519680:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788521512.101675:0:18707:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00010000:00080000:3.0:1788521512.102305:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43d4ed80 x1875400222519296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521528 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521512.102326:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222519296:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1788521512.102769:0:17931:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:3.0:1788521512.102816:0:17179:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788521512.107970:0:18704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788521512.107981:0:18704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e048f127/0x411dd0ee4d2d27f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.108009:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788521512.108015:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521512.108021:0:18704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e048f127/0x411dd0ee4d2d27f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.108119:0:18704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e048f127/0x411dd0ee4d2d27f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.108131:0:18704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e048f127/0x411dd0ee4d2d27f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.108140:0:18704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e048f127/0x411dd0ee4d2d27f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.108167:0:18704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788521512.108616:0:18704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788521512.108623:0:18704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d19076ea/0x411dd0ee4d2d27f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.108633:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788521512.108637:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521512.108642:0:18704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d19076ea/0x411dd0ee4d2d27f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.108652:0:18704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d19076ea/0x411dd0ee4d2d27f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.108673:0:18704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d19076ea/0x411dd0ee4d2d27f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.108682:0:18704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d19076ea/0x411dd0ee4d2d27f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.108694:0:18704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788521512.108828:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788521512.108836:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e048f127/0x411dd0ee4d2d27f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.108844:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef7f12de00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:3.0:1788521512.108849:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e048f127/0x411dd0ee4d2d27f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.108860:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e048f127/0x411dd0ee4d2d27f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.108879:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e048f127/0x411dd0ee4d2d27f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.108909:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e048f127/0x411dd0ee4d2d27f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.108928:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521512.108932:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d19076ea/0x411dd0ee4d2d27f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.108948:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef7f12cc00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:3.0:1788521512.108953:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d19076ea/0x411dd0ee4d2d27f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.108961:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d19076ea/0x411dd0ee4d2d27f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.108983:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d19076ea/0x411dd0ee4d2d27f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.108992:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d19076ea/0x411dd0ee4d2d27f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.109005:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521512.109007:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521512.109009:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521512.109015:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788521512.110146:0:18704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788521512.110156:0:18704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b02445fa/0x411dd0ee4d2d27fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.110168:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788521512.110171:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521512.110186:0:18704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b02445fa/0x411dd0ee4d2d27fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.110199:0:18704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b02445fa/0x411dd0ee4d2d27fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.110208:0:18704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b02445fa/0x411dd0ee4d2d27fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.110216:0:18704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b02445fa/0x411dd0ee4d2d27fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.110314:0:18704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521512.110597:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521512.110604:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b02445fa/0x411dd0ee4d2d27fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.110612:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef7f12ca00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:3.0:1788521512.110616:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b02445fa/0x411dd0ee4d2d27fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.110626:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b02445fa/0x411dd0ee4d2d27fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.110642:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b02445fa/0x411dd0ee4d2d27fe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.110651:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b02445fa/0x411dd0ee4d2d27fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.110680:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521512.110682:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521512.110684:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788521512.111539:0:18704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788521512.111549:0:18704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cd82e70/0x411dd0ee4d2d2805 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.111561:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788521512.111565:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521512.111570:0:18704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cd82e70/0x411dd0ee4d2d2805 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.111581:0:18704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cd82e70/0x411dd0ee4d2d2805 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.111590:0:18704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cd82e70/0x411dd0ee4d2d2805 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.111597:0:18704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cd82e70/0x411dd0ee4d2d2805 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.111614:0:18704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521512.112948:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521512.112959:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cd82e70/0x411dd0ee4d2d2805 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.112970:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef7f12c400 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:3.0:1788521512.112975:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cd82e70/0x411dd0ee4d2d2805 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.112986:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cd82e70/0x411dd0ee4d2d2805 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.113004:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cd82e70/0x411dd0ee4d2d2805 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.113012:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cd82e70/0x411dd0ee4d2d2805 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.113036:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521512.113037:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521512.113039:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788521512.113158:0:18704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788521512.113165:0:18704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d74c3be3/0x411dd0ee4d2d280c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.113186:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788521512.113197:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521512.113203:0:18704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d74c3be3/0x411dd0ee4d2d280c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.113215:0:18704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d74c3be3/0x411dd0ee4d2d280c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.113225:0:18704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d74c3be3/0x411dd0ee4d2d280c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.113242:0:18704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d74c3be3/0x411dd0ee4d2d280c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.113266:0:18704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521512.113744:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521512.113750:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d74c3be3/0x411dd0ee4d2d280c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.113771:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef7f12d600 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:3.0:1788521512.113776:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d74c3be3/0x411dd0ee4d2d280c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.113784:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d74c3be3/0x411dd0ee4d2d280c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.113797:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d74c3be3/0x411dd0ee4d2d280c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.113806:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d74c3be3/0x411dd0ee4d2d280c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.113820:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521512.113822:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521512.113824:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788521512.114661:0:18704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788521512.114670:0:18704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ec1f840/0x411dd0ee4d2d2813 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.114682:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1788521512.114685:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521512.114691:0:18704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ec1f840/0x411dd0ee4d2d2813 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.114704:0:18704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ec1f840/0x411dd0ee4d2d2813 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.114724:0:18704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ec1f840/0x411dd0ee4d2d2813 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.114733:0:18704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ec1f840/0x411dd0ee4d2d2813 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.114753:0:18704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521512.114909:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521512.114915:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ec1f840/0x411dd0ee4d2d2813 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.114923:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef457f2c00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:3.0:1788521512.114928:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ec1f840/0x411dd0ee4d2d2813 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.114938:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ec1f840/0x411dd0ee4d2d2813 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.114962:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ec1f840/0x411dd0ee4d2d2813 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.114970:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ec1f840/0x411dd0ee4d2d2813 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.114986:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521512.114988:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521512.114990:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788521512.115514:0:18704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788521512.115521:0:18704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ceea14e9/0x411dd0ee4d2d281a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.115530:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1788521512.115533:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521512.115537:0:18704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ceea14e9/0x411dd0ee4d2d281a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.115560:0:18704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ceea14e9/0x411dd0ee4d2d281a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.115569:0:18704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ceea14e9/0x411dd0ee4d2d281a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.115577:0:18704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ceea14e9/0x411dd0ee4d2d281a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.115597:0:18704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788521512.115743:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521512.115750:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ceea14e9/0x411dd0ee4d2d281a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.115758:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef457f3e00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:0.0:1788521512.115762:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ceea14e9/0x411dd0ee4d2d281a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.115771:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ceea14e9/0x411dd0ee4d2d281a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.115785:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ceea14e9/0x411dd0ee4d2d281a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.115805:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ceea14e9/0x411dd0ee4d2d281a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.115820:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521512.115822:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521512.115824:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788521512.116530:0:18704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788521512.116538:0:18704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2d61338/0x411dd0ee4d2d2821 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.116549:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788521512.116553:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521512.116559:0:18704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d61338/0x411dd0ee4d2d2821 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.116570:0:18704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2d61338/0x411dd0ee4d2d2821 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.116581:0:18704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2d61338/0x411dd0ee4d2d2821 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.116589:0:18704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2d61338/0x411dd0ee4d2d2821 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.116610:0:18704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788521512.116959:0:18704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788521512.116970:0:18704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9de7b13/0x411dd0ee4d2d2828 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.116978:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788521512.116981:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521512.116985:0:18704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9de7b13/0x411dd0ee4d2d2828 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.116993:0:18704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9de7b13/0x411dd0ee4d2d2828 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.117000:0:18704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9de7b13/0x411dd0ee4d2d2828 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.117008:0:18704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9de7b13/0x411dd0ee4d2d2828 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.117024:0:18704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788521512.117429:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788521512.117436:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2d61338/0x411dd0ee4d2d2821 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.117445:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef7f12d000 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:3.0:1788521512.117450:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2d61338/0x411dd0ee4d2d2821 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.117460:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2d61338/0x411dd0ee4d2d2821 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.117475:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2d61338/0x411dd0ee4d2d2821 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.117483:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2d61338/0x411dd0ee4d2d2821 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.117515:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521512.117519:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9de7b13/0x411dd0ee4d2d2828 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.117526:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef7f12c000 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:3.0:1788521512.117529:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9de7b13/0x411dd0ee4d2d2828 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.117537:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9de7b13/0x411dd0ee4d2d2828 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.117547:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9de7b13/0x411dd0ee4d2d2828 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.117555:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9de7b13/0x411dd0ee4d2d2828 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521512.117567:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521512.117569:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521512.117571:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521512.117643:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788521512.117728:0:18704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788521512.117734:0:18704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b70f0a1/0x411dd0ee4d2d282f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.117744:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788521512.117748:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521512.117753:0:18704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b70f0a1/0x411dd0ee4d2d282f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.117763:0:18704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b70f0a1/0x411dd0ee4d2d282f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.117777:0:18704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b70f0a1/0x411dd0ee4d2d282f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.117786:0:18704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b70f0a1/0x411dd0ee4d2d282f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.117805:0:18704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521512.118094:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521512.118100:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b70f0a1/0x411dd0ee4d2d282f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.118108:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef7f12da00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:2.0:1788521512.118112:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b70f0a1/0x411dd0ee4d2d282f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.118119:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b70f0a1/0x411dd0ee4d2d282f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.118130:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b70f0a1/0x411dd0ee4d2d282f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.118149:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b70f0a1/0x411dd0ee4d2d282f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.118165:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521512.118167:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521512.118168:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788521512.118318:0:18704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788521512.118324:0:18704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026f9be1f/0x411dd0ee4d2d2836 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.118332:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788521512.118335:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521512.118339:0:18704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026f9be1f/0x411dd0ee4d2d2836 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.118348:0:18704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026f9be1f/0x411dd0ee4d2d2836 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.118355:0:18704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026f9be1f/0x411dd0ee4d2d2836 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.118362:0:18704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026f9be1f/0x411dd0ee4d2d2836 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.118392:0:18704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521512.118844:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521512.118850:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026f9be1f/0x411dd0ee4d2d2836 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.118858:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef4167fa00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:2.0:1788521512.118862:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026f9be1f/0x411dd0ee4d2d2836 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.118869:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026f9be1f/0x411dd0ee4d2d2836 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.118881:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026f9be1f/0x411dd0ee4d2d2836 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.118911:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026f9be1f/0x411dd0ee4d2d2836 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.118926:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521512.118928:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521512.118929:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788521512.119136:0:18704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788521512.119142:0:18704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003059679e/0x411dd0ee4d2d283d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.119152:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788521512.119155:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521512.119160:0:18704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003059679e/0x411dd0ee4d2d283d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.119170:0:18704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003059679e/0x411dd0ee4d2d283d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.119190:0:18704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003059679e/0x411dd0ee4d2d283d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.119198:0:18704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003059679e/0x411dd0ee4d2d283d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.119217:0:18704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521512.119621:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521512.119627:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003059679e/0x411dd0ee4d2d283d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.119635:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef4167e000 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:2.0:1788521512.119639:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003059679e/0x411dd0ee4d2d283d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.119648:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003059679e/0x411dd0ee4d2d283d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.119661:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003059679e/0x411dd0ee4d2d283d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.119669:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003059679e/0x411dd0ee4d2d283d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.119684:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521512.119686:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521512.119688:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788521512.126587:0:18704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788521512.126599:0:18704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe7693c5/0x411dd0ee4d2d2844 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.126617:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1788521512.126622:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521512.126629:0:18704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe7693c5/0x411dd0ee4d2d2844 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.126657:0:18704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe7693c5/0x411dd0ee4d2d2844 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.126668:0:18704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe7693c5/0x411dd0ee4d2d2844 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.126675:0:18704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe7693c5/0x411dd0ee4d2d2844 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.126697:0:18704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788521512.127133:0:18704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788521512.127139:0:18704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a8eab16/0x411dd0ee4d2d284b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.127148:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=562s v=(0 0) 00010000:00010000:2.0:1788521512.127151:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521512.127156:0:18704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a8eab16/0x411dd0ee4d2d284b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.127166:0:18704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a8eab16/0x411dd0ee4d2d284b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.127174:0:18704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a8eab16/0x411dd0ee4d2d284b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.127203:0:18704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a8eab16/0x411dd0ee4d2d284b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.127261:0:18704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788521512.133076:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788521512.133089:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe7693c5/0x411dd0ee4d2d2844 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521512.133103:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef457f2400 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:1.0:1788521512.133109:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe7693c5/0x411dd0ee4d2d2844 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521512.133121:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe7693c5/0x411dd0ee4d2d2844 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521512.133146:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe7693c5/0x411dd0ee4d2d2844 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521512.133154:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe7693c5/0x411dd0ee4d2d2844 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521512.133301:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521512.133307:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a8eab16/0x411dd0ee4d2d284b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521512.133314:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef457f2a00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:1.0:1788521512.133318:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a8eab16/0x411dd0ee4d2d284b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521512.133326:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a8eab16/0x411dd0ee4d2d284b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521512.133351:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a8eab16/0x411dd0ee4d2d284b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521512.133360:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a8eab16/0x411dd0ee4d2d284b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521512.133376:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521512.133378:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521512.133380:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521512.134035:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788521512.134342:0:18704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788521512.134351:0:18704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3e1913a/0x411dd0ee4d2d2852 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.134365:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788521512.134377:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521512.134383:0:18704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3e1913a/0x411dd0ee4d2d2852 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.134395:0:18704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3e1913a/0x411dd0ee4d2d2852 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.134406:0:18704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3e1913a/0x411dd0ee4d2d2852 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.134414:0:18704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3e1913a/0x411dd0ee4d2d2852 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.134437:0:18704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521512.136421:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521512.136432:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3e1913a/0x411dd0ee4d2d2852 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.136444:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40030800 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:2.0:1788521512.136449:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3e1913a/0x411dd0ee4d2d2852 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.136460:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3e1913a/0x411dd0ee4d2d2852 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.136479:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3e1913a/0x411dd0ee4d2d2852 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.136486:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3e1913a/0x411dd0ee4d2d2852 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.136505:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521512.136507:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521512.136508:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788521512.136927:0:18704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788521512.136936:0:18704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad16ccfe/0x411dd0ee4d2d2859 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.138029:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788521512.138034:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521512.138042:0:18704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad16ccfe/0x411dd0ee4d2d2859 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.138056:0:18704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad16ccfe/0x411dd0ee4d2d2859 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.138068:0:18704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad16ccfe/0x411dd0ee4d2d2859 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.138087:0:18704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad16ccfe/0x411dd0ee4d2d2859 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.139918:0:18704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788521512.143678:0:18704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788521512.143692:0:18704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce34b8a2/0x411dd0ee4d2d2860 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.143711:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788521512.143728:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521512.143735:0:18704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce34b8a2/0x411dd0ee4d2d2860 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.143751:0:18704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce34b8a2/0x411dd0ee4d2d2860 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.143762:0:18704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce34b8a2/0x411dd0ee4d2d2860 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.143770:0:18704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce34b8a2/0x411dd0ee4d2d2860 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.143792:0:18704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788521512.146993:0:18704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788521512.147008:0:18704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f95e50c5/0x411dd0ee4d2d2867 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.147033:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788521512.147038:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521512.147045:0:18704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f95e50c5/0x411dd0ee4d2d2867 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.147059:0:18704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f95e50c5/0x411dd0ee4d2d2867 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.147069:0:18704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f95e50c5/0x411dd0ee4d2d2867 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.147076:0:18704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f95e50c5/0x411dd0ee4d2d2867 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.147086:0:18704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788521512.147616:0:18704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788521512.147622:0:18704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047511951/0x411dd0ee4d2d286e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.147630:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788521512.147634:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521512.147637:0:18704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047511951/0x411dd0ee4d2d286e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.147646:0:18704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047511951/0x411dd0ee4d2d286e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.147666:0:18704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047511951/0x411dd0ee4d2d286e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.147673:0:18704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047511951/0x411dd0ee4d2d286e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.147681:0:18704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788521512.148033:0:18704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788521512.148038:0:18704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ab5ba49/0x411dd0ee4d2d2875 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.148047:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788521512.148051:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521512.148055:0:18704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ab5ba49/0x411dd0ee4d2d2875 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.148065:0:18704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ab5ba49/0x411dd0ee4d2d2875 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.148072:0:18704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ab5ba49/0x411dd0ee4d2d2875 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.148079:0:18704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ab5ba49/0x411dd0ee4d2d2875 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.148098:0:18704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788521512.148837:0:18704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788521512.148845:0:18704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000471c037e/0x411dd0ee4d2d287c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.148856:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788521512.148860:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521512.148865:0:18704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000471c037e/0x411dd0ee4d2d287c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.148876:0:18704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000471c037e/0x411dd0ee4d2d287c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.148901:0:18704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000471c037e/0x411dd0ee4d2d287c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.148909:0:18704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000471c037e/0x411dd0ee4d2d287c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.148918:0:18704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00000001:00080000:3.0:1788521512.150047:0:19520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1788521512.150071:0:19520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788521512.150076:0:19520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788521512.150224:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17944:x1875400222519680:12345-0@lo:5:osp-pre-1-1.0 Request processed in 48568us (48635us total) trans 8589934593 rc 0/0 00002000:00010000:0.0:1788521512.150397:0:18704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788521512.150405:0:18704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d59d46a/0x411dd0ee4d2d2883 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.150419:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788521512.150431:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521512.150438:0:18704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d59d46a/0x411dd0ee4d2d2883 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.150450:0:18704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d59d46a/0x411dd0ee4d2d2883 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.150460:0:18704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d59d46a/0x411dd0ee4d2d2883 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.150468:0:18704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d59d46a/0x411dd0ee4d2d2883 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.150478:0:18704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:2.0:1788521512.151502:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788521512.151521:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad16ccfe/0x411dd0ee4d2d2859 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.151534:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40031800 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:2.0:1788521512.151539:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad16ccfe/0x411dd0ee4d2d2859 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.151549:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad16ccfe/0x411dd0ee4d2d2859 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.151569:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad16ccfe/0x411dd0ee4d2d2859 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.151577:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad16ccfe/0x411dd0ee4d2d2859 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.151603:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788521512.151607:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce34b8a2/0x411dd0ee4d2d2860 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.151614:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40031e00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:2.0:1788521512.151616:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce34b8a2/0x411dd0ee4d2d2860 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.151622:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce34b8a2/0x411dd0ee4d2d2860 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.151645:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce34b8a2/0x411dd0ee4d2d2860 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.151652:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce34b8a2/0x411dd0ee4d2d2860 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.151667:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788521512.151670:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f95e50c5/0x411dd0ee4d2d2867 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.151677:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40030600 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:2.0:1788521512.151680:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f95e50c5/0x411dd0ee4d2d2867 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.151687:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f95e50c5/0x411dd0ee4d2d2867 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.151696:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f95e50c5/0x411dd0ee4d2d2867 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.151703:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f95e50c5/0x411dd0ee4d2d2867 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521512.151825:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788521512.151899:0:17944:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788521512.151907:0:17944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17944:1875400222519680:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788521512.151922:0:17944:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788521512.151976:0:17944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76715180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17944:1875400222519808:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788521512.152028:0:17944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521512.152061:0:17944:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee434e1000 going to sleep for 11 seconds 00000100:00100000:0.0:1788521512.152197:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222519808 00000100:00100000:0.0:1788521512.152204:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222519808 00000100:00100000:0.0:1788521512.152804:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521512.152816:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17944:x1875400222519808:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788521512.152898:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17944:x1875400222519808:12345-0@lo:900:osp-pre-1-1.0 Request processed in 69us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521512.152906:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00010000:0.0:1788521512.153009:0:18704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788521512.153016:0:18704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b108ba2/0x411dd0ee4d2d288a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.153030:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788521512.153035:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521512.153051:0:18704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b108ba2/0x411dd0ee4d2d288a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.153065:0:18704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b108ba2/0x411dd0ee4d2d288a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.153075:0:18704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b108ba2/0x411dd0ee4d2d288a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.153083:0:18704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b108ba2/0x411dd0ee4d2d288a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.153093:0:18704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00080000:3.0:1788521512.153344:0:17944:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef76715180 x1875400222519808/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788521528 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521512.153357:0:17944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76715180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17944:1875400222519808:0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1788521512.153453:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788521512.153459:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047511951/0x411dd0ee4d2d286e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.153474:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40030400 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:2.0:1788521512.153478:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047511951/0x411dd0ee4d2d286e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.153487:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047511951/0x411dd0ee4d2d286e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.153501:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047511951/0x411dd0ee4d2d286e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.153508:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047511951/0x411dd0ee4d2d286e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.153524:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788521512.153527:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ab5ba49/0x411dd0ee4d2d2875 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.153533:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40030200 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:2.0:1788521512.153537:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ab5ba49/0x411dd0ee4d2d2875 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.153544:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ab5ba49/0x411dd0ee4d2d2875 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.153553:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ab5ba49/0x411dd0ee4d2d2875 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.153566:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ab5ba49/0x411dd0ee4d2d2875 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.153579:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788521512.153582:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000471c037e/0x411dd0ee4d2d287c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.153589:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40031a00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:2.0:1788521512.153592:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000471c037e/0x411dd0ee4d2d287c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.153601:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000471c037e/0x411dd0ee4d2d287c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.153611:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000471c037e/0x411dd0ee4d2d287c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.153618:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000471c037e/0x411dd0ee4d2d287c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.153634:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788521512.153638:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d59d46a/0x411dd0ee4d2d2883 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.153644:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40030c00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:2.0:1788521512.153652:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d59d46a/0x411dd0ee4d2d2883 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.153660:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d59d46a/0x411dd0ee4d2d2883 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.153670:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d59d46a/0x411dd0ee4d2d2883 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.153677:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d59d46a/0x411dd0ee4d2d2883 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.153689:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521512.153692:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b108ba2/0x411dd0ee4d2d288a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.153699:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40030e00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:2.0:1788521512.153702:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b108ba2/0x411dd0ee4d2d288a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.153710:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b108ba2/0x411dd0ee4d2d288a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.153924:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b108ba2/0x411dd0ee4d2d288a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.153933:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b108ba2/0x411dd0ee4d2d288a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.154004:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521512.154006:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521512.154007:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521512.154014:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788521512.155044:0:18704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788521512.155054:0:18704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3e1913a/0x411dd0ee4d2d2891 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.155066:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788521512.155070:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521512.155076:0:18704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3e1913a/0x411dd0ee4d2d2891 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.155087:0:18704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3e1913a/0x411dd0ee4d2d2891 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.155096:0:18704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3e1913a/0x411dd0ee4d2d2891 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.155119:0:18704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3e1913a/0x411dd0ee4d2d2891 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.155136:0:18704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521512.155340:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521512.155346:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3e1913a/0x411dd0ee4d2d2891 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.155354:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40030800 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:2.0:1788521512.155358:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3e1913a/0x411dd0ee4d2d2891 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.155367:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3e1913a/0x411dd0ee4d2d2891 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.155380:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3e1913a/0x411dd0ee4d2d2891 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.155388:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3e1913a/0x411dd0ee4d2d2891 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.155404:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521512.155406:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521512.155408:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788521512.156787:0:18704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788521512.156798:0:18704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe4d3591/0x411dd0ee4d2d2898 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.156811:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788521512.156816:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521512.156822:0:18704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe4d3591/0x411dd0ee4d2d2898 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.156834:0:18704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe4d3591/0x411dd0ee4d2d2898 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.156844:0:18704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe4d3591/0x411dd0ee4d2d2898 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.156851:0:18704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe4d3591/0x411dd0ee4d2d2898 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.156876:0:18704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521512.157472:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521512.157480:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe4d3591/0x411dd0ee4d2d2898 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.157496:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42411400 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:2.0:1788521512.157501:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe4d3591/0x411dd0ee4d2d2898 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.157510:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe4d3591/0x411dd0ee4d2d2898 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.157525:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe4d3591/0x411dd0ee4d2d2898 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.157533:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe4d3591/0x411dd0ee4d2d2898 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.157550:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521512.157552:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521512.157553:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788521512.157845:0:18704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788521512.157853:0:18704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003088bd80/0x411dd0ee4d2d289f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.157867:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788521512.157870:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521512.157875:0:18704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003088bd80/0x411dd0ee4d2d289f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.157915:0:18704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003088bd80/0x411dd0ee4d2d289f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.157923:0:18704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003088bd80/0x411dd0ee4d2d289f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.157930:0:18704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003088bd80/0x411dd0ee4d2d289f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.157950:0:18704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521512.158458:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521512.158465:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003088bd80/0x411dd0ee4d2d289f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.158473:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42411200 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:2.0:1788521512.158477:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003088bd80/0x411dd0ee4d2d289f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.158486:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003088bd80/0x411dd0ee4d2d289f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.158506:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003088bd80/0x411dd0ee4d2d289f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.158513:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003088bd80/0x411dd0ee4d2d289f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.158529:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521512.158531:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521512.158532:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788521512.158929:0:18704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788521512.158936:0:18704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c01d5ff6/0x411dd0ee4d2d28a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.158956:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=562s v=(0 0) 00010000:00010000:0.0:1788521512.158959:0:18704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521512.158965:0:18704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c01d5ff6/0x411dd0ee4d2d28a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.158977:0:18704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c01d5ff6/0x411dd0ee4d2d28a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.158996:0:18704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c01d5ff6/0x411dd0ee4d2d28a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.159004:0:18704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c01d5ff6/0x411dd0ee4d2d28a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521512.159020:0:18704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788521512.159068:0:18704:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:0.0:1788521512.159164:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17227:x1875400222519424:12345-0@lo:5:osp-pre-1-0.0 Request processed in 71780us (72449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521512.159173:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1788521512.159825:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521512.159833:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c01d5ff6/0x411dd0ee4d2d28a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.159843:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42411000 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:2.0:1788521512.159847:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c01d5ff6/0x411dd0ee4d2d28a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.159856:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c01d5ff6/0x411dd0ee4d2d28a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.159872:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c01d5ff6/0x411dd0ee4d2d28a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.159879:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c01d5ff6/0x411dd0ee4d2d28a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521512.159931:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521512.159933:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521512.159935:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521512.160096:0:17227:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17227:1875400222519424:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788521512.160114:0:17227:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1788521512.160162:0:17227:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef76715180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17227:1875400222519936:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788521512.160221:0:17227:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521512.160321:0:17227:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee434e1000 going to sleep for 11 seconds 00000100:00100000:3.0:1788521512.160342:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222519936 00000100:00100000:3.0:1788521512.160348:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222519936 00000100:00100000:3.0:1788521512.160390:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788521512.160398:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17227:x1875400222519936:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788521512.160434:0:18706:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:3.0:1788521512.168584:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17227:x1875400222519936:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8181us (8357us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788521512.168596:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788521512.168764:0:17227:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef76715180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17227:1875400222519936:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788521512.168779:0:17227:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:3.0:1788521512.398155:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788521512.912682:0:17234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788521513.426743:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788521513.562349:0:19876:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg341-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788521514.445690:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788521514.726219:0:19928:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788521514.726451:0:19928:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788521515.471069:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521515.662300:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222520064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788521515.662368:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521515.662406:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788521515.662413:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222520192:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788521515.662440:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521515.662469:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222520192 00000100:00100000:1.0:1788521515.662476:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222520192 00000100:00100000:1.0:1788521515.662517:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788521515.662525:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222520192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788521515.662555:0:17940:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788521515.662598:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222520192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521515.662616:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788521515.662661:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222520192:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788521515.662699:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222520064 00000100:00100000:1.0:1788521515.662702:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222520064 00000100:00100000:1.0:1788521515.662734:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788521515.662741:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222520064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788521515.662759:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788521515.662791:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222520064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521515.662797:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788521515.662814:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521515.662838:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222520064:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788521515.678406:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788521515.682839:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43e2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222520320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521515.682933:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521515.683022:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222520320 00000100:00100000:1.0:1788521515.683031:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222520320 00000100:00100000:1.0:1788521515.683092:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788521515.683101:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222520320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788521515.683124:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788521515.683176:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222520320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521515.683182:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788521515.683394:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521515.683683:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43e2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222520320:0@lo:13:osp-pre-0-0.0 00000020:00000004:0.0:1788521515.691828:0:19978:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788521515.692591:0:19978:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788521515.908014:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521515.908184:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201457792 00000100:00100000:3.0:1788521515.908192:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201457792 00000100:00100000:3.0:1788521515.908240:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 114 00000100:00100000:3.0:1788521515.908248:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7979a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2392:x1875400201457792:12345-192.168.203.41@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788521515.908277:0:17193:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from cd8ede77-4a8a-40f5-a75d-31d60b0f4d28@192.168.203.41@tcp t0 exp 0000000000000000 cur 565 last 0 00000020:00000080:3.0:1788521515.908306:0:17193:0:(genops.c:1385:class_connect()) connect: client cd8ede77-4a8a-40f5-a75d-31d60b0f4d28, cookie 0x411dd0ee4d2d28ad 00000100:00080000:3.0:1788521515.908448:0:17193:0:(import.c:65:import_set_state_nolock()) ffff8fef76790800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788521515.908527:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7979a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+5:2392:x1875400201457792:12345-192.168.203.41@tcp:250:mount.lustre.0 Request processed in 278us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521515.908534:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 114 00000100:00100000:2.0:1788521515.930763:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521515.930962:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201457920 00000100:00100000:1.0:1788521515.930973:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201457920 00000100:00100000:0.0:1788521515.931209:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 115 00000100:00100000:0.0:1788521515.931220:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef79799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+5:14933:x1875400201457920:12345-192.168.203.41@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788521515.931237:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521515.931257:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fee42411c00/0x411dd0ee4d2d28b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed99e expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521515.931283:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fee42411c00/0x411dd0ee4d2d28b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed99e expref: 6 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521515.931293:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fee42411c00/0x411dd0ee4d2d28b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed99e expref: 6 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521515.931473:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411c00, rc 0) 00000100:00100000:0.0:1788521515.931528:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef79799050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+6:14933:x1875400201457920:12345-192.168.203.41@tcp:101:mount.lustre.0 Request processed in 309us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521515.931535:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 115 00000100:00100000:0.0:1788521515.937812:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521515.937926:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201458048 00000100:00100000:3.0:1788521515.937935:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201458048 00000100:00100000:3.0:1788521515.937990:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 116 00000100:00100000:3.0:1788521515.937999:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef79799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+6:14933:x1875400201458048:12345-192.168.203.41@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788521515.938113:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef79799450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+6:14933:x1875400201458048:12345-192.168.203.41@tcp:501:mount.lustre.0 Request processed in 115us (310us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788521515.938121:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 116 00000100:00100000:2.0:1788521515.951136:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521515.951582:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201458176 00000100:00100000:0.0:1788521515.951593:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201458176 00000100:00100000:0.0:1788521515.951652:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 117 00000100:00100000:0.0:1788521515.951662:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7979ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+6:14933:x1875400201458176:12345-192.168.203.41@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788521515.951860:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521515.951880:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fee42411e00/0x411dd0ee4d2d28bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed9a5 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521515.951948:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fee42411e00/0x411dd0ee4d2d28bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed9a5 expref: 7 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521515.951961:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fee42411e00/0x411dd0ee4d2d28bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed9a5 expref: 7 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521515.951971:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411e00, rc 0) 00000100:00100000:1.0:1788521515.952126:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7979ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+7:14933:x1875400201458176:12345-192.168.203.41@tcp:101:mount.lustre.0 Request processed in 463us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521515.952135:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 117 00000100:00100000:0.0:1788521515.955446:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521515.955547:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201458304 00000100:00100000:2.0:1788521515.955559:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201458304 00000100:00100000:2.0:1788521515.955652:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 118 00000100:00100000:2.0:1788521515.955661:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef79799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+7:14933:x1875400201458304:12345-192.168.203.41@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788521515.955834:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef79799850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+8:14933:x1875400201458304:12345-192.168.203.41@tcp:501:mount.lustre.0 Request processed in 174us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521515.955842:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 118 00000100:00100000:0.0:1788521515.958606:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521515.958696:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201458432 00000100:00100000:1.0:1788521515.958721:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201458432 00000100:00100000:1.0:1788521515.958787:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 119 00000100:00100000:1.0:1788521515.958805:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7979b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+8:14933:x1875400201458432:12345-192.168.203.41@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788521515.958972:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7979b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+8:14933:x1875400201458432:12345-192.168.203.41@tcp:503:mount.lustre.0 Request processed in 175us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521515.958979:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 119 00000100:00100000:0.0:1788521515.967131:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521515.968593:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201458560 00000100:00100000:2.0:1788521515.968608:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201458560 00000100:00100000:2.0:1788521515.968675:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 120 00000100:00100000:2.0:1788521515.968685:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef79798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+8:14952:x1875400201458560:12345-192.168.203.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788521515.969354:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef79798c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+8:14952:x1875400201458560:12345-192.168.203.41@tcp:502:llog_process_th.0 Request processed in 667us (2229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521515.969375:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 120 00000100:00100000:0.0:1788521515.995723:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521515.995938:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201458688 00000100:00100000:3.0:1788521515.995947:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201458688 00000100:00100000:3.0:1788521515.996056:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 121 00000100:00100000:3.0:1788521515.996067:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7979a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+8:14952:x1875400201458688:12345-192.168.203.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788521515.996247:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7979a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+8:14952:x1875400201458688:12345-192.168.203.41@tcp:502:llog_process_th.0 Request processed in 181us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521515.996263:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 121 00000100:00100000:0.0:1788521516.007905:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521516.011857:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201458816 00000100:00100000:2.0:1788521516.011871:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201458816 00000100:00100000:2.0:1788521516.012063:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 122 00000100:00100000:2.0:1788521516.012683:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef79798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+8:14952:x1875400201458816:12345-192.168.203.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788521516.012872:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef79798850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+8:14952:x1875400201458816:12345-192.168.203.41@tcp:502:llog_process_th.0 Request processed in 797us (4996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521516.012880:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 122 00000100:00100000:0.0:1788521516.026778:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521516.026910:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201458944 00000100:00100000:3.0:1788521516.026928:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201458944 00000100:00100000:3.0:1788521516.026978:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 123 00000100:00100000:3.0:1788521516.026988:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef79798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+8:14933:x1875400201458944:12345-192.168.203.41@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788521516.027005:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521516.027022:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef6d7b7a00/0x411dd0ee4d2d28c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed9d6 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521516.027048:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef6d7b7a00/0x411dd0ee4d2d28c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed9d6 expref: 9 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521516.027059:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef6d7b7a00/0x411dd0ee4d2d28c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed9d6 expref: 9 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521516.027067:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7a00, rc 0) 00000100:00100000:3.0:1788521516.027122:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef79798450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+9:14933:x1875400201458944:12345-192.168.203.41@tcp:101:mount.lustre.0 Request processed in 135us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521516.027129:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 123 00000100:00100000:0.0:1788521516.031547:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521516.031708:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201459072 00000100:00100000:2.0:1788521516.031717:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201459072 00000100:00100000:2.0:1788521516.031873:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 124 00000100:00100000:2.0:1788521516.031925:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef79799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+9:14933:x1875400201459072:12345-192.168.203.41@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788521516.031953:0:17192:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788521516.031973:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788521516.031978:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788521516.031982:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788521516.031985:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788521516.031988:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1788521516.042141:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef79799c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+9:14933:x1875400201459072:12345-192.168.203.41@tcp:256:mount.lustre.0 Request processed in 10248us (10593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521516.042168:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 124 00000100:00100000:0.0:1788521516.045397:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521516.045491:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201459200 00000100:00100000:1.0:1788521516.045500:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201459200 00000100:00100000:1.0:1788521516.045555:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 125 00000100:00100000:1.0:1788521516.045564:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7979b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+9:14933:x1875400201459200:12345-192.168.203.41@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788521516.045580:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521516.045598:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef821dd600/0x411dd0ee4d2d28c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x64dd99be98eed9dd expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521516.045634:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef821dd600/0x411dd0ee4d2d28c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed9dd expref: 10 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521516.045645:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef821dd600/0x411dd0ee4d2d28c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed9dd expref: 10 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521516.045654:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef821dd600, rc 0) 00000100:00100000:1.0:1788521516.045709:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7979b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+10:14933:x1875400201459200:12345-192.168.203.41@tcp:101:mount.lustre.0 Request processed in 146us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521516.045716:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 125 00000100:00100000:0.0:1788521516.048090:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521516.048177:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201459328 00000100:00100000:2.0:1788521516.048187:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201459328 00000100:00100000:2.0:1788521516.048241:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 126 00000100:00100000:2.0:1788521516.048250:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7979a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+10:14933:x1875400201459328:12345-192.168.203.41@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788521516.048419:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7979a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+10:14933:x1875400201459328:12345-192.168.203.41@tcp:501:mount.lustre.0 Request processed in 169us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521516.048427:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 126 00000100:00100000:0.0:1788521516.051687:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521516.051966:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201459456 00000100:00100000:3.0:1788521516.051975:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201459456 00000100:00100000:3.0:1788521516.052030:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 127 00000100:00100000:3.0:1788521516.052040:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef79798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+10:14933:x1875400201459456:12345-192.168.203.41@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788521516.052202:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef79798050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+10:14933:x1875400201459456:12345-192.168.203.41@tcp:503:mount.lustre.0 Request processed in 162us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521516.052210:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 127 00000100:00100000:0.0:1788521516.056368:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521516.056509:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201459584 00000100:00100000:1.0:1788521516.056519:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201459584 00000100:00100000:1.0:1788521516.056566:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 128 00000100:00100000:1.0:1788521516.056575:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a5fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+10:14957:x1875400201459584:12345-192.168.203.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788521516.056968:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a5fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+10:14957:x1875400201459584:12345-192.168.203.41@tcp:502:llog_process_th.0 Request processed in 392us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521516.056976:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 128 00000100:00100000:0.0:1788521516.063142:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521516.064090:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201459712 00000100:00100000:2.0:1788521516.064101:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201459712 00000100:00100000:2.0:1788521516.064621:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 129 00000100:00100000:2.0:1788521516.064634:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+10:14957:x1875400201459712:12345-192.168.203.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788521516.064959:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+10:14957:x1875400201459712:12345-192.168.203.41@tcp:502:llog_process_th.0 Request processed in 326us (1822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521516.064968:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 129 00000100:00100000:0.0:1788521516.070362:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521516.070459:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521516.070623:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201459840 00000100:00100000:1.0:1788521516.070633:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201459840 00000100:00100000:1.0:1788521516.070669:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201460096 00000100:00100000:1.0:1788521516.070672:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201460096 00000100:00100000:1.0:1788521516.070691:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 7 00000100:00100000:1.0:1788521516.070699:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1875400201459840:12345-192.168.203.41@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788521516.070727:0:19535:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 130bc563-236a-43ec-a1a1-1e1e641e5bc7@192.168.203.41@tcp t0 exp 0000000000000000 cur 566 last 0 00000020:00000080:1.0:1788521516.070777:0:19535:0:(genops.c:1385:class_connect()) connect: client 130bc563-236a-43ec-a1a1-1e1e641e5bc7, cookie 0x411dd0ee4d2d28d0 00000004:00100000:1.0:1788521516.070802:0:19535:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788521516.071043:0:19535:0:(import.c:65:import_set_state_nolock()) ffff8fee4376c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788521516.071104:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130bc563-236a-43ec-a1a1-1e1e641e5bc7+6:2392:x1875400201459840:12345-192.168.203.41@tcp:38:mount.lustre.0 Request processed in 403us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521516.071113:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 7 00000100:00100000:1.0:1788521516.071132:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 8 00000100:00100000:1.0:1788521516.071137:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1875400201460096:12345-192.168.203.41@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788521516.073926:0:19535:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 130bc563-236a-43ec-a1a1-1e1e641e5bc7@192.168.203.41@tcp t0 exp 0000000000000000 cur 566 last 0 00000020:00000080:1.0:1788521516.073988:0:19535:0:(genops.c:1385:class_connect()) connect: client 130bc563-236a-43ec-a1a1-1e1e641e5bc7, cookie 0x411dd0ee4d2d28d7 00000004:00100000:1.0:1788521516.074014:0:19535:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788521516.074351:0:19535:0:(import.c:65:import_set_state_nolock()) ffff8fee43769800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788521516.074530:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130bc563-236a-43ec-a1a1-1e1e641e5bc7+6:2392:x1875400201460096:12345-192.168.203.41@tcp:38:mount.lustre.0 Request processed in 3389us (4069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521516.074541:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 8 00000100:00100000:0.0:1788521516.079874:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521516.079959:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521516.080185:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201459968 00000100:00100000:3.0:1788521516.080195:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201459968 00000100:00100000:3.0:1788521516.080262:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201460352 00000100:00100000:3.0:1788521516.080266:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201460352 00000100:00100000:3.0:1788521516.080286:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 9 00000100:00100000:3.0:1788521516.080295:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+7:0:x1875400201459968:12345-192.168.203.41@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788521516.080330:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788521516.080404:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+7:0:x1875400201459968:12345-192.168.203.41@tcp:41:mount.lustre.0 Request processed in 110us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521516.080412:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 9 00000100:00100000:3.0:1788521516.080428:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 10 00000100:00100000:3.0:1788521516.080434:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+6:14933:x1875400201460352:12345-192.168.203.41@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788521516.080445:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788521516.080464:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+6:14933:x1875400201460352:12345-192.168.203.41@tcp:41:mount.lustre.0 Request processed in 30us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521516.080470:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 10 00000100:00080000:2.0:1788521516.080922:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521516.086231:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521516.086438:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201460224 00000100:00100000:1.0:1788521516.086448:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201460224 00000100:00080000:2.0:1788521516.086518:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788521516.086525:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 11 00000100:00100000:1.0:1788521516.086537:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+6:0:x1875400201460224:12345-192.168.203.41@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788521516.086578:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788521516.086677:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+6:0:x1875400201460224:12345-192.168.203.41@tcp:41:mount.lustre.0 Request processed in 141us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521516.086684:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 11 00000100:00100000:0.0:1788521516.093281:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521516.093963:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201460480 00000100:00100000:1.0:1788521516.093974:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201460480 00000100:00100000:1.0:1788521516.094045:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 12 00000100:00100000:1.0:1788521516.094055:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+6:14933:x1875400201460480:12345-192.168.203.41@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788521516.094164:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+6:14933:x1875400201460480:12345-192.168.203.41@tcp:40:mount.lustre.0 Request processed in 109us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521516.094171:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 12 00000100:00100000:2.0:1788521516.103176:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521516.103215:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521516.103244:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521516.103336:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201460864 00000100:00100000:0.0:1788521516.103346:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201460864 00000100:00100000:0.0:1788521516.103403:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 3 00000100:00100000:0.0:1788521516.103412:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+6:14933:x1875400201460864:12345-192.168.203.41@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788521516.103491:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+6:14933:x1875400201460864:12345-192.168.203.41@tcp:900:mount.lustre.0 Request processed in 80us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521516.103498:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 3 00000100:00100000:3.0:1788521516.103973:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201460608 00000100:00100000:3.0:1788521516.103978:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201460608 00000100:00100000:3.0:1788521516.104005:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201460736 00000100:00100000:3.0:1788521516.104008:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201460736 00000100:00100000:3.0:1788521516.104030:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 19 00000100:00100000:3.0:1788521516.104036:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1875400201460608:12345-192.168.203.41@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788521516.104063:0:18707:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 130bc563-236a-43ec-a1a1-1e1e641e5bc7@192.168.203.41@tcp t0 exp 0000000000000000 cur 566 last 0 00000020:00000080:3.0:1788521516.104096:0:18707:0:(genops.c:1385:class_connect()) connect: client 130bc563-236a-43ec-a1a1-1e1e641e5bc7, cookie 0x411dd0ee4d2d28de 00002000:00100000:3.0:1788521516.104108:0:18707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 130bc563-236a-43ec-a1a1-1e1e641e5bc7/ffff8fef81493000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788521516.104132:0:18707:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788521516.104323:0:18707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788521516.104351:0:18707:0:(import.c:65:import_set_state_nolock()) ffff8fef81493800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788521516.104395:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+6:2392:x1875400201460608:12345-192.168.203.41@tcp:8:mount.lustre.0 Request processed in 357us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521516.104402:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 19 00000100:00100000:3.0:1788521516.104418:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 20 00000100:00100000:3.0:1788521516.104423:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1875400201460736:12345-192.168.203.41@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788521516.104440:0:18707:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 130bc563-236a-43ec-a1a1-1e1e641e5bc7@192.168.203.41@tcp t0 exp 0000000000000000 cur 566 last 0 00000020:00000080:3.0:1788521516.104457:0:18707:0:(genops.c:1385:class_connect()) connect: client 130bc563-236a-43ec-a1a1-1e1e641e5bc7, cookie 0x411dd0ee4d2d28e5 00002000:00100000:3.0:1788521516.104463:0:18707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 130bc563-236a-43ec-a1a1-1e1e641e5bc7/ffff8fef71ba7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788521516.104475:0:18707:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788521516.104592:0:18707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788521516.106061:0:18707:0:(import.c:65:import_set_state_nolock()) ffff8fef71ba0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788521516.106136:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+6:2392:x1875400201460736:12345-192.168.203.41@tcp:8:mount.lustre.0 Request processed in 1708us (2888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521516.106145:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 20 00000100:00100000:2.0:1788521516.109053:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521516.109230:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201460992 00000100:00100000:1.0:1788521516.109238:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201460992 00000100:00100000:1.0:1788521516.109289:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 0 00000100:00100000:1.0:1788521516.109300:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+6:14933:x1875400201460992:12345-192.168.203.41@tcp:33:mount.lustre.0 00000004:00080000:2.0:1788521516.111776:0:17202:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2391us 00000004:00200000:3.0:1788521516.128105:0:17202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788521516.128233:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+6:14933:x1875400201460992:12345-192.168.203.41@tcp:33:mount.lustre.0 Request processed in 18929us (19183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521516.128247:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 0 00000100:00100000:0.0:1788521516.176134:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521516.176165:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222520448:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788521516.176233:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521516.176377:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222520448 00000100:00100000:2.0:1788521516.176386:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222520448 00000100:00100000:2.0:1788521516.176439:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788521516.176448:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222520448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788521516.176475:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788521516.176530:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222520448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521516.176538:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788521516.176653:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222520448:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788521516.391251:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521516.391362:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201461120 00000100:00100000:1.0:1788521516.391372:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201461120 00000100:00100000:1.0:1788521516.391441:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 13 00000100:00100000:1.0:1788521516.391452:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+6:14980:x1875400201461120:12345-192.168.203.41@tcp:101:mkdir.0 00010000:00010000:1.0:1788521516.391488:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521516.391518:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef821ddc00/0x411dd0ee4d2d28ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eeda0e expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521516.391610:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef821dda00/0x411dd0ee4d2d28f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521516.391624:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef821dda00/0x411dd0ee4d2d28f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521516.391639:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef821dda00/0x411dd0ee4d2d28f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521516.391691:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788521516.391695:0:17200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788521516.391732:0:17200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef821dda00/0x411dd0ee4d2d28f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521516.391760:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef821ddc00/0x411dd0ee4d2d28ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda0e expref: 8 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521516.391782:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef821dda00/0x411dd0ee4d2d28f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda0e expref: 7 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521516.391791:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef51db3d00) 00010000:00010000:1.0:1788521516.391794:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788521516.391798:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef821dda00, rc 0) 00000100:00100000:1.0:1788521516.391858:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+7:14980:x1875400201461120:12345-192.168.203.41@tcp:101:mkdir.0 Request processed in 408us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521516.391865:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 13 00010000:00010000:3.0:1788521516.494787:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788521516.878368:0:17953:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788521517.197482:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222520960:0@lo:400:kworker.0 00000100:00100000:2.0:1788521517.197482:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3644:1875400222520704:0@lo:400:kworker.0 00000100:00100000:0.0:1788521517.197581:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222520832:0@lo:400:kworker.0 00000100:00100000:1.0:1788521517.197597:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222520576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521517.198619:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521517.198664:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222521472:0@lo:400:kworker.0 00000100:00100000:3.0:1788521517.198690:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521517.198721:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875400222521984:0@lo:400:kworker.0 00000100:00100000:3.0:1788521517.198754:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521517.198802:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222520960 00000100:00100000:3.0:1788521517.198810:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222520960 00000100:00100000:3.0:1788521517.198863:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222521472 00000100:00100000:3.0:1788521517.198866:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222521472 00000100:00100000:3.0:1788521517.198903:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788521517.199183:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222520960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521517.199245:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222520960:12345-0@lo:400:kworker.0 Request processed in 333us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521517.199253:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788521517.199272:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788521517.199279:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222521472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521517.199386:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222521472:12345-0@lo:400:kworker.0 Request processed in 107us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521517.199393:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788521517.199415:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222521984 00000100:00100000:3.0:1788521517.199419:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222521984 00000100:00100000:3.0:1788521517.199448:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788521517.199455:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875400222521984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521517.199483:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875400222521984:12345-0@lo:400:kworker.0 Request processed in 29us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521517.199489:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1788521517.199518:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788521517.199522:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521517.199562:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222520960:0@lo:400:kworker.0 00000100:00100000:3.0:1788521517.199574:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222521472:0@lo:400:kworker.0 00010000:00080000:3.0:1788521517.199586:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43496a00 x1875400222521984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521517.199596:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3646:1875400222521984:0@lo:400:kworker.0 00000100:00100000:2.0:1788521517.200226:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521517.200226:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521517.200264:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875400222521216:0@lo:400:kworker.0 00000100:00100000:0.0:1788521517.200264:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222521344:0@lo:400:kworker.0 00000100:00100000:2.0:1788521517.200290:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521517.200290:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521517.200308:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222521728:0@lo:400:kworker.0 00000100:00100000:0.0:1788521517.200313:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875400222521856:0@lo:400:kworker.0 00000100:00100000:2.0:1788521517.200326:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521517.200340:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222520832 00000100:00100000:0.0:1788521517.200344:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222520832 00000100:00100000:2.0:1788521517.200345:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875400222522240:0@lo:400:kworker.0 00000100:00100000:2.0:1788521517.200367:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521517.200370:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222521344 00000100:00100000:0.0:1788521517.200373:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222521344 00000100:00100000:0.0:1788521517.200387:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788521517.200392:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222521216 00000100:00100000:0.0:1788521517.200393:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222520832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521517.200395:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222521216 00000100:00100000:2.0:1788521517.200415:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222521728 00000100:00100000:2.0:1788521517.200418:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222521728 00000100:00100000:0.0:1788521517.200428:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222520832:12345-0@lo:400:kworker.0 Request processed in 36us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521517.200429:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222522240 00000100:00100000:2.0:1788521517.200431:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222522240 00000100:00100000:0.0:1788521517.200435:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788521517.200447:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788521517.200448:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788521517.200453:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875400222521216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521517.200453:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222521344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521517.200478:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222521344:12345-0@lo:400:kworker.0 Request processed in 25us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521517.200480:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875400222521216:12345-0@lo:400:kworker.0 Request processed in 27us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521517.200484:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788521517.200485:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788521517.200496:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788521517.200502:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222521728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521517.200505:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521517.200519:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222522368:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788521517.200524:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875400222521728:12345-0@lo:400:kworker.0 Request processed in 24us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521517.200529:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788521517.200538:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222521856 00000100:00100000:2.0:1788521517.200541:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222521856 00000100:00100000:2.0:1788521517.200555:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788521517.200555:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521517.200566:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875400222522240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521517.200586:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222520832:0@lo:400:kworker.0 00000100:00100000:2.0:1788521517.200593:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875400222522240:12345-0@lo:400:kworker.0 Request processed in 28us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521517.200596:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222521344:0@lo:400:kworker.0 00000100:00100000:2.0:1788521517.200599:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788521517.200616:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222522368 00000100:00100000:0.0:1788521517.200620:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222522368 00000100:00100000:0.0:1788521517.200645:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788521517.200651:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222522368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788521517.200664:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788521517.200699:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222522368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521517.200936:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788521517.200976:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43d21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222522368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788521517.201004:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788521517.201012:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875400222521856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521517.201045:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875400222521856:12345-0@lo:400:kworker.0 Request processed in 34us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521517.201189:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788521517.201218:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3645:1875400222521856:0@lo:400:kworker.0 00000100:00080000:0.0:1788521517.201252:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521517.201258:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788521517.201260:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788521517.201512:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875400222521216:0@lo:400:kworker.0 00000100:00100000:2.0:1788521517.201523:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875400222521728:0@lo:400:kworker.0 00010000:00080000:2.0:1788521517.201536:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43497480 x1875400222522240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521517.201545:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3644:1875400222522240:0@lo:400:kworker.0 00000100:00100000:3.0:1788521517.201642:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222520704 00000100:00100000:3.0:1788521517.201647:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222520704 00000100:00100000:3.0:1788521517.201687:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788521517.201694:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:3644:x1875400222520704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521517.201741:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:3644:x1875400222520704:12345-0@lo:400:kworker.0 Request processed in 48us (1517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521517.201747:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788521517.202064:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3644:1875400222520704:0@lo:400:kworker.0 00000100:00100000:1.0:1788521517.206769:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521517.206976:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222521088:0@lo:400:kworker.0 00000100:00100000:1.0:1788521517.207011:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521517.207037:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222521600:0@lo:400:kworker.0 00000100:00100000:1.0:1788521517.207059:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521517.207093:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222522112:0@lo:400:kworker.0 00000100:00100000:1.0:1788521517.207122:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521517.207180:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222522112 00000100:00100000:1.0:1788521517.207189:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222522112 00000100:00100000:1.0:1788521517.207245:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788521517.207254:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222522112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521517.207306:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222522112:12345-0@lo:400:kworker.0 Request processed in 53us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521517.207313:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788521517.207354:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222522112:0@lo:400:kworker.0 00000100:00080000:1.0:1788521517.207388:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521517.207965:0:19185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222521088 00000100:00100000:2.0:1788521517.207971:0:19185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222521088 00000100:00100000:2.0:1788521517.208017:0:19185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222521600 00000100:00100000:2.0:1788521517.208020:0:19185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222521600 00000100:00100000:2.0:1788521517.208038:0:19185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788521517.208045:0:19185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3643:x1875400222521088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521517.208101:0:19185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3643:x1875400222521088:12345-0@lo:400:kworker.0 Request processed in 57us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521517.208108:0:19185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788521517.208122:0:19185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788521517.208128:0:19185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222521600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521517.208166:0:19185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222521600:12345-0@lo:400:kworker.0 Request processed in 38us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521517.208173:0:19185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788521517.208961:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788521517.209002:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222521088:0@lo:400:kworker.0 00000100:00100000:1.0:1788521517.209016:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222521600:0@lo:400:kworker.0 00000100:00100000:0.0:1788521517.211985:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222520576 00000100:00100000:0.0:1788521517.211999:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222520576 00000100:00100000:0.0:1788521517.212133:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788521517.212153:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875400222520576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788521517.212180:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788521517.212330:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875400222520576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 188us (5568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521517.212338:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788521517.220804:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222520576:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788521517.518510:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788521517.715797:0:19520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 130bc563-236a-43ec-a1a1-1e1e641e5bc7 00000001:00080000:1.0:1788521517.715811:0:19520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:0.0:1788521518.386012:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521518.386440:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201461248 00000100:00100000:3.0:1788521518.386450:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201461248 00000100:00100000:3.0:1788521518.386524:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 14 00000100:00100000:3.0:1788521518.386536:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130bc563-236a-43ec-a1a1-1e1e641e5bc7+7:15032:x1875400201461248:12345-192.168.203.41@tcp:41:lfs.0 00000004:00000024:3.0:1788521518.386574:0:19535:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788521518.386662:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130bc563-236a-43ec-a1a1-1e1e641e5bc7+7:15032:x1875400201461248:12345-192.168.203.41@tcp:41:lfs.0 Request processed in 129us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521518.386670:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 14 00000100:00080000:1.0:1788521518.387425:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521518.389863:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521518.390129:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201461376 00000100:00100000:1.0:1788521518.390150:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201461376 00000100:00100000:1.0:1788521518.390226:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 15 00000100:00100000:1.0:1788521518.390237:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef76715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+6:15032:x1875400201461376:12345-192.168.203.41@tcp:41:lfs.0 00000004:00000024:1.0:1788521518.390299:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788521518.390392:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef76715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+6:15032:x1875400201461376:12345-192.168.203.41@tcp:41:lfs.0 Request processed in 157us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521518.390400:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 15 00000100:00080000:0.0:1788521518.390473:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788521518.393160:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521518.393314:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201461504 00000100:00100000:1.0:1788521518.393323:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201461504 00000100:00100000:1.0:1788521518.393392:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 11 00000100:00100000:1.0:1788521518.393402:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:130bc563-236a-43ec-a1a1-1e1e641e5bc7+6:15032:x1875400201461504:12345-192.168.203.41@tcp:13:lfs.0 00002000:00000024:1.0:1788521518.393435:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788521518.393534:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:130bc563-236a-43ec-a1a1-1e1e641e5bc7+6:15032:x1875400201461504:12345-192.168.203.41@tcp:13:lfs.0 Request processed in 133us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521518.393541:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 11 00000100:00080000:0.0:1788521518.393600:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521518.396415:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521518.396940:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201461632 00000100:00100000:1.0:1788521518.396950:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201461632 00000100:00100000:1.0:1788521518.397066:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 12 00000100:00100000:1.0:1788521518.397077:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:130bc563-236a-43ec-a1a1-1e1e641e5bc7+5:15032:x1875400201461632:12345-192.168.203.41@tcp:13:lfs.0 00002000:00000024:1.0:1788521518.397107:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788521518.397198:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:130bc563-236a-43ec-a1a1-1e1e641e5bc7+5:15032:x1875400201461632:12345-192.168.203.41@tcp:13:lfs.0 Request processed in 123us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521518.397205:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 12 00000100:00080000:0.0:1788521518.398434:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788521518.541080:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521518.604218:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521518.604317:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201461760 00000100:00100000:2.0:1788521518.604327:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201461760 00000100:00100000:2.0:1788521518.604382:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 131 00000100:00100000:2.0:1788521518.604393:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+10:15064:x1875400201461760:12345-192.168.203.41@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788521518.604409:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521518.604427:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef457f2000/0x411dd0ee4d2d28fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x64dd99be98eeda15 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521518.604456:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef457f2000/0x411dd0ee4d2d28fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda15 expref: 11 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521518.604467:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef457f2000/0x411dd0ee4d2d28fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda15 expref: 11 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521518.604475:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef457f2000, rc 0) 00000100:00100000:2.0:1788521518.604535:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+11:15064:x1875400201461760:12345-192.168.203.41@tcp:101:mount.lustre.0 Request processed in 144us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521518.604543:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 131 00000100:00100000:3.0:1788521518.614328:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521518.614435:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201461888 00000100:00100000:0.0:1788521518.614444:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201461888 00000100:00100000:0.0:1788521518.614514:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 132 00000100:00100000:0.0:1788521518.614524:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+11:15064:x1875400201461888:12345-192.168.203.41@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788521518.614676:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+11:15064:x1875400201461888:12345-192.168.203.41@tcp:501:mount.lustre.0 Request processed in 152us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521518.614684:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 132 00000100:00100000:0.0:1788521518.629249:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521518.629800:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201462016 00000100:00100000:3.0:1788521518.629818:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201462016 00000100:00100000:3.0:1788521518.629939:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 133 00000100:00100000:3.0:1788521518.629950:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+11:15064:x1875400201462016:12345-192.168.203.41@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788521518.630148:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+11:15064:x1875400201462016:12345-192.168.203.41@tcp:503:mount.lustre.0 Request processed in 199us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521518.630157:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 133 00000100:00100000:3.0:1788521518.649746:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521518.656422:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201462144 00000100:00100000:2.0:1788521518.656445:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201462144 00000100:00100000:2.0:1788521518.656544:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 134 00000100:00100000:2.0:1788521518.656557:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+11:15071:x1875400201462144:12345-192.168.203.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788521518.656853:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+11:15071:x1875400201462144:12345-192.168.203.41@tcp:502:llog_process_th.0 Request processed in 296us (7121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521518.656863:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 134 00000100:00100000:1.0:1788521518.689752:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521518.690321:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201462272 00000100:00100000:0.0:1788521518.690335:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201462272 00000100:00100000:0.0:1788521518.690411:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 135 00000100:00100000:0.0:1788521518.690424:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+11:15071:x1875400201462272:12345-192.168.203.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788521518.690761:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+11:15071:x1875400201462272:12345-192.168.203.41@tcp:502:llog_process_th.0 Request processed in 338us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521518.690771:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 135 00000100:00100000:0.0:1788521518.694228:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521518.694678:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201462400 00000100:00100000:3.0:1788521518.694692:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201462400 00000100:00100000:3.0:1788521518.694762:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 136 00000100:00100000:3.0:1788521518.694775:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+11:15071:x1875400201462400:12345-192.168.203.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788521518.697472:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+11:15071:x1875400201462400:12345-192.168.203.41@tcp:502:llog_process_th.0 Request processed in 2675us (3234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521518.697492:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 136 00000100:00100000:3.0:1788521518.706969:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521518.707267:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201462528 00000100:00100000:2.0:1788521518.707281:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201462528 00000100:00100000:2.0:1788521518.707363:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 137 00000100:00100000:2.0:1788521518.707376:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+11:15064:x1875400201462528:12345-192.168.203.41@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788521518.707400:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521518.707430:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef457f3600/0x411dd0ee4d2d2901 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x64dd99be98eeda46 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521518.707632:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef457f3600/0x411dd0ee4d2d2901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda46 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521518.707647:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef457f3600/0x411dd0ee4d2d2901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda46 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521518.707658:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef457f3600, rc 0) 00000100:00100000:2.0:1788521518.707733:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+12:15064:x1875400201462528:12345-192.168.203.41@tcp:101:mount.lustre.0 Request processed in 359us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521518.707745:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 137 00000100:00100000:1.0:1788521518.711746:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521518.711937:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201462656 00000100:00100000:3.0:1788521518.712010:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201462656 00000100:00100000:3.0:1788521518.713022:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 138 00000100:00100000:3.0:1788521518.713040:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+12:15064:x1875400201462656:12345-192.168.203.41@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788521518.713091:0:17193:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788521518.713125:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788521518.713129:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788521518.713143:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788521518.713154:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788521518.713158:0:17193:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1788521518.718632:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+12:15064:x1875400201462656:12345-192.168.203.41@tcp:256:mount.lustre.0 Request processed in 5582us (6885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521518.718652:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 138 00000100:00100000:2.0:1788521518.723128:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521518.723918:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201462784 00000100:00100000:3.0:1788521518.723933:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201462784 00000100:00100000:3.0:1788521518.724030:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 139 00000100:00100000:3.0:1788521518.724043:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+12:15064:x1875400201462784:12345-192.168.203.41@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788521518.724068:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521518.724095:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef6d7b6c00/0x411dd0ee4d2d2908 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x64dd99be98eeda4d expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521518.724142:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef6d7b6c00/0x411dd0ee4d2d2908 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda4d expref: 13 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521518.724156:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef6d7b6c00/0x411dd0ee4d2d2908 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda4d expref: 13 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521518.724168:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b6c00, rc 0) 00000100:00100000:3.0:1788521518.724256:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+13:15064:x1875400201462784:12345-192.168.203.41@tcp:101:mount.lustre.0 Request processed in 216us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521518.724264:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 139 00000100:00100000:1.0:1788521518.726935:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521518.727044:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201462912 00000100:00100000:3.0:1788521518.727057:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201462912 00000100:00100000:3.0:1788521518.727127:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 140 00000100:00100000:3.0:1788521518.727151:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+13:15064:x1875400201462912:12345-192.168.203.41@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788521518.727352:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+13:15064:x1875400201462912:12345-192.168.203.41@tcp:501:mount.lustre.0 Request processed in 202us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521518.727378:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 140 00000100:00100000:1.0:1788521518.732168:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521518.734760:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201463040 00000100:00100000:0.0:1788521518.734780:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201463040 00000100:00100000:0.0:1788521518.734866:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 141 00000100:00100000:0.0:1788521518.734878:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+13:15064:x1875400201463040:12345-192.168.203.41@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788521518.735108:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+13:15064:x1875400201463040:12345-192.168.203.41@tcp:503:mount.lustre.0 Request processed in 231us (2953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521518.735117:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 141 00000100:00100000:0.0:1788521518.742608:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521518.742754:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201463168 00000100:00100000:2.0:1788521518.742767:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201463168 00000100:00100000:2.0:1788521518.742875:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 142 00000100:00100000:2.0:1788521518.743075:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+13:15076:x1875400201463168:12345-192.168.203.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788521518.744636:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+13:15076:x1875400201463168:12345-192.168.203.41@tcp:502:llog_process_th.0 Request processed in 1737us (2029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521518.744652:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 142 00000100:00100000:1.0:1788521518.747508:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521518.748006:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201463296 00000100:00100000:3.0:1788521518.748019:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201463296 00000100:00100000:3.0:1788521518.748095:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 143 00000100:00100000:3.0:1788521518.748108:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+13:15076:x1875400201463296:12345-192.168.203.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788521518.748344:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+13:15076:x1875400201463296:12345-192.168.203.41@tcp:502:llog_process_th.0 Request processed in 237us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521518.748353:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 143 00000100:00100000:1.0:1788521518.759522:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521518.759824:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521518.760425:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201463424 00000100:00100000:3.0:1788521518.760437:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201463680 00000100:00100000:2.0:1788521518.760457:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201463424 00000100:00100000:2.0:1788521518.760524:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 16 00000100:00100000:2.0:1788521518.760535:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2392:x1875400201463424:12345-192.168.203.41@tcp:38:mount.lustre.0 00000100:00100000:3.0:1788521518.760560:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201463680 00010000:00080000:2.0:1788521518.760574:0:17201:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f42285c1-7e18-4c56-9a31-6c5ebfa3d451@192.168.203.41@tcp t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:2.0:1788521518.760621:0:17201:0:(genops.c:1385:class_connect()) connect: client f42285c1-7e18-4c56-9a31-6c5ebfa3d451, cookie 0x411dd0ee4d2d290f 00000100:00100000:3.0:1788521518.760626:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 17 00000100:00100000:3.0:1788521518.760632:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1875400201463680:12345-192.168.203.41@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788521518.760649:0:19535:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from f42285c1-7e18-4c56-9a31-6c5ebfa3d451@192.168.203.41@tcp t0 exp 0000000000000000 cur 568 last 0 00000004:00100000:2.0:1788521518.760655:0:17201:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000020:00000080:3.0:1788521518.760676:0:19535:0:(genops.c:1385:class_connect()) connect: client f42285c1-7e18-4c56-9a31-6c5ebfa3d451, cookie 0x411dd0ee4d2d2916 00000004:00100000:3.0:1788521518.760691:0:19535:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788521518.760783:0:19535:0:(import.c:65:import_set_state_nolock()) ffff8fef483de800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788521518.760783:0:17201:0:(import.c:65:import_set_state_nolock()) ffff8fee42360000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788521518.760940:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+6:2392:x1875400201463680:12345-192.168.203.41@tcp:38:mount.lustre.0 Request processed in 304us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521518.761076:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 17 00000100:00100000:2.0:1788521518.761422:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+6:2392:x1875400201463424:12345-192.168.203.41@tcp:38:mount.lustre.0 Request processed in 886us (1916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521518.763420:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 16 00000100:00100000:0.0:1788521518.767529:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521518.767671:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201463808 00000100:00100000:1.0:1788521518.767685:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201463808 00000100:00100000:1.0:1788521518.767793:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 18 00000100:00100000:1.0:1788521518.767807:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+6:0:x1875400201463808:12345-192.168.203.41@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788521518.767850:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00080000:0.0:1788521518.768290:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788521518.768386:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+6:0:x1875400201463808:12345-192.168.203.41@tcp:41:mount.lustre.0 Request processed in 580us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521518.768396:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 18 00000100:00100000:0.0:1788521518.769435:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521518.769638:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521518.770057:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201463552 00000100:00100000:2.0:1788521518.770068:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201463552 00000100:00100000:2.0:1788521518.770145:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201463936 00000100:00100000:2.0:1788521518.770149:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201463936 00000100:00100000:2.0:1788521518.770168:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 19 00000100:00100000:2.0:1788521518.770179:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+7:0:x1875400201463552:12345-192.168.203.41@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788521518.770216:0:17201:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788521518.770294:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+7:0:x1875400201463552:12345-192.168.203.41@tcp:41:mount.lustre.0 Request processed in 117us (864us total) trans 0 rc 0/0 00000100:00080000:0.0:1788521518.770568:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521518.770597:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 19 00000100:00100000:2.0:1788521518.770619:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 20 00000100:00100000:2.0:1788521518.770627:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+6:15064:x1875400201463936:12345-192.168.203.41@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788521518.770640:0:17201:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788521518.770666:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+6:15064:x1875400201463936:12345-192.168.203.41@tcp:41:mount.lustre.0 Request processed in 41us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521518.770673:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 20 00000100:00100000:0.0:1788521518.776440:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521518.776573:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201464064 00000100:00100000:2.0:1788521518.776586:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201464064 00000100:00100000:2.0:1788521518.776663:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 21 00000100:00100000:2.0:1788521518.776676:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+6:15064:x1875400201464064:12345-192.168.203.41@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788521518.776799:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+6:15064:x1875400201464064:12345-192.168.203.41@tcp:40:mount.lustre.0 Request processed in 125us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521518.776808:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 21 00000100:00100000:1.0:1788521518.782393:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521518.782442:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521518.782555:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201464448 00000100:00100000:0.0:1788521518.782567:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201464448 00000100:00100000:0.0:1788521518.782639:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 4 00000100:00100000:0.0:1788521518.782651:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+6:15064:x1875400201464448:12345-192.168.203.41@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788521518.782761:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+6:15064:x1875400201464448:12345-192.168.203.41@tcp:900:mount.lustre.0 Request processed in 111us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521518.782769:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 4 00000100:00100000:1.0:1788521518.783648:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521518.784547:0:19185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201464192 00000100:00100000:2.0:1788521518.784559:0:19185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201464192 00000100:00100000:2.0:1788521518.784610:0:19185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201464320 00000100:00100000:2.0:1788521518.784614:0:19185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201464320 00000100:00100000:0.0:1788521518.784938:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 21 00000100:00100000:0.0:1788521518.784961:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2392:x1875400201464192:12345-192.168.203.41@tcp:8:mount.lustre.0 00000100:00100000:2.0:1788521518.785005:0:19185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 22 00010000:00080000:0.0:1788521518.785013:0:18706:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f42285c1-7e18-4c56-9a31-6c5ebfa3d451@192.168.203.41@tcp t0 exp 0000000000000000 cur 568 last 0 00000100:00100000:2.0:1788521518.785024:0:19185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2392:x1875400201464320:12345-192.168.203.41@tcp:8:mount.lustre.0 00000020:00000080:0.0:1788521518.785063:0:18706:0:(genops.c:1385:class_connect()) connect: client f42285c1-7e18-4c56-9a31-6c5ebfa3d451, cookie 0x411dd0ee4d2d291d 00010000:00080000:2.0:1788521518.785070:0:19185:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f42285c1-7e18-4c56-9a31-6c5ebfa3d451@192.168.203.41@tcp t0 exp 0000000000000000 cur 568 last 0 00002000:00100000:0.0:1788521518.785083:0:18706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f42285c1-7e18-4c56-9a31-6c5ebfa3d451/ffff8fee44400000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788521518.785101:0:18706:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000080:2.0:1788521518.785110:0:19185:0:(genops.c:1385:class_connect()) connect: client f42285c1-7e18-4c56-9a31-6c5ebfa3d451, cookie 0x411dd0ee4d2d2924 00002000:00100000:2.0:1788521518.785127:0:19185:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f42285c1-7e18-4c56-9a31-6c5ebfa3d451/ffff8fee42367800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788521518.785149:0:19185:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788521518.785232:0:18706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00080000:2.0:1788521518.785259:0:19185:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788521518.785444:0:19185:0:(import.c:65:import_set_state_nolock()) ffff8fee42362000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788521518.785516:0:19185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+6:2392:x1875400201464320:12345-192.168.203.41@tcp:8:mount.lustre.0 Request processed in 498us (1872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521518.785524:0:19185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 22 00000100:00080000:0.0:1788521518.786390:0:18706:0:(import.c:65:import_set_state_nolock()) ffff8fee44407000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788521518.786467:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+6:2392:x1875400201464192:12345-192.168.203.41@tcp:8:mount.lustre.0 Request processed in 1505us (4020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521518.786478:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 21 00000100:00100000:3.0:1788521518.790358:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521518.790613:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201464576 00000100:00100000:1.0:1788521518.790626:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201464576 00000100:00100000:1.0:1788521518.790692:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 1 00000100:00100000:1.0:1788521518.790704:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+6:15064:x1875400201464576:12345-192.168.203.41@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788521518.790815:0:17203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788521518.790988:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+6:15064:x1875400201464576:12345-192.168.203.41@tcp:33:mount.lustre.0 Request processed in 285us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521518.790997:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 1 00000100:00100000:2.0:1788521518.959160:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521518.959414:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201464704 00000100:00100000:3.0:1788521518.959428:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201464704 00000100:00100000:3.0:1788521518.959687:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 22 00000100:00100000:3.0:1788521518.959701:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+6:15099:x1875400201464704:12345-192.168.203.41@tcp:101:mkdir.0 00010000:00010000:3.0:1788521518.959733:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521518.959793:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6a00/0x411dd0ee4d2d292b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eeda7e expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521518.959940:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2932 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521518.959961:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2932 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521518.959978:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2932 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521518.960038:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788521518.960042:0:17200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788521518.960084:0:17200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2932 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521518.960119:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6a00/0x411dd0ee4d2d292b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda7e expref: 8 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521518.960153:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2932 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda7e expref: 7 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521518.960162:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef51db3d00) 00010000:00010000:3.0:1788521518.960166:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788521518.960170:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7800, rc 0) 00000100:00100000:3.0:1788521518.960316:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+7:15099:x1875400201464704:12345-192.168.203.41@tcp:101:mkdir.0 Request processed in 617us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521518.960324:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 22 00010000:00010000:2.0:1788521519.565289:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521520.591079:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521520.781138:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788521520.781189:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222522496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521520.781285:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521520.781352:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222522496 00000100:00100000:2.0:1788521520.781362:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222522496 00000100:00100000:2.0:1788521520.781433:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788521520.781446:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222522496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788521520.781500:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788521520.781553:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222522496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521520.781561:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788521520.781587:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521520.781632:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222522496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521520.782942:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788521520.782977:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222522624:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788521520.783041:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521520.783090:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222522624 00000100:00100000:3.0:1788521520.783098:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222522624 00000100:00100000:3.0:1788521520.783158:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788521520.783168:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222522624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788521520.783205:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788521520.783255:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222522624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521520.783263:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788521520.783311:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222522624:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788521520.787223:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788521520.787880:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222522752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788521520.788257:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521520.789037:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222522752 00000100:00100000:2.0:1788521520.789049:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222522752 00000100:00100000:2.0:1788521520.789147:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788521520.789159:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222522752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788521520.789191:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788521520.789261:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222522752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521520.789269:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788521520.789519:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521520.789790:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222522752:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788521521.294036:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4321e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222522880:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788521521.294144:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521521.294221:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222522880 00000100:00100000:0.0:1788521521.294232:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222522880 00000100:00100000:0.0:1788521521.294309:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788521521.294321:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222522880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788521521.294367:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788521521.297926:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222522880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3592us (3767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521521.297944:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788521521.298916:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4321e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222522880:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788521521.613051:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788521521.808180:0:17931:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f42285c1-7e18-4c56-9a31-6c5ebfa3d451 00000001:00100000:1.0:1788521521.808195:0:17931:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 130bc563-236a-43ec-a1a1-1e1e641e5bc7 00000001:00100000:3.0:1788521521.808710:0:18701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f42285c1-7e18-4c56-9a31-6c5ebfa3d451 00000001:00100000:3.0:1788521521.808721:0:18701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 130bc563-236a-43ec-a1a1-1e1e641e5bc7 00000001:00100000:1.0:1788521521.809591:0:17179:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f42285c1-7e18-4c56-9a31-6c5ebfa3d451 00000001:00100000:1.0:1788521521.809601:0:17179:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 130bc563-236a-43ec-a1a1-1e1e641e5bc7 00000040:00080000:0.0:1788521522.126138:0:17234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788521522.317103:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222523008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788521522.317213:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521522.317364:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222523008 00000100:00100000:0.0:1788521522.317376:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222523008 00000100:00100000:0.0:1788521522.317458:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788521522.317470:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222523008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788521522.317512:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788521522.317561:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222523008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521522.317569:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788521522.317753:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788521522.317794:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222523008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788521522.321017:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222523264:0@lo:400:kworker.0 00000100:00100000:2.0:1788521522.321125:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521522.321204:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222523776:0@lo:400:kworker.0 00000100:00100000:2.0:1788521522.321230:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521522.321245:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875400222524288:0@lo:400:kworker.0 00000100:00100000:2.0:1788521522.321269:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521522.321637:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788521522.321645:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3644:1875400222523136:0@lo:400:kworker.0 00000100:00100000:2.0:1788521522.321678:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521522.321713:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875400222523648:0@lo:400:kworker.0 00000100:00100000:2.0:1788521522.321737:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521522.321755:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875400222524160:0@lo:400:kworker.0 00000100:00100000:2.0:1788521522.321775:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521522.321802:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222523392:0@lo:400:kworker.0 00000100:00100000:2.0:1788521522.321830:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521522.321850:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222523904:0@lo:400:kworker.0 00000100:00100000:2.0:1788521522.321869:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521522.321910:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875400222524416:0@lo:400:kworker.0 00000100:00100000:2.0:1788521522.321938:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521522.321957:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788521522.321963:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222523520:0@lo:400:kworker.0 00000100:00100000:2.0:1788521522.321982:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521522.322045:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222523136 00000100:00100000:0.0:1788521522.322055:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222523136 00000100:00100000:1.0:1788521522.322216:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4321c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222524672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521522.322249:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521522.322297:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222523264 00000100:00100000:1.0:1788521522.322302:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222523264 00000100:00100000:1.0:1788521522.322334:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222523776 00000100:00100000:1.0:1788521522.322337:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222523776 00000100:00100000:1.0:1788521522.322357:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788521522.322367:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222523264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521522.322428:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222523264:12345-0@lo:400:kworker.0 Request processed in 62us (1302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521522.322436:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788521522.322456:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788521522.322463:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222523776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521522.322492:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222523776:12345-0@lo:400:kworker.0 Request processed in 30us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521522.322498:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788521522.322963:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222524288 00000100:00100000:1.0:1788521522.322971:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222524288 00000100:00100000:1.0:1788521522.323009:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222523648 00000100:00100000:1.0:1788521522.323014:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222523648 00000100:00100000:1.0:1788521522.323025:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222524160 00000100:00100000:1.0:1788521522.323028:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222524160 00000100:00100000:1.0:1788521522.323040:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222524416 00000100:00100000:1.0:1788521522.323043:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222524416 00000100:00100000:1.0:1788521522.323059:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788521522.323065:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875400222524288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521522.323142:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875400222524288:12345-0@lo:400:kworker.0 Request processed in 77us (1872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521522.323151:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788521522.323164:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788521522.323171:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875400222523648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521522.323199:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875400222523648:12345-0@lo:400:kworker.0 Request processed in 29us (1461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521522.323204:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788521522.323215:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788521522.323220:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875400222524160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521522.323246:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875400222524160:12345-0@lo:400:kworker.0 Request processed in 27us (1470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521522.323252:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788521522.323263:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788521522.323268:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875400222524416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521522.323296:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875400222524416:12345-0@lo:400:kworker.0 Request processed in 29us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521522.323301:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788521522.323351:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875400222523648:0@lo:400:kworker.0 00000100:00100000:1.0:1788521522.323366:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3644:1875400222524160:0@lo:400:kworker.0 00000100:00100000:1.0:1788521522.323379:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222523264:0@lo:400:kworker.0 00000100:00100000:1.0:1788521522.323391:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222523776:0@lo:400:kworker.0 00010000:00080000:1.0:1788521522.323407:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43495180 x1875400222524288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521522.323428:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3644:1875400222524288:0@lo:400:kworker.0 00000100:00080000:1.0:1788521522.323646:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788521522.323651:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788521522.323666:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222524672 00000100:00100000:1.0:1788521522.323671:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222524672 00000100:00100000:1.0:1788521522.323711:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788521522.323718:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222524672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521522.323736:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788521522.323779:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222524672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (1529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521522.323785:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788521522.323801:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788521522.323820:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1788521522.323840:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4321c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222524672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521522.334395:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788521522.334428:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef769fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:3644:x1875400222523136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521522.334561:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef769fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:3644:x1875400222523136:12345-0@lo:400:kworker.0 Request processed in 149us (12881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521522.334570:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788521522.335683:0:19185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222523392 00000100:00100000:3.0:1788521522.335699:0:19185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222523392 00000100:00100000:3.0:1788521522.335781:0:19185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222523904 00000100:00100000:3.0:1788521522.335785:0:19185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222523904 00000100:00100000:3.0:1788521522.335803:0:19185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222523520 00000100:00100000:3.0:1788521522.335806:0:19185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222523520 00000100:00100000:3.0:1788521522.335825:0:19185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788521522.335835:0:19185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222523392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521522.335931:0:19185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222523392:12345-0@lo:400:kworker.0 Request processed in 98us (14100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521522.335958:0:19185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788521522.335977:0:19185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788521522.335983:0:19185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222523904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521522.336016:0:19185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222523904:12345-0@lo:400:kworker.0 Request processed in 34us (14146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521522.336022:0:19185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788521522.336033:0:19185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788521522.336040:0:19185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222523520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521522.336069:0:19185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222523520:12345-0@lo:400:kworker.0 Request processed in 31us (14086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521522.336075:0:19185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788521522.336326:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521522.336407:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222523520:0@lo:400:kworker.0 00000100:00100000:3.0:1788521522.336422:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222524032:0@lo:400:kworker.0 00000100:00100000:3.0:1788521522.336470:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521522.336542:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222524544:0@lo:400:kworker.0 00000100:00100000:3.0:1788521522.336565:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521522.336790:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3644:1875400222523136:0@lo:400:kworker.0 00000100:00100000:3.0:1788521522.347511:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222523392:0@lo:400:kworker.0 00000100:00100000:3.0:1788521522.347535:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222523904:0@lo:400:kworker.0 00000100:00100000:3.0:1788521522.347548:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3645:1875400222524416:0@lo:400:kworker.0 00000100:00100000:0.0:1788521522.347797:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222524032 00000100:00100000:0.0:1788521522.347807:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222524032 00000100:00100000:0.0:1788521522.351100:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222524544 00000100:00100000:0.0:1788521522.351127:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222524544 00000100:00080000:0.0:1788521522.351164:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788521522.351209:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788521522.351221:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222524032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521522.351341:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222524032:12345-0@lo:400:kworker.0 Request processed in 122us (14869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521522.351366:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788521522.351387:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788521522.351394:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222524544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521522.351427:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222524544:12345-0@lo:400:kworker.0 Request processed in 34us (14861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521522.351434:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788521522.351547:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222524032:0@lo:400:kworker.0 00010000:00080000:3.0:1788521522.351566:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee4244c000 x1875400222524544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521522.351591:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222524544:0@lo:400:kworker.0 00000001:02000400:2.0:1788521522.437490:0:20076:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788521522.640418:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521523.661133:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521523.825411:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521523.825516:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521523.825545:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521523.825587:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521523.825628:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521523.825648:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521523.825667:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521523.825687:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521523.825718:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521523.825764:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201465088 00000100:00100000:2.0:1788521523.825776:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201465088 00000100:00100000:2.0:1788521523.825843:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201464960 00000100:00100000:2.0:1788521523.825847:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201464960 00000100:00100000:2.0:1788521523.829865:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201465472 00000100:00100000:2.0:1788521523.829880:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201465472 00000100:00100000:2.0:1788521523.830050:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201465600 00000100:00100000:2.0:1788521523.830053:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201465600 00000100:00100000:2.0:1788521523.830078:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 44 00000100:00100000:2.0:1788521523.830089:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130bc563-236a-43ec-a1a1-1e1e641e5bc7+5:2394:x1875400201465088:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521523.830270:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201464832 00000100:00100000:3.0:1788521523.830277:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201464832 00000100:00100000:3.0:1788521523.830321:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 145 00000100:00100000:2.0:1788521523.830327:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130bc563-236a-43ec-a1a1-1e1e641e5bc7+5:2394:x1875400201465088:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 237us (4808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521523.830335:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+13:2394:x1875400201464832:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521523.830341:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 44 00000100:00100000:2.0:1788521523.830368:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 45 00000100:00100000:3.0:1788521523.830375:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+13:2394:x1875400201464832:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 44us (4979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521523.830378:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130bc563-236a-43ec-a1a1-1e1e641e5bc7+6:2393:x1875400201464960:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521523.830391:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 145 00000100:00100000:2.0:1788521523.830416:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130bc563-236a-43ec-a1a1-1e1e641e5bc7+6:2393:x1875400201464960:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 40us (4869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521523.830424:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 45 00000100:00100000:2.0:1788521523.830438:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 46 00000100:00100000:2.0:1788521523.830444:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+6:2393:x1875400201465472:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521523.830466:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+6:2393:x1875400201465472:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 21us (4816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521523.830472:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 47 00000100:00100000:3.0:1788521523.830484:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+5:2394:x1875400201465600:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521523.830521:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+5:2394:x1875400201465600:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 39us (4852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521523.830649:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 46 00000100:00100000:2.0:1788521523.830674:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201465216 00000100:00100000:2.0:1788521523.830678:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201465216 00000100:00100000:2.0:1788521523.830700:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201465344 00000100:00100000:2.0:1788521523.830703:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201465344 00000100:00100000:2.0:1788521523.830714:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201465728 00000100:00100000:2.0:1788521523.830717:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201465728 00000100:00100000:2.0:1788521523.830726:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201465856 00000100:00100000:2.0:1788521523.830729:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201465856 00000100:00100000:2.0:1788521523.830742:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 12 00000100:00100000:2.0:1788521523.830748:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+5:2393:x1875400201465216:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521523.830773:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+5:2393:x1875400201465216:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 26us (5186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521523.830780:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 12 00000100:00100000:2.0:1788521523.830789:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 13 00000100:00100000:2.0:1788521523.830795:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+5:2394:x1875400201465344:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521523.830813:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+5:2394:x1875400201465344:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 18us (5185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521523.830819:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 13 00000100:00100000:2.0:1788521523.830827:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 14 00000100:00100000:2.0:1788521523.830832:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+5:2393:x1875400201465728:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521523.830848:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+5:2393:x1875400201465728:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 17us (5162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521523.830854:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 14 00000100:00100000:2.0:1788521523.830862:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 15 00000100:00100000:2.0:1788521523.830873:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4244df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+6:2394:x1875400201465856:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521523.831034:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4244df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+6:2394:x1875400201465856:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 159us (5314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521523.831042:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 15 00000100:00080000:2.0:1788521523.831073:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521523.831078:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788521523.831080:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788521523.831083:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788521523.831878:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 47 00010000:00010000:2.0:1788521524.685126:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788521524.882454:0:19520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f42285c1-7e18-4c56-9a31-6c5ebfa3d451 00010000:00010000:3.0:1788521525.710450:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521525.902409:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788521525.902439:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222524800:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788521525.902529:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521525.902592:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222524800 00000100:00100000:3.0:1788521525.902601:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222524800 00000100:00100000:3.0:1788521525.902662:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788521525.902672:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222524800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788521525.902715:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788521525.902766:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222524800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521525.902791:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788521525.902852:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222524800:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788521525.908947:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222524928:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788521525.909051:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521525.909142:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222524928 00000100:00100000:3.0:1788521525.909152:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222524928 00000100:00100000:3.0:1788521525.909230:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788521525.909242:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222524928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788521525.909280:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788521525.909332:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222524928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521525.909340:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788521525.909407:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222524928:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788521525.909449:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521525.914231:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521525.914262:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222525056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521525.914357:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521525.914414:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222525056 00000100:00100000:0.0:1788521525.914423:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222525056 00000100:00100000:0.0:1788521525.914494:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788521525.914504:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222525056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788521525.914533:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788521525.914582:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875400222525056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521525.914589:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788521525.914615:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521525.914661:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3645:1875400222525056:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1788521526.031372:0:20224:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd0ee60960 20000000:00000080:2.0:1788521526.031397:0:20224:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8fef7528a400 uarg=0000000000000000 20000000:01000000:2.0:1788521526.031454:0:20224:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788521526.031462:0:20224:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788521526.031468:0:20224:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788521526.041856:0:20225:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1788521526.042520:0:20224:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788521526.061670:0:20224:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788521526.066303:0:20224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fef457f2c00/0x411dd0ee4d2d2939 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521526.066452:0:20224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef413fd800/0x411dd0ee4d2d25ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d25c7 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521526.066461:0:20224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef7f12dc00/0x411dd0ee4d2d25dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d25d5 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521526.066468:0:20224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fee434ab400/0x411dd0ee4d2d261b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2614 expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521526.066474:0:20224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef457f3a00/0x411dd0ee4d2d2780 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2779 expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521526.066509:0:20224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef821dd600/0x411dd0ee4d2d28c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed9dd expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521526.066516:0:20224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fef6d7b6c00/0x411dd0ee4d2d2908 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda4d expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521526.066525:0:20224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fef457f2c00/0x411dd0ee4d2d2939 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521526.066581:0:20224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef6d7b6c00/0x411dd0ee4d2d2908 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda4d expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521526.066602:0:20224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fef6d7b6c00/0x411dd0ee4d2d2908 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda4d expref: 12 pid: 17192 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521526.066620:0:20224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1875400222525184:192.168.203.41@tcp:104: 00010000:00010000:2.0:1788521526.066812:0:20224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef821dd600/0x411dd0ee4d2d28c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed9dd expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521526.066822:0:20224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fef821dd600/0x411dd0ee4d2d28c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed9dd expref: 12 pid: 17194 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521526.066832:0:20224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef752b3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1875400222525312:192.168.203.41@tcp:104: 00010000:00010000:2.0:1788521526.067102:0:20224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef457f3a00/0x411dd0ee4d2d2780 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d2779 expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521526.067111:0:20224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fef457f3a00/0x411dd0ee4d2d2780 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2779 expref: 23 pid: 17194 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521526.067133:0:20224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef752b1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1875400222525440:0@lo:104: 00000100:00100000:2.0:1788521526.067181:0:20224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788521526.067228:0:20224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fee434ab400/0x411dd0ee4d2d261b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d2614 expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521526.067237:0:20224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fee434ab400/0x411dd0ee4d2d261b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2614 expref: 23 pid: 17193 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521526.067246:0:20224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef752b0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1875400222525568:0@lo:104: 00000100:00100000:0.0:1788521526.067307:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222525440 00000100:00100000:0.0:1788521526.067318:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222525440 00000100:00100000:0.0:1788521526.067386:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788521526.067406:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef752b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+3:20224:x1875400222525440:12345-0@lo:104: 00010000:00010000:0.0:1788521526.067423:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef821dd200/0x411dd0ee4d2d2779 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d2780 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521526.067479:0:20224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788521526.067507:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1788521526.067508:0:20224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef7f12dc00/0x411dd0ee4d2d25dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d25d5 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521526.067519:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef752b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+3:20224:x1875400222525440:12345-0@lo:104: Request processed in 122us (336us total) trans 0 rc 0/0 00010000:00010000:2.0:1788521526.067524:0:20224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fef7f12dc00/0x411dd0ee4d2d25dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d25d5 expref: 23 pid: 17192 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521526.067532:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788521526.067540:0:20224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef752b0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1875400222525696:0@lo:104: 00000100:00100000:0.0:1788521526.067553:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222525568 00000100:00100000:0.0:1788521526.067558:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222525568 00000100:00100000:0.0:1788521526.067573:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788521526.067579:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef752b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+3:20224:x1875400222525568:12345-0@lo:104: 00010000:00010000:0.0:1788521526.067588:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef457f2e00/0x411dd0ee4d2d2614 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d261b expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521526.067621:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788521526.067627:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef752b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+3:20224:x1875400222525568:12345-0@lo:104: Request processed in 48us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521526.067633:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788521526.067652:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788521526.067659:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef821dd200/0x411dd0ee4d2d2779 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d2780 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521526.067666:0:20224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788521526.067674:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef821dd200 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:0.0:1788521526.067681:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef821dd200/0x411dd0ee4d2d2779 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d2780 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521526.067691:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef821dd200/0x411dd0ee4d2d2779 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d2780 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521526.067699:0:20224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fef413fd800/0x411dd0ee4d2d25ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x411dd0ee4d2d25c7 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521526.067702:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef821dd200/0x411dd0ee4d2d2779 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d2780 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521526.067719:0:20224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fef413fd800/0x411dd0ee4d2d25ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x411dd0ee4d2d25c7 expref: 23 pid: 17192 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521526.067738:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788521526.067741:0:20224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef752b3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1875400222525824:0@lo:104: 00000100:00100000:2.0:1788521526.067769:0:20224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788521526.067780:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef821dd200/0x411dd0ee4d2d2779 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d2780 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521526.067782:0:20224:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef6d7f9a80 going to sleep for 11 seconds 00010000:00010000:0.0:1788521526.067791:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788521526.067812:0:20224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef752b1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1875400222525440:0@lo:104: 00010000:00010000:0.0:1788521526.067817:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef821dd200/0x411dd0ee4d2d2779 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d2780 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521526.067831:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef821dd200/0x411dd0ee4d2d2779 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d2780 expref: -99 pid: 19519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521526.067838:0:20224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef752b0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1875400222525568:0@lo:104: 00000100:00100000:3.0:1788521526.067919:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222525696 00000100:00100000:3.0:1788521526.067924:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222525696 00000100:00100000:3.0:1788521526.067948:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222525824 00000100:00100000:3.0:1788521526.067951:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222525824 00000100:00100000:3.0:1788521526.067964:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788521526.067971:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef752b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+4:20224:x1875400222525696:12345-0@lo:104: 00010000:00010000:3.0:1788521526.067980:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fee434ab000/0x411dd0ee4d2d25d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d25dc expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521526.068016:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788521526.068029:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef752b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+4:20224:x1875400222525696:12345-0@lo:104: Request processed in 58us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521526.068036:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788521526.068052:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788521526.068058:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef752b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+3:20224:x1875400222525824:12345-0@lo:104: 00010000:00010000:3.0:1788521526.068066:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.141@tcp lock: ffff8fef7f12c600/0x411dd0ee4d2d25c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d25ce expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521526.068105:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788521526.068111:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef752b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+3:20224:x1875400222525824:12345-0@lo:104: Request processed in 53us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521526.068117:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788521526.068131:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:3.0:1788521526.068155:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3643:1875400222525952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521526.068186:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788521526.068247:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788521526.068252:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fee434ab000/0x411dd0ee4d2d25d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d25dc expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521526.068259:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee434ab000 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:0.0:1788521526.068262:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fee434ab000/0x411dd0ee4d2d25d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d25dc expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521526.068270:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fee434ab000/0x411dd0ee4d2d25d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d25dc expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521526.068277:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fee434ab000/0x411dd0ee4d2d25d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d25dc expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521526.068282:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788521526.068297:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fee434ab000/0x411dd0ee4d2d25d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d25dc expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521526.068303:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521526.068316:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fee434ab000/0x411dd0ee4d2d25d5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d25dc expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521526.068322:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fee434ab000/0x411dd0ee4d2d25d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d25dc expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521526.068933:0:20224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef752b0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1875400222525696:0@lo:104: 00000100:00100000:2.0:1788521526.069060:0:20224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef752b3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1875400222525824:0@lo:104: 00010000:00010000:2.0:1788521526.069400:0:20226:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521526.069410:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef457f2e00/0x411dd0ee4d2d2614 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d261b expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521526.069419:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef457f2e00 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:2.0:1788521526.069423:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef457f2e00/0x411dd0ee4d2d2614 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d261b expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521526.069433:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef457f2e00/0x411dd0ee4d2d2614 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d261b expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521526.069440:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef457f2e00/0x411dd0ee4d2d2614 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d261b expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521526.069446:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788521526.069472:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef457f2e00/0x411dd0ee4d2d2614 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d261b expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521526.069479:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521526.069500:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef457f2e00/0x411dd0ee4d2d2614 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d261b expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521526.069506:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef457f2e00/0x411dd0ee4d2d2614 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d261b expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521526.069520:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521526.069527:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521526.069530:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521526.069549:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788521526.069760:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef752b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3646:1875400222526208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788521526.069820:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521526.070306:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222525952 00000100:00100000:1.0:1788521526.070314:0:18731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222525952 00010000:00010000:1.0:1788521526.070343:0:18731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef457f3a00/0x411dd0ee4d2d2780 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2779 expref: 24 pid: 17194 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521526.070374:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222526208 00000100:00100000:1.0:1788521526.070377:0:18731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222526208 00010000:00010000:1.0:1788521526.070387:0:18731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fee434ab400/0x411dd0ee4d2d261b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2614 expref: 25 pid: 17193 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521526.070407:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788521526.070414:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+25:3643:x1875400222525952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788521526.070437:0:18731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521526.070443:0:18731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef457f3a00/0x411dd0ee4d2d2780 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2779 expref: 25 pid: 17194 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521526.070454:0:18731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef457f3a00/0x411dd0ee4d2d2780 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2779 expref: 25 pid: 17194 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521526.070472:0:18731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef457f3a00/0x411dd0ee4d2d2780 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d2779 expref: 25 pid: 17194 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521526.070486:0:18731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521526.070523:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:3643:x1875400222525952:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (2336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521526.070530:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788521526.070546:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788521526.070551:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef752b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+23:3646:x1875400222526208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788521526.070558:0:18731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521526.070562:0:18731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fee434ab400/0x411dd0ee4d2d261b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2614 expref: 23 pid: 17193 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521526.070570:0:18731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fee434ab400/0x411dd0ee4d2d261b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d2614 expref: 23 pid: 17193 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521526.070580:0:18731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fee434ab400/0x411dd0ee4d2d261b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d2614 expref: 23 pid: 17193 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521526.078827:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521526.078942:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521526.078982:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201465984 00000100:00100000:3.0:1788521526.078994:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201465984 00010000:00010000:3.0:1788521526.079039:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef6d7b6c00/0x411dd0ee4d2d2908 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda4d expref: 13 pid: 17192 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521526.079070:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201466112 00000100:00100000:3.0:1788521526.079074:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201466112 00010000:00010000:3.0:1788521526.079149:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef821dd600/0x411dd0ee4d2d28c9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed9dd expref: 14 pid: 17194 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521526.079167:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 11 00000100:00100000:3.0:1788521526.079178:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+14:2396:x1875400201465984:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521526.079213:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521526.079221:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef6d7b6c00/0x411dd0ee4d2d2908 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda4d expref: 14 pid: 17192 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521526.079236:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef6d7b6c00/0x411dd0ee4d2d2908 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda4d expref: 14 pid: 17192 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521526.079263:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521526.079289:0:20224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef6d7b6c00/0x411dd0ee4d2d2908 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda4d expref: 14 pid: 17192 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521526.079309:0:20224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1875400222525184:192.168.203.41@tcp:104: 00000100:00100000:2.0:1788521526.079323:0:20224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef752b3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20224:1875400222525312:192.168.203.41@tcp:104: 00000100:00100000:3.0:1788521526.079333:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+13:2396:x1875400201465984:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 155us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521526.079343:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 11 00000100:00100000:3.0:1788521526.079368:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 12 00010000:00010000:2.0:1788521526.079374:0:20224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fef457f2c00/0x411dd0ee4d2d2939 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521526.079378:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+12:2395:x1875400201466112:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521526.079392:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521526.079399:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef821dd600/0x411dd0ee4d2d28c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed9dd expref: 12 pid: 17194 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521526.079410:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef821dd600/0x411dd0ee4d2d28c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed9dd expref: 12 pid: 17194 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521526.079421:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef821dd600/0x411dd0ee4d2d28c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eed9dd expref: 12 pid: 17194 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521526.079426:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3643:1875400222525952:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788521526.079435:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521526.079449:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788521526.079457:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+11:2395:x1875400201466112:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 81us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521526.079465:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3643:1875400222526080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521526.079466:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 12 00000100:00100000:2.0:1788521526.079524:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521526.079595:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222526080 00000100:00100000:2.0:1788521526.079600:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222526080 00010000:00010000:2.0:1788521526.079618:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef7f12dc00/0x411dd0ee4d2d25dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d25d5 expref: 23 pid: 17192 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521526.079634:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788521526.079640:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7efffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+23:3643:x1875400222526080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788521526.079650:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521526.079655:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef7f12dc00/0x411dd0ee4d2d25dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d25d5 expref: 23 pid: 17192 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521526.079677:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef7f12dc00/0x411dd0ee4d2d25dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d25d5 expref: 23 pid: 17192 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521526.079690:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef7f12dc00/0x411dd0ee4d2d25dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d25d5 expref: 23 pid: 17192 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521526.079700:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521526.079745:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7efffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+22:3643:x1875400222526080:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521526.079752:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788521526.080800:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3643:1875400222526080:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788521526.085230:0:18731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521526.085378:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef752b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:3646:x1875400222526208:12345-0@lo:103:ldlm_bl.0 Request processed in 14817us (15549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521526.085427:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788521526.085785:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef752b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3646:1875400222526208:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788521526.086156:0:20227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521526.086160:0:20227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521526.086163:0:20227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521526.086198:0:20226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.141@tcp lock: ffff8fef7f12c600/0x411dd0ee4d2d25c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x411dd0ee4d2d25ce expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521526.086211:0:20226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef7f12c600 already unused, calling callback (ffffffffc1352c20) 10000000:00010000:3.0:1788521526.086217:0:20226:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.141@tcp lock: ffff8fef7f12c600/0x411dd0ee4d2d25c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x411dd0ee4d2d25ce expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521526.086229:0:20226:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.141@tcp lock: ffff8fef7f12c600/0x411dd0ee4d2d25c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x411dd0ee4d2d25ce expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521526.086237:0:20226:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.141@tcp lock: ffff8fef7f12c600/0x411dd0ee4d2d25c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x411dd0ee4d2d25ce expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521526.086243:0:20226:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788521526.086291:0:20226:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.141@tcp lock: ffff8fef7f12c600/0x411dd0ee4d2d25c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d25ce expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521526.086297:0:20226:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521526.086325:0:20226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.141@tcp lock: ffff8fef7f12c600/0x411dd0ee4d2d25c7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d25ce expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521526.086333:0:20226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.141@tcp lock: ffff8fef7f12c600/0x411dd0ee4d2d25c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x411dd0ee4d2d25ce expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521526.086352:0:20226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521526.086354:0:20226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521526.086355:0:20226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521526.086404:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3646:1875400222526336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788521526.086460:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521526.086549:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222526336 00000100:00100000:3.0:1788521526.086556:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222526336 00010000:00010000:3.0:1788521526.086585:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fef413fd800/0x411dd0ee4d2d25ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d25c7 expref: 21 pid: 17192 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521526.086636:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788521526.086646:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef752b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:3646:x1875400222526336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788521526.086661:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521526.086667:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fef413fd800/0x411dd0ee4d2d25ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x411dd0ee4d2d25c7 expref: 21 pid: 17192 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521526.086680:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fef413fd800/0x411dd0ee4d2d25ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x411dd0ee4d2d25c7 expref: 21 pid: 17192 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521526.086696:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef413fd800/0x411dd0ee4d2d25ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x411dd0ee4d2d25c7 expref: 21 pid: 17192 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521526.086713:0:17186:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fef457f2c00/0x411dd0ee4d2d2939 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521526.086723:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef457f2c00/0x411dd0ee4d2d2939 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521526.086741:0:17186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fef457f2c00/0x411dd0ee4d2d2939 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521526.086750:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fef457f2c00/0x411dd0ee4d2d2939 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521526.086758:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fef457f2c00/0x411dd0ee4d2d2939 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521526.086765:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fef457f2c00/0x411dd0ee4d2d2939 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521526.086780:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef457f2c00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:3.0:1788521526.086785:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fef457f2c00/0x411dd0ee4d2d2939 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521526.086792:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fef457f2c00/0x411dd0ee4d2d2939 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521526.086810:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fef457f2c00/0x411dd0ee4d2d2939 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521526.086820:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521526.086857:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef752b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+20:3646:x1875400222526336:12345-0@lo:103:ldlm_bl.0 Request processed in 212us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521526.086864:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788521526.086985:0:20224:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fef457f2c00/0x411dd0ee4d2d2939 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521526.086993:0:20224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fef457f2c00/0x411dd0ee4d2d2939 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521526.087000:0:20224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fef457f2c00/0x411dd0ee4d2d2939 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521526.088150:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3646:1875400222526336:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521526.091652:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521526.091662:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521526.091666:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788521526.095661:0:17953:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788521526.413243:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788521526.414976:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4321c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222526464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788521526.415105:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521526.415855:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222526464 00000100:00100000:1.0:1788521526.415867:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222526464 00000100:00100000:1.0:1788521526.416028:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788521526.416041:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222526464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788521526.416099:0:17940:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788521526.416180:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222526464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521526.416187:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788521526.416239:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4321c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222526464:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788521526.733125:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521527.437150:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef752b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3644:1875400222526592:0@lo:400:kworker.0 00000100:00100000:0.0:1788521527.437197:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222526720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788521527.437944:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef752b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222526848:0@lo:400:kworker.0 00000100:00100000:0.0:1788521527.439716:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521527.439803:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef752b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222527232:0@lo:400:kworker.0 00000100:00100000:2.0:1788521527.439807:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222526720 00000100:00100000:2.0:1788521527.439817:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222526720 00000100:00100000:2.0:1788521527.439918:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788521527.439949:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222526720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788521527.439992:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788521527.442018:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875400222526720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2061us (2300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521527.442033:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1788521527.442096:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521527.444591:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef752b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222526976:0@lo:400:kworker.0 00000100:00100000:2.0:1788521527.444720:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521527.444776:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef752b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222527488:0@lo:400:kworker.0 00000100:00100000:2.0:1788521527.444800:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521527.444823:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef752b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222528000:0@lo:400:kworker.0 00000100:00100000:2.0:1788521527.444847:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521527.444878:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788521527.444910:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef752b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222527104:0@lo:400:kworker.0 00000100:00100000:2.0:1788521527.444934:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521527.444953:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef752b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222527616:0@lo:400:kworker.0 00000100:00100000:2.0:1788521527.444974:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521527.444991:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef752b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222528128:0@lo:400:kworker.0 00000100:00100000:2.0:1788521527.445012:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521527.445054:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222528000 00000100:00100000:2.0:1788521527.445063:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222528000 00000100:00100000:2.0:1788521527.445137:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222528128 00000100:00100000:2.0:1788521527.445140:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222528128 00000100:00100000:2.0:1788521527.445168:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788521527.445178:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef75280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222528000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521527.445240:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef75280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222528000:12345-0@lo:400:kworker.0 Request processed in 64us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521527.445255:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788521527.445275:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788521527.445281:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef75282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222528128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521527.445311:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef75282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875400222528128:12345-0@lo:400:kworker.0 Request processed in 31us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521527.445317:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788521527.445337:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222526976 00000100:00100000:2.0:1788521527.445340:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222526976 00000100:00100000:2.0:1788521527.445360:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222527488 00000100:00100000:2.0:1788521527.445364:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222527488 00000100:00100000:2.0:1788521527.445378:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222527104 00000100:00100000:2.0:1788521527.445380:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222527104 00000100:00100000:2.0:1788521527.445403:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222527616 00000100:00100000:2.0:1788521527.445406:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222527616 00000100:00100000:2.0:1788521527.445419:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788521527.445425:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef75281500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222526976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521527.445459:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef75281500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222526976:12345-0@lo:400:kworker.0 Request processed in 34us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521527.445465:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788521527.445477:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788521527.445483:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef75282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222527488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521527.445506:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef75282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222527488:12345-0@lo:400:kworker.0 Request processed in 25us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521527.445512:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788521527.445522:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788521527.445528:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef75282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222527104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521527.445564:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef75282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222527104:12345-0@lo:400:kworker.0 Request processed in 37us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521527.445570:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788521527.445581:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788521527.445586:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef75280700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222527616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521527.445611:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef75280700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222527616:12345-0@lo:400:kworker.0 Request processed in 25us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521527.445617:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1788521527.445645:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521527.445649:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788521527.445652:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788521527.445654:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788521527.445687:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef752b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222527104:0@lo:400:kworker.0 00000100:00100000:2.0:1788521527.445696:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef752b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222527616:0@lo:400:kworker.0 00000100:00100000:2.0:1788521527.445705:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef752b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3643:1875400222528128:0@lo:400:kworker.0 00000100:00100000:2.0:1788521527.445714:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef752b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222526976:0@lo:400:kworker.0 00000100:00100000:2.0:1788521527.445723:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef752b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222527488:0@lo:400:kworker.0 00010000:00080000:2.0:1788521527.445735:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef752b0a80 x1875400222528000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521527.445745:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef752b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222528000:0@lo:400:kworker.0 00000100:00100000:3.0:1788521527.445933:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521527.447726:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222526592 00000100:00100000:2.0:1788521527.447745:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222526592 00000100:00100000:2.0:1788521527.447817:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788521527.447828:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+20:3644:x1875400222526592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521527.447982:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+20:3644:x1875400222526592:12345-0@lo:400:kworker.0 Request processed in 156us (2049us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521527.447990:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788521527.448059:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef752b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3644:1875400222526592:0@lo:400:kworker.0 00000100:00100000:0.0:1788521527.448215:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521527.448262:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521527.448326:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222527232 00000100:00100000:2.0:1788521527.448331:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222527232 00000100:00100000:2.0:1788521527.448363:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788521527.448370:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222527232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521527.448383:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef752b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222527360:0@lo:400:kworker.0 00000100:00100000:2.0:1788521527.448468:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222527232:12345-0@lo:400:kworker.0 Request processed in 98us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521527.448475:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788521527.448521:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222526848 00000100:00100000:3.0:1788521527.448526:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222526848 00000100:00100000:1.0:1788521527.448527:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521527.448615:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222527360 00000100:00100000:3.0:1788521527.448618:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222527360 00000100:00100000:3.0:1788521527.448635:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788521527.448642:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222526848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521527.448682:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222526848:12345-0@lo:400:kworker.0 Request processed in 41us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521527.448688:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788521527.448701:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788521527.448706:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222527360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521527.448744:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222527360:12345-0@lo:400:kworker.0 Request processed in 38us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521527.448752:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788521527.448796:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef752b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222527232:0@lo:400:kworker.0 00000100:00100000:0.0:1788521527.448817:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef752b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222527744:0@lo:400:kworker.0 00000100:00100000:0.0:1788521527.448843:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521527.448868:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222527744 00000100:00100000:0.0:1788521527.448871:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222527744 00000100:00100000:0.0:1788521527.448925:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788521527.448932:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222527744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521527.449065:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef752b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875400222527872:0@lo:400:kworker.0 00000100:00100000:2.0:1788521527.449117:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef752b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222528256:0@lo:400:kworker.0 00000100:00100000:1.0:1788521527.449209:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521527.449254:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222527872 00000100:00100000:3.0:1788521527.449257:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222527872 00000100:00100000:1.0:1788521527.449296:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4244c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222528384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521527.449297:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222527744:12345-0@lo:400:kworker.0 Request processed in 362us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521527.449332:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788521527.449339:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875400222527872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521527.449369:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875400222527872:12345-0@lo:400:kworker.0 Request processed in 30us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521527.449376:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788521527.449402:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521527.449443:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3645:1875400222526720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788521527.449475:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef752b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222527744:0@lo:400:kworker.0 00000100:00100000:0.0:1788521527.449529:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788521527.449543:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222528256 00000100:00100000:0.0:1788521527.449547:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222528256 00000100:00080000:2.0:1788521527.449560:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788521527.449566:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521527.449582:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788521527.449590:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222528256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521527.449629:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222528256:12345-0@lo:400:kworker.0 Request processed in 39us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521527.449636:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1788521527.449649:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fef752b2a00 x1875400222528256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521527.449662:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef752b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222528256:0@lo:400:kworker.0 00000100:00100000:1.0:1788521527.449785:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521527.449955:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef752b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222526848:0@lo:400:kworker.0 00000100:00100000:1.0:1788521527.449966:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef752b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222527360:0@lo:400:kworker.0 00000100:00100000:1.0:1788521527.449974:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef752b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875400222527872:0@lo:400:kworker.0 00000100:00100000:2.0:1788521527.450101:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222528384 00000100:00100000:2.0:1788521527.450106:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222528384 00000100:00100000:2.0:1788521527.450174:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788521527.450182:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222528384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788521527.450214:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788521527.450255:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222528384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521527.450261:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788521527.450327:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4244c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222528384:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1788521527.501110:0:17196:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788521527.501121:0:17196:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fef7a3bc000 from 13 10000000:01000000:1.0:1788521527.501128:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788521527.501190:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef821dd600/0x411dd0ee4d2d2940 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521527.501205:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef821dd600/0x411dd0ee4d2d2940 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521527.501224:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef821dd600/0x411dd0ee4d2d2940 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521527.501268:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4321c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222528512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788521527.501354:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521527.501416:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef5240f240 going to sleep for 11 seconds 00000100:00100000:0.0:1788521527.501477:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222528512 00000100:00100000:0.0:1788521527.501487:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222528512 00000100:00100000:0.0:1788521527.501553:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788521527.501564:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+20:17196:x1875400222528512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521527.501581:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521527.501599:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fee42411600/0x411dd0ee4d2d2947 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d2940 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521527.501627:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fee42411600/0x411dd0ee4d2d2947 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2940 expref: 21 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521527.501640:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fee42411600/0x411dd0ee4d2d2947 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d2940 expref: 21 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521527.501651:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411600, rc 0) 00000100:00100000:0.0:1788521527.501701:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:17196:x1875400222528512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521527.501708:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788521527.502088:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4321c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222528512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521527.502107:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef821dd600/0x411dd0ee4d2d2940 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2947 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521527.502117:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef821dd600/0x411dd0ee4d2d2940 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d2947 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521527.502191:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4321c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222528640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521527.502225:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521527.502343:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef5240f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788521527.503999:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222528640 00000100:00100000:3.0:1788521527.504016:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222528640 00000100:00100000:0.0:1788521527.504234:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788521527.504332:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:17196:x1875400222528640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521527.505716:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:17196:x1875400222528640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1381us (3481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521527.505730:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788521527.506043:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4321c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222528640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521527.506128:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222528768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521527.506188:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521527.506235:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee410b39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521527.506336:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222528768 00000100:00100000:0.0:1788521527.506344:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222528768 00000100:00100000:0.0:1788521527.506720:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788521527.506733:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:17196:x1875400222528768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521527.507506:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:17196:x1875400222528768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 770us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521527.507516:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788521527.507710:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222528768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788521527.509112:0:20294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788521527.509768:0:17196:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788521527.509801:0:17196:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788521527.509815:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef821dd600/0x411dd0ee4d2d2940 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2947 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521527.509828:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef821dd600/0x411dd0ee4d2d2940 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2947 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521527.509979:0:17196:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788521527.509982:0:17196:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fef4e7ac800 from 13 10000000:01000000:1.0:1788521527.509985:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788521527.510038:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef821dde00/0x411dd0ee4d2d294e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521527.510047:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef821dde00/0x411dd0ee4d2d294e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521527.510060:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef821dde00/0x411dd0ee4d2d294e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521527.510131:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4321ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222528896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788521527.510217:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521527.510366:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef5240f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521527.510474:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222528896 00000100:00100000:3.0:1788521527.510484:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222528896 00000100:00100000:3.0:1788521527.510585:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788521527.510596:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+21:17196:x1875400222528896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521527.510628:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521527.510645:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef6d7b6a00/0x411dd0ee4d2d2955 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d294e expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521527.510675:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef6d7b6a00/0x411dd0ee4d2d2955 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d294e expref: 22 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521527.510686:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef6d7b6a00/0x411dd0ee4d2d2955 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d294e expref: 22 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521527.510696:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b6a00, rc 0) 00000100:00100000:3.0:1788521527.510796:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+22:17196:x1875400222528896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 202us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521527.510803:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788521527.510995:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4321ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222528896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521527.511012:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef821dde00/0x411dd0ee4d2d294e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2955 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521527.511021:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef821dde00/0x411dd0ee4d2d294e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d2955 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521527.511119:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222529024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521527.511152:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521527.511285:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef71d5bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521527.511396:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222529024 00000100:00100000:1.0:1788521527.511402:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222529024 00000100:00100000:1.0:1788521527.511427:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788521527.511434:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+22:17196:x1875400222529024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521527.511593:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+22:17196:x1875400222529024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521527.511601:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788521527.511785:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222529024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521527.511817:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222529152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521527.512068:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521527.512135:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef71d5bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521527.512169:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222529152 00000100:00100000:1.0:1788521527.512174:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222529152 00000100:00100000:1.0:1788521527.512232:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788521527.512299:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+22:17196:x1875400222529152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521527.512490:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+22:17196:x1875400222529152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 250us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521527.512497:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788521527.512641:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222529152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788521527.519772:0:20295:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788521527.519982:0:17196:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788521527.520015:0:17196:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788521527.520030:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef821dde00/0x411dd0ee4d2d294e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2955 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521527.520055:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef821dde00/0x411dd0ee4d2d294e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2955 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521527.520067:0:17196:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788521527.520081:0:17196:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fef7a3b2800 from 13 10000000:01000000:0.0:1788521527.520085:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788521527.520317:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee42411a00/0x411dd0ee4d2d295c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521527.520327:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fee42411a00/0x411dd0ee4d2d295c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521527.520339:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fee42411a00/0x411dd0ee4d2d295c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521527.520371:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222529280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788521527.520463:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521527.520521:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef71d5bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521527.524343:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222529280 00000100:00100000:3.0:1788521527.524363:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222529280 00000100:00100000:3.0:1788521527.524450:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788521527.524462:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+22:17196:x1875400222529280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521527.524483:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521527.524507:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef6d7b6e00/0x411dd0ee4d2d2963 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d295c expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521527.524542:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef6d7b6e00/0x411dd0ee4d2d2963 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d295c expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521527.524555:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef6d7b6e00/0x411dd0ee4d2d2963 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d295c expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521527.524592:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b6e00, rc 0) 00000100:00100000:3.0:1788521527.524748:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+23:17196:x1875400222529280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 288us (4284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521527.524755:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788521527.526050:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222529280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521527.526092:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fee42411a00/0x411dd0ee4d2d295c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2963 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521527.526107:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fee42411a00/0x411dd0ee4d2d295c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d2963 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521527.526214:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222529408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521527.526333:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521527.526434:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef71d5bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521527.526818:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222529408 00000100:00100000:1.0:1788521527.526827:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222529408 00000100:00100000:1.0:1788521527.527919:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788521527.527933:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+23:17196:x1875400222529408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521527.528336:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+23:17196:x1875400222529408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 406us (2002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521527.528346:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788521527.528440:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222529408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521527.528505:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef7f0e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222529536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521527.528574:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521527.528650:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222529536 00000100:00100000:1.0:1788521527.528657:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222529536 00000100:00100000:1.0:1788521527.528692:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788521527.528701:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+23:17196:x1875400222529536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521527.528778:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef71d5bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521527.528781:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+23:17196:x1875400222529536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521527.528788:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788521527.528789:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef7f0e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222529536:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788521527.531492:0:20296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788521527.531824:0:17196:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788521527.531859:0:17196:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788521527.531874:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fee42411a00/0x411dd0ee4d2d295c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2963 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521527.531908:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fee42411a00/0x411dd0ee4d2d295c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2963 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521527.531920:0:17196:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788521527.531924:0:17196:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fef48513800 from 13 10000000:01000000:3.0:1788521527.531927:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788521527.531977:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6c00/0x411dd0ee4d2d296a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521527.531986:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6c00/0x411dd0ee4d2d296a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521527.531998:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6c00/0x411dd0ee4d2d296a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521527.532029:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222529664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788521527.532120:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521527.532179:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee410b36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521527.532245:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222529664 00000100:00100000:0.0:1788521527.532255:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222529664 00000100:00100000:0.0:1788521527.532314:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788521527.532326:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+23:17196:x1875400222529664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521527.532343:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521527.532359:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fee42410c00/0x411dd0ee4d2d2971 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x411dd0ee4d2d296a expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521527.532388:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fee42410c00/0x411dd0ee4d2d2971 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x411dd0ee4d2d296a expref: 24 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521527.532400:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fee42410c00/0x411dd0ee4d2d2971 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x411dd0ee4d2d296a expref: 24 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521527.532410:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42410c00, rc 0) 00000100:00100000:0.0:1788521527.532453:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:17196:x1875400222529664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521527.532460:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788521527.532495:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222529664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521527.532530:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6c00/0x411dd0ee4d2d296a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2971 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521527.532540:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6c00/0x411dd0ee4d2d296a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x411dd0ee4d2d2971 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521527.532615:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222529792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521527.532644:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521527.532665:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee410b36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521527.533093:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222529792 00000100:00100000:0.0:1788521527.533099:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222529792 00000100:00100000:0.0:1788521527.533128:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788521527.533134:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:17196:x1875400222529792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521527.533276:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:17196:x1875400222529792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521527.533284:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788521527.534566:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222529792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521527.534979:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43c65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222529920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521527.535068:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521527.535493:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee410b36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521527.538523:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222529920 00000100:00100000:0.0:1788521527.538542:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222529920 00000100:00100000:0.0:1788521527.538627:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788521527.538638:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:17196:x1875400222529920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521527.540932:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:17196:x1875400222529920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2285us (5852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521527.540949:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788521527.541442:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43c65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:17196:1875400222529920:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788521527.547394:0:20298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788521527.547870:0:17196:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788521527.547999:0:17196:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788521527.548014:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6c00/0x411dd0ee4d2d296a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2971 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521527.548027:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.141@tcp lock: ffff8fef6d7b6c00/0x411dd0ee4d2d296a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x411dd0ee4d2d2971 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521527.759381:0:20227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521527.784332:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521527.789001:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201466240 00000100:00100000:2.0:1788521527.789014:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201466240 00000100:00100000:2.0:1788521527.789084:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 159 00000100:00100000:2.0:1788521527.789095:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+11:14947:x1875400201466240:12345-192.168.203.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521527.789112:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521527.789129:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef457f2200/0x411dd0ee4d2d2978 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x64dd99be98eeda85 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521527.789969:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef457f2200/0x411dd0ee4d2d2978 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda85 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521527.789984:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef457f2200/0x411dd0ee4d2d2978 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda85 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521527.789992:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef457f2200, rc 0) 00000100:00100000:2.0:1788521527.790056:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+12:14947:x1875400201466240:12345-192.168.203.41@tcp:101:ll_cfg_requeue.0 Request processed in 961us (5995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521527.790063:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 159 00000100:00100000:3.0:1788521527.794023:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521527.794101:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201466368 00000100:00100000:1.0:1788521527.794110:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201466368 00000100:00100000:1.0:1788521527.794177:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 160 00000100:00100000:1.0:1788521527.794187:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+12:14947:x1875400201466368:12345-192.168.203.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521527.794327:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+12:14947:x1875400201466368:12345-192.168.203.41@tcp:501:ll_cfg_requeue.0 Request processed in 140us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521527.794335:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 160 00000100:00100000:1.0:1788521527.806982:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521527.807020:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201466496 00000100:00100000:1.0:1788521527.807028:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201466496 00000100:00100000:1.0:1788521527.807086:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 161 00000100:00100000:1.0:1788521527.807096:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+12:14947:x1875400201466496:12345-192.168.203.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521527.807244:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+12:14947:x1875400201466496:12345-192.168.203.41@tcp:503:ll_cfg_requeue.0 Request processed in 148us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521527.807252:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 161 00000100:00100000:3.0:1788521527.817043:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521527.817727:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201466624 00000100:00100000:2.0:1788521527.817738:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201466624 00000100:00100000:2.0:1788521527.817791:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 162 00000100:00100000:2.0:1788521527.817800:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+12:14947:x1875400201466624:12345-192.168.203.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521527.817815:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521527.817833:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fef457f3200/0x411dd0ee4d2d297f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x64dd99be98eeda8c expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521527.817878:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fef457f3200/0x411dd0ee4d2d297f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda8c expref: 13 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521527.817911:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fef457f3200/0x411dd0ee4d2d297f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda8c expref: 13 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521527.817920:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef457f3200, rc 0) 00000100:00100000:2.0:1788521527.817979:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+13:14947:x1875400201466624:12345-192.168.203.41@tcp:101:ll_cfg_requeue.0 Request processed in 179us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521527.817985:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 162 00000100:00100000:1.0:1788521527.820752:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521527.820834:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201466752 00000100:00100000:2.0:1788521527.820843:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201466752 00000100:00100000:2.0:1788521527.821080:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 163 00000100:00100000:2.0:1788521527.821091:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+13:14947:x1875400201466752:12345-192.168.203.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521527.821241:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+13:14947:x1875400201466752:12345-192.168.203.41@tcp:501:ll_cfg_requeue.0 Request processed in 152us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521527.821250:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 163 00000100:00100000:3.0:1788521527.823141:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521527.829710:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201466880 00000100:00100000:1.0:1788521527.829733:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201466880 00000100:00100000:1.0:1788521527.829822:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 164 00000100:00100000:1.0:1788521527.829847:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+13:14947:x1875400201466880:12345-192.168.203.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521527.830079:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+13:14947:x1875400201466880:12345-192.168.203.41@tcp:503:ll_cfg_requeue.0 Request processed in 237us (6941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521527.830087:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 164 00010000:00010000:3.0:1788521528.783137:0:20226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521528.937529:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521528.937589:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521528.937626:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521528.937987:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201467008 00000100:00100000:1.0:1788521528.938001:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201467008 00000100:00100000:3.0:1788521528.938049:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521528.938075:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 165 00000100:00100000:3.0:1788521528.938093:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521528.938105:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+13:2393:x1875400201467008:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521528.938111:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521528.938128:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521528.938148:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521528.938218:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201467136 00000100:00100000:2.0:1788521528.938223:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201467136 00000100:00100000:2.0:1788521528.938262:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201467264 00000100:00100000:2.0:1788521528.938265:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201467264 00000100:00100000:2.0:1788521528.938277:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201467776 00000100:00100000:2.0:1788521528.938279:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201467776 00000100:00100000:2.0:1788521528.938290:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201467648 00000100:00100000:2.0:1788521528.938292:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201467648 00000100:00100000:2.0:1788521528.938304:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 54 00000100:00100000:2.0:1788521528.938310:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+6:2394:x1875400201467136:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521528.938424:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+13:2393:x1875400201467008:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 320us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521528.938432:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 165 00000100:00100000:3.0:1788521528.938468:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00080000:1.0:1788521528.938493:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788521528.938498:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521528.938509:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201467520 00000100:00100000:1.0:1788521528.938513:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201467520 00000100:00100000:1.0:1788521528.938539:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201468032 00000100:00100000:1.0:1788521528.938542:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201468032 00000100:00100000:1.0:1788521528.938555:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201467392 00000100:00100000:1.0:1788521528.938557:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201467392 00000100:00100000:1.0:1788521528.938569:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201467904 00000100:00100000:1.0:1788521528.938571:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201467904 00000100:00100000:1.0:1788521528.938585:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 20 00000100:00100000:1.0:1788521528.938592:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef46bfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+5:2393:x1875400201467520:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521528.938622:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef46bfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+5:2393:x1875400201467520:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 31us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521528.938630:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 20 00000100:00100000:0.0:1788521528.938707:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 55 00000100:00100000:0.0:1788521528.938717:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+5:2393:x1875400201467264:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521528.938748:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+5:2393:x1875400201467264:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 34us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521528.938754:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 55 00000100:00100000:1.0:1788521528.938769:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 21 00000100:00100000:0.0:1788521528.938769:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 56 00000100:00100000:1.0:1788521528.938776:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+5:2393:x1875400201468032:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521528.938776:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+5:2393:x1875400201467776:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521528.939038:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+5:2393:x1875400201468032:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 260us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521528.939045:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 21 00000100:00100000:1.0:1788521528.939058:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 22 00000100:00100000:2.0:1788521528.939232:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+6:2394:x1875400201467136:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 920us (1716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521528.939241:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 54 00000100:00100000:2.0:1788521528.939256:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 57 00000100:00100000:2.0:1788521528.939264:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+6:2394:x1875400201467648:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521528.939290:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+6:2394:x1875400201467648:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 28us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521528.939296:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 57 00000100:00100000:0.0:1788521528.940311:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+5:2393:x1875400201467776:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 1524us (2205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521528.940323:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 56 00000100:00100000:1.0:1788521528.940558:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+5:2394:x1875400201467392:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521528.940620:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+5:2394:x1875400201467392:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 71us (2490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521528.944605:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 23 00000100:00100000:2.0:1788521528.944644:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+5:2394:x1875400201467904:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521528.944757:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+5:2394:x1875400201467904:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 135us (6288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521528.944766:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 23 00000100:00080000:2.0:1788521528.945068:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788521528.945076:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788521528.962598:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 22 00000100:00100000:3.0:1788521529.400225:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521529.400432:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201468160 00000100:00100000:2.0:1788521529.400457:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201468160 00000100:00100000:2.0:1788521529.400536:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 23 00000100:00100000:2.0:1788521529.400550:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+6:15615:x1875400201468160:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521529.400574:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521529.400604:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2400/0x411dd0ee4d2d2986 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eeda93 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.400687:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3e00/0x411dd0ee4d2d298d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.400716:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3e00/0x411dd0ee4d2d298d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.400738:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3e00/0x411dd0ee4d2d298d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.400757:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2e00/0x411dd0ee4d2d2994 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.400764:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2e00/0x411dd0ee4d2d2994 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.400770:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2e00/0x411dd0ee4d2d2994 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.404867:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2c00/0x411dd0ee4d2d299b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.404909:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2c00/0x411dd0ee4d2d299b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.404926:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2c00/0x411dd0ee4d2d299b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521529.405005:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788521529.405009:0:17199:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788521529.405075:0:17199:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2c00/0x411dd0ee4d2d299b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.405089:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3e00/0x411dd0ee4d2d298d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.405117:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3e00/0x411dd0ee4d2d298d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.405124:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3e00/0x411dd0ee4d2d298d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.405130:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef457f3e00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521529.405136:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3e00/0x411dd0ee4d2d298d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.405143:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3e00/0x411dd0ee4d2d298d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.405158:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef51db3d00) 00010000:00010000:2.0:1788521529.405162:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521529.405168:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3e00/0x411dd0ee4d2d298d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.405175:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3e00/0x411dd0ee4d2d298d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.405195:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2e00/0x411dd0ee4d2d2994 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.405200:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2e00/0x411dd0ee4d2d2994 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.405206:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2e00/0x411dd0ee4d2d2994 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.405211:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef457f2e00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521529.405220:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2e00/0x411dd0ee4d2d2994 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.405226:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2e00/0x411dd0ee4d2d2994 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.405235:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8fef44f4f300) 00010000:00010000:2.0:1788521529.405237:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521529.405240:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2e00/0x411dd0ee4d2d2994 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.405245:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2e00/0x411dd0ee4d2d2994 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.405301:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2400/0x411dd0ee4d2d2986 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda93 expref: 8 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.405315:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2c00/0x411dd0ee4d2d299b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda93 expref: 7 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.405322:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8fef44f4f100) 00010000:00010000:2.0:1788521529.405324:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788521529.405327:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef457f2c00, rc 0) 00000100:00100000:2.0:1788521529.405426:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+7:15615:x1875400201468160:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 4878us (5212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521529.405437:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 23 00000100:00100000:2.0:1788521529.412622:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521529.412922:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201468288 00000100:00100000:0.0:1788521529.412950:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201468288 00000100:00100000:0.0:1788521529.413082:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 5 00000100:00100000:0.0:1788521529.413096:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef75283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+7:15615:x1875400201468288:12345-192.168.203.41@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788521529.413202:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef75283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+7:15615:x1875400201468288:12345-192.168.203.41@tcp:900:lhsmtool_posix.0 Request processed in 109us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521529.413210:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 5 00000100:00100000:3.0:1788521529.417631:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521529.420332:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201468544 00000100:00100000:1.0:1788521529.420353:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201468544 00000100:00100000:1.0:1788521529.420593:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 24 00000100:00100000:1.0:1788521529.420607:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+7:15615:x1875400201468544:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788521529.420637:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521529.420666:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef821dd200/0x411dd0ee4d2d29a2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eeda9a expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.420770:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef821ddc00/0x411dd0ee4d2d29a9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.420789:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef821ddc00/0x411dd0ee4d2d29a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.420803:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef821ddc00/0x411dd0ee4d2d29a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.423213:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c95c00/0x411dd0ee4d2d29b0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.424395:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c95c00/0x411dd0ee4d2d29b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.424415:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c95c00/0x411dd0ee4d2d29b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.425017:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c94e00/0x411dd0ee4d2d29b7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.425040:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c94e00/0x411dd0ee4d2d29b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.425048:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c94e00/0x411dd0ee4d2d29b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521529.425070:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788521529.427210:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef821ddc00/0x411dd0ee4d2d29a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.427226:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef821ddc00/0x411dd0ee4d2d29a9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.427234:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef821ddc00/0x411dd0ee4d2d29a9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.427239:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef821ddc00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521529.427243:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef821ddc00/0x411dd0ee4d2d29a9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.427641:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef821ddc00/0x411dd0ee4d2d29a9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.427659:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8fef44f4f100) 00010000:00010000:1.0:1788521529.427662:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521529.427666:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef821ddc00/0x411dd0ee4d2d29a9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.427672:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef821ddc00/0x411dd0ee4d2d29a9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.427690:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c95c00/0x411dd0ee4d2d29b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.427713:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c95c00/0x411dd0ee4d2d29b0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.427719:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c95c00/0x411dd0ee4d2d29b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.427723:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef71c95c00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:1.0:1788521529.427726:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c95c00/0x411dd0ee4d2d29b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.427732:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c95c00/0x411dd0ee4d2d29b0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.427739:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8fef51db3800) 00010000:00010000:1.0:1788521529.427742:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521529.427744:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c95c00/0x411dd0ee4d2d29b0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.427750:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c95c00/0x411dd0ee4d2d29b0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.430189:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef821dd200/0x411dd0ee4d2d29a2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda9a expref: 10 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.430222:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c94e00/0x411dd0ee4d2d29b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda9a expref: 9 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.430231:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fef51db3e00) 00010000:00010000:1.0:1788521529.430234:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521529.430256:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef71c94e00, rc 0) 00000100:00100000:1.0:1788521529.430357:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+9:15615:x1875400201468544:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 9750us (12737us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788521529.430368:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 24 00000100:00100000:3.0:1788521529.443624:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521529.444088:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201468672 00000100:00100000:2.0:1788521529.444103:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201468672 00000100:00100000:2.0:1788521529.444233:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 25 00000100:00100000:2.0:1788521529.444265:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130bc563-236a-43ec-a1a1-1e1e641e5bc7+9:15615:x1875400201468672:12345-192.168.203.41@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788521529.444425:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130bc563-236a-43ec-a1a1-1e1e641e5bc7+9:15615:x1875400201468672:12345-192.168.203.41@tcp:59:lhsmtool_posix.0 Request processed in 163us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521529.444434:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 25 00000100:00100000:3.0:1788521529.459433:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521529.459812:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201468800 00000100:00100000:0.0:1788521529.459837:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201468800 00000100:00100000:0.0:1788521529.459943:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 26 00000100:00100000:0.0:1788521529.459956:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+5:15615:x1875400201468800:12345-192.168.203.41@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1788521529.467990:0:17200:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 7976us 00000100:00100000:3.0:1788521529.476320:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521529.476682:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201468928 00000100:00100000:0.0:1788521529.476695:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201468928 00000100:00100000:0.0:1788521529.476775:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 27 00000100:00100000:0.0:1788521529.476788:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+9:15621:x1875400201468928:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:0.0:1788521529.476828:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521529.476861:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410800/0x411dd0ee4d2d29c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eedaa1 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.476975:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d29cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.477017:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d29cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.477032:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d29cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.477065:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d29d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.477073:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d29d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.477081:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d29d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.477141:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d29cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.477149:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d29cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.477156:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d29cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.477161:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42411800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521529.477166:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d29cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.477174:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d29cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.477187:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef51db3d00) 00010000:00010000:0.0:1788521529.477196:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521529.477202:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d29cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.477209:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411800/0x411dd0ee4d2d29cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.477225:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d29d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.477231:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d29d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.477236:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d29d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.477241:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521529.477245:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d29d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.477250:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d29d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.477256:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8fef74b1b700) 00010000:00010000:0.0:1788521529.477258:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521529.477261:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d29d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.477266:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d29d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.477303:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410800/0x411dd0ee4d2d29c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedaa1 expref: 10 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.477320:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef51db3d00) 00010000:00010000:0.0:1788521529.477322:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521529.477327:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410800/0x411dd0ee4d2d29c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedaa1 expref: 10 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.477335:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42410800, rc 0) 00000100:00100000:0.0:1788521529.477412:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+9:15621:x1875400201468928:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 626us (1106us total) trans 0 rc 301/301 00000100:00100000:0.0:1788521529.477420:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 27 00000100:00100000:2.0:1788521529.489570:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521529.489757:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201469056 00000100:00100000:0.0:1788521529.489769:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201469056 00000100:00100000:3.0:1788521529.489911:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+5:15615:x1875400201468800:12345-192.168.203.41@tcp:59:lhsmtool_posix.0 Request processed in 29955us (30489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521529.489925:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 26 00000100:00100000:0.0:1788521529.490190:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 0 00000100:00100000:0.0:1788521529.490214:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef75281f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+9:15621:x1875400201469056:12345-192.168.203.41@tcp:700:lfs.0 00000100:00100000:0.0:1788521529.490298:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef75281f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+9:15621:x1875400201469056:12345-192.168.203.41@tcp:700:lfs.0 Request processed in 97us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521529.490306:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 0 00000100:00100000:3.0:1788521529.501440:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521529.507861:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201469312 00000100:00100000:2.0:1788521529.507936:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201469312 00000100:00100000:2.0:1788521529.508023:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 28 00000100:00100000:2.0:1788521529.508034:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+9:15621:x1875400201469312:12345-192.168.203.41@tcp:36:lfs.0 00010000:00010000:2.0:1788521529.508121:0:17201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521529.508156:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef821dda00/0x411dd0ee4d2d28f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda0e expref: 9 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.508184:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef51db3d00) 00010000:00010000:2.0:1788521529.508191:0:17201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788521529.508362:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d29da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.508381:0:17201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2932 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda7e expref: 5 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.508390:0:17201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d29da lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.508435:0:17201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2932 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda7e expref: 5 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.508461:0:17201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2932 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda7e expref: 5 pid: 17200 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521529.508478:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef44fc9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17201:1875400222530048:192.168.203.41@tcp:104: 00000100:00100000:3.0:1788521529.508605:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee410b3480 going to sleep for 11 seconds 00000100:00100000:2.0:1788521529.511722:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521529.511775:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef44fc9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17201:1875400222530048:192.168.203.41@tcp:104: 00000100:00100000:1.0:1788521529.511783:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201469440 00000100:00100000:1.0:1788521529.511791:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201469440 00010000:00010000:3.0:1788521529.511813:0:17201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d29da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.511837:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2932 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda7e expref: 6 pid: 17200 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521529.511876:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 15 00000100:00100000:1.0:1788521529.511919:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef75283800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+6:2396:x1875400201469440:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521529.511938:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521529.511947:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2932 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda7e expref: 6 pid: 17200 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.511961:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2932 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda7e expref: 6 pid: 17200 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.511988:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7800/0x411dd0ee4d2d2932 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eeda7e expref: 6 pid: 17200 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.512006:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef51db3d00) 00010000:00010000:1.0:1788521529.512011:0:17185:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d29da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.512022:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d29da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.512031:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d29da lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521529.512078:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788521529.512130:0:17201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d29da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.512138:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d29da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.512169:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d29e1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.512179:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d29e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.512188:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d29e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521529.515279:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef75283800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+5:2396:x1875400201469440:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 3374us (3553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521529.515297:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 15 00010000:00010000:0.0:1788521529.519542:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d29e8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.519567:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d29e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.519581:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d29e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788521529.519615:0:17201:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e3a3efcb reply state 000000003d102f14 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d29e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.519644:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d29e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.519651:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8fef74b1b700) 00010000:00010000:0.0:1788521529.519654:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788521529.519657:0:17201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788521529.519663:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788521529.519672:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d29da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.519678:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d29da lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.519684:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d29da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.519690:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7000 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521529.519694:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d29da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.519702:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d29da lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.519712:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef51db3d00) 00010000:00010000:0.0:1788521529.519714:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521529.519718:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d29da lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.519725:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7000/0x411dd0ee4d2d29da lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788521529.519758:0:17201:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e3a3efcb reply state 000000003d102f14 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d29e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.519767:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d29e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.519773:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8fef7656a500) 00010000:00010000:0.0:1788521529.519775:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788521529.519778:0:17201:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788521529.521283:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+10:15621:x1875400201469312:12345-192.168.203.41@tcp:36:lfs.0 Request processed in 13233us (19842us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788521529.521298:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 28 00000100:00100000:3.0:1788521529.635409:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521529.635628:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201469568 00000100:00100000:2.0:1788521529.635637:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201469568 00000100:00100000:2.0:1788521529.635723:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 29 00000100:00100000:2.0:1788521529.635733:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130bc563-236a-43ec-a1a1-1e1e641e5bc7+10:15630:x1875400201469568:12345-192.168.203.41@tcp:101:lctl.0 00010000:00010000:2.0:1788521529.635756:0:19535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521529.635777:0:19535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3e00/0x411dd0ee4d2d29ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eedaa8 expref: -99 pid: 19535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.635848:0:19535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3a00/0x411dd0ee4d2d29f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.635907:0:19535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3a00/0x411dd0ee4d2d29f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.635919:0:19535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3a00/0x411dd0ee4d2d29f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521529.635965:0:19535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788521529.635969:0:19535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788521529.636012:0:19535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3a00/0x411dd0ee4d2d29f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.636034:0:19535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3e00/0x411dd0ee4d2d29ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedaa8 expref: 12 pid: 19535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.636051:0:19535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3a00/0x411dd0ee4d2d29f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedaa8 expref: 11 pid: 19535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.636069:0:19535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef44f4f300) 00010000:00010000:2.0:1788521529.636072:0:19535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788521529.636075:0:19535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef457f3a00, rc 0) 00000100:00100000:2.0:1788521529.636132:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130bc563-236a-43ec-a1a1-1e1e641e5bc7+11:15630:x1875400201469568:12345-192.168.203.41@tcp:101:lctl.0 Request processed in 401us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521529.636139:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 29 00000100:00100000:0.0:1788521529.691473:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521529.691831:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201469696 00000100:00100000:2.0:1788521529.691846:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201469696 00000100:00100000:2.0:1788521529.691945:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 30 00000100:00100000:2.0:1788521529.691957:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+5:15631:x1875400201469696:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:2.0:1788521529.691983:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521529.692020:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3e00/0x411dd0ee4d2d29fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eedaaf expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.692113:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2e00/0x411dd0ee4d2d2a04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.692130:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2e00/0x411dd0ee4d2d2a04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.692144:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2e00/0x411dd0ee4d2d2a04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521529.693452:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788521529.693464:0:17199:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788521529.693644:0:17199:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2e00/0x411dd0ee4d2d2a04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.693697:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3e00/0x411dd0ee4d2d29fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedaaf expref: 7 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.693724:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2e00/0x411dd0ee4d2d2a04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedaaf expref: 6 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.693734:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef44f4f300) 00010000:00010000:2.0:1788521529.693737:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788521529.693741:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef457f2e00, rc 0) 00000100:00100000:2.0:1788521529.695185:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+6:15631:x1875400201469696:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 3219us (3715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521529.696904:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 30 00000100:00100000:0.0:1788521529.710149:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521529.710319:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201469824 00000100:00100000:3.0:1788521529.710332:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201469824 00000100:00100000:3.0:1788521529.710424:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 31 00000100:00100000:3.0:1788521529.710438:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+6:15631:x1875400201469824:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:3.0:1788521529.710465:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521529.710494:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d2a0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eedab6 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.710588:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2a12 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.710606:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2a12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.710648:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2a12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.710664:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d2a19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.710672:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d2a19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.710679:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d2a19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.710786:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2a20 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.710794:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2a20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.710801:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2a20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521529.710847:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788521529.710851:0:17200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788521529.710875:0:17200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2a20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.710944:0:17200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2a12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.710952:0:17200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2a12 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.710970:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2a12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.710977:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7200 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521529.710982:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2a12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.710992:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2a12 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.711007:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef44f4f300) 00010000:00010000:3.0:1788521529.711010:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521529.711016:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2a12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.711023:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2a12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.711038:0:17200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d2a19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.711044:0:17200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d2a19 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.711049:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d2a19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.711067:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7c00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521529.711070:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d2a19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.711088:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d2a19 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.711097:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8fef7656a500) 00010000:00010000:3.0:1788521529.711099:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521529.711102:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d2a19 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.711108:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d2a19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.711137:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d2a0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedab6 expref: 8 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.711151:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2a20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedab6 expref: 7 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.711159:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8fef74b1b700) 00010000:00010000:3.0:1788521529.711161:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788521529.711164:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7600, rc 0) 00000100:00100000:3.0:1788521529.712915:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+7:15631:x1875400201469824:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 2444us (2742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521529.712929:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 31 00000100:00100000:3.0:1788521529.715771:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521529.715918:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201469952 00000100:00100000:2.0:1788521529.715948:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201469952 00000100:00100000:2.0:1788521529.716005:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 6 00000100:00100000:2.0:1788521529.716017:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+5:15631:x1875400201469952:12345-192.168.203.41@tcp:900:lfs.0 00000100:00100000:2.0:1788521529.716128:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+5:15631:x1875400201469952:12345-192.168.203.41@tcp:900:lfs.0 Request processed in 113us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521529.716136:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 6 00000100:00100000:1.0:1788521529.730473:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521529.730649:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201470208 00000100:00100000:3.0:1788521529.730662:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201470208 00000100:00100000:3.0:1788521529.730739:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 32 00000100:00100000:3.0:1788521529.730752:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+7:15631:x1875400201470208:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:3.0:1788521529.730799:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521529.730837:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7400/0x411dd0ee4d2d2a27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eedabd expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521529.731013:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788521529.731157:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7400/0x411dd0ee4d2d2a27 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedabd expref: 9 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.731174:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef44f4f300) 00010000:00010000:3.0:1788521529.731177:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788521529.731183:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7400/0x411dd0ee4d2d2a27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedabd expref: 9 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.731332:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7400, rc 0) 00000100:00100000:3.0:1788521529.731419:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+8:15631:x1875400201470208:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 669us (960us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788521529.731428:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 32 00000100:00100000:3.0:1788521529.734450:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521529.734931:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201470464 00000100:00100000:2.0:1788521529.734945:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201470464 00000100:00100000:2.0:1788521529.735020:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 33 00000100:00100000:2.0:1788521529.735033:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+8:15631:x1875400201470464:12345-192.168.203.41@tcp:36:lfs.0 00010000:00010000:2.0:1788521529.735116:0:19535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521529.735151:0:19535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7600/0x411dd0ee4d2d2a20 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedab6 expref: 8 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.735175:0:19535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8fef74b1b700) 00010000:00010000:2.0:1788521529.735181:0:19535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521529.735333:0:19535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3e00/0x411dd0ee4d2d2a35 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.735351:0:19535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3e00/0x411dd0ee4d2d2a35 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.735362:0:19535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3e00/0x411dd0ee4d2d2a35 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788521529.735681:0:19535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2568083 reply state 000000005a53bbdd transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3e00/0x411dd0ee4d2d2a35 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.735696:0:19535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3e00/0x411dd0ee4d2d2a35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.735722:0:19535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8fef74b1b700) 00010000:00010000:2.0:1788521529.735725:0:19535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1788521529.735728:0:19535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788521529.735739:0:19535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788521529.736380:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+9:15631:x1875400201470464:12345-192.168.203.41@tcp:36:lfs.0 Request processed in 1336us (1945us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788521529.736391:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 33 00000100:00100000:0.0:1788521529.740234:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521529.740388:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201470720 00000100:00100000:3.0:1788521529.740401:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201470720 00000100:00100000:3.0:1788521529.740490:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 2 00000100:00100000:3.0:1788521529.740504:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+9:15631:x1875400201470720:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:3.0:1788521529.740794:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+10:15631:x1875400201470720:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 292us (574us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788521529.740803:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 2 00000100:00100000:1.0:1788521529.748705:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521529.748828:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201470976 00000100:00100000:3.0:1788521529.748860:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201470976 00000100:00100000:3.0:1788521529.750226:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 34 00000100:00100000:3.0:1788521529.750319:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+10:15631:x1875400201470976:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:3.0:1788521529.750354:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521529.750520:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7400/0x411dd0ee4d2d2a3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eedac4 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.751087:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d2a43 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.751108:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d2a43 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.751124:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d2a43 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.751357:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d2a4a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.751368:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d2a4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.751441:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d2a4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521529.754083:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788521529.754222:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d2a43 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.754235:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d2a43 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.754243:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d2a43 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.754250:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6000 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521529.754256:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d2a43 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.754265:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d2a43 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.754286:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef44f4f300) 00010000:00010000:2.0:1788521529.754289:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521529.754296:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d2a43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.754314:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6000/0x411dd0ee4d2d2a43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.754355:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d2a4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.754363:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d2a4a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.754369:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d2a4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.754374:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7c00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521529.754378:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d2a4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.754384:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d2a4a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.754393:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8fef7656a500) 00010000:00010000:2.0:1788521529.754396:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521529.754399:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d2a4a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.754405:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7c00/0x411dd0ee4d2d2a4a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.754475:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7400/0x411dd0ee4d2d2a3c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedac4 expref: 12 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.754487:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef44f4f300) 00010000:00010000:2.0:1788521529.754489:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521529.754500:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7400/0x411dd0ee4d2d2a3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedac4 expref: 12 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.754512:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7400, rc 0) 00000100:00100000:2.0:1788521529.754680:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+11:15631:x1875400201470976:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 4438us (5988us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788521529.754690:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 34 00000100:00100000:0.0:1788521529.766487:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521529.766545:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201471104 00000100:00100000:3.0:1788521529.766558:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201471104 00000100:00100000:3.0:1788521529.766708:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 35 00000100:00100000:3.0:1788521529.766721:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+11:15631:x1875400201471104:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:3.0:1788521529.766759:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521529.766808:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2a58 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eedacb expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.766994:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6200/0x411dd0ee4d2d2a5f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.767012:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6200/0x411dd0ee4d2d2a5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.767027:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6200/0x411dd0ee4d2d2a5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521529.767072:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788521529.767078:0:17200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788521529.767103:0:17200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6200/0x411dd0ee4d2d2a5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.767139:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2a58 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedacb expref: 13 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.767171:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6200/0x411dd0ee4d2d2a5f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedacb expref: 12 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.767183:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8fef74b1b700) 00010000:00010000:3.0:1788521529.767186:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788521529.767191:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b6200, rc 0) 00000100:00100000:3.0:1788521529.767286:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+12:15631:x1875400201471104:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 566us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521529.767295:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 35 00000100:00100000:0.0:1788521529.771343:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521529.771739:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201471232 00000100:00100000:3.0:1788521529.771776:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201471232 00000100:00100000:3.0:1788521529.771862:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 3 00000100:00100000:3.0:1788521529.771875:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+12:15631:x1875400201471232:12345-192.168.203.41@tcp:37:lfs.0 00000100:00100000:3.0:1788521529.787080:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+12:15631:x1875400201471232:12345-192.168.203.41@tcp:37:lfs.0 Request processed in 15178us (15723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521529.787100:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 3 00000100:00100000:1.0:1788521529.793053:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521529.793486:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201471488 00000100:00100000:3.0:1788521529.793500:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201471488 00000100:00100000:3.0:1788521529.793580:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 4 00000100:00100000:3.0:1788521529.793593:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7ab050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+12:15631:x1875400201471488:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:2.0:1788521529.796048:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7ab050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+13:15631:x1875400201471488:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 2441us (2994us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788521529.796085:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 4 00010000:00010000:0.0:1788521529.807642:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521529.848984:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521529.849193:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201471616 00000100:00100000:2.0:1788521529.849207:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201471616 00000100:00100000:2.0:1788521529.849290:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 36 00000100:00100000:2.0:1788521529.849302:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+11:15637:x1875400201471616:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:2.0:1788521529.849328:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521529.849355:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2400/0x411dd0ee4d2d2a66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eedad2 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.849443:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2a00/0x411dd0ee4d2d2a6d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.849460:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2a00/0x411dd0ee4d2d2a6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.849474:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2a00/0x411dd0ee4d2d2a6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.849487:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2600/0x411dd0ee4d2d2a74 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.849518:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2600/0x411dd0ee4d2d2a74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.849526:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2600/0x411dd0ee4d2d2a74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.849628:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3400/0x411dd0ee4d2d2a7b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.849638:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3400/0x411dd0ee4d2d2a7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.849645:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3400/0x411dd0ee4d2d2a7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521529.849687:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788521529.849691:0:17199:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788521529.849738:0:17199:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3400/0x411dd0ee4d2d2a7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.849753:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2a00/0x411dd0ee4d2d2a6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.849760:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2a00/0x411dd0ee4d2d2a6d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.849768:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2a00/0x411dd0ee4d2d2a6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.849774:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef457f2a00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521529.849780:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2a00/0x411dd0ee4d2d2a6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.849795:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2a00/0x411dd0ee4d2d2a6d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.849809:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef44f4f300) 00010000:00010000:2.0:1788521529.849812:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521529.849830:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2a00/0x411dd0ee4d2d2a6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.849837:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2a00/0x411dd0ee4d2d2a6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.849855:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2600/0x411dd0ee4d2d2a74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.849860:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2600/0x411dd0ee4d2d2a74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.849865:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2600/0x411dd0ee4d2d2a74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.849870:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef457f2600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521529.849873:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2600/0x411dd0ee4d2d2a74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.849879:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2600/0x411dd0ee4d2d2a74 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.849939:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8fef7656a500) 00010000:00010000:2.0:1788521529.849942:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521529.849945:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2600/0x411dd0ee4d2d2a74 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.849961:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2600/0x411dd0ee4d2d2a74 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.849993:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f2400/0x411dd0ee4d2d2a66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedad2 expref: 13 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.850007:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3400/0x411dd0ee4d2d2a7b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedad2 expref: 12 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.850015:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8fef74b1b700) 00010000:00010000:2.0:1788521529.850018:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788521529.850021:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef457f3400, rc 0) 00000100:00100000:2.0:1788521529.850120:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+12:15637:x1875400201471616:12345-192.168.203.41@tcp:101:bash.0 Request processed in 819us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521529.850128:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 36 00000100:00100000:1.0:1788521529.853999:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521529.854115:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201471744 00000100:00100000:2.0:1788521529.854129:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201471744 00000100:00100000:2.0:1788521529.854186:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 7 00000100:00100000:2.0:1788521529.854197:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+5:15637:x1875400201471744:12345-192.168.203.41@tcp:900:bash.0 00000100:00100000:2.0:1788521529.854305:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+5:15637:x1875400201471744:12345-192.168.203.41@tcp:900:bash.0 Request processed in 109us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521529.854313:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 7 00000100:00100000:0.0:1788521529.857357:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521529.857512:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201472000 00000100:00100000:2.0:1788521529.857525:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201472000 00000100:00100000:2.0:1788521529.857599:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 37 00000100:00100000:2.0:1788521529.857612:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130bc563-236a-43ec-a1a1-1e1e641e5bc7+12:15637:x1875400201472000:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:2.0:1788521529.857660:0:19535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521529.857689:0:19535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3000/0x411dd0ee4d2d2a82 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eedad9 expref: -99 pid: 19535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.857851:0:19535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2a89 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.857871:0:19535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6200/0x411dd0ee4d2d2a5f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedacb expref: 12 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.857915:0:19535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2a89 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.857958:0:19535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6200/0x411dd0ee4d2d2a5f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedacb expref: 12 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.857973:0:19535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6200/0x411dd0ee4d2d2a5f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedacb expref: 12 pid: 17200 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521529.857988:0:19535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef75282a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19535:1875400222530176:192.168.203.41@tcp:104: 00000100:00100000:2.0:1788521529.858098:0:19535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef50e2d240 going to sleep for 11 seconds 00000100:00100000:3.0:1788521529.866122:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521529.866271:0:19535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef75282a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19535:1875400222530176:192.168.203.41@tcp:104: 00010000:00010000:2.0:1788521529.866307:0:19535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2a89 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521529.866540:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201472128 00000100:00100000:0.0:1788521529.866549:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201472128 00010000:00010000:0.0:1788521529.866597:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6200/0x411dd0ee4d2d2a5f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedacb expref: 13 pid: 17200 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521529.866645:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 16 00000100:00100000:0.0:1788521529.866656:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+13:2395:x1875400201472128:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521529.866675:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521529.866683:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6200/0x411dd0ee4d2d2a5f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedacb expref: 13 pid: 17200 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.866718:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6200/0x411dd0ee4d2d2a5f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedacb expref: 13 pid: 17200 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.866746:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6200/0x411dd0ee4d2d2a5f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedacb expref: 13 pid: 17200 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.866764:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8fef74b1b700) 00010000:00010000:0.0:1788521529.866770:0:17186:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2a89 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.866783:0:17186:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2a89 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.866792:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2a89 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521529.866824:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521529.866954:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+12:2395:x1875400201472128:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 284us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521529.866963:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 16 00010000:00010000:2.0:1788521529.867035:0:19535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2a89 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.867043:0:19535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2a89 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.867098:0:19535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d2a90 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.867110:0:19535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d2a90 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.867118:0:19535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d2a90 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.867741:0:19535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030c00/0x411dd0ee4d2d2a97 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.867756:0:19535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030c00/0x411dd0ee4d2d2a97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.867764:0:19535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030c00/0x411dd0ee4d2d2a97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521529.867776:0:19535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788521529.867810:0:19535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2a89 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.867818:0:19535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2a89 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.867825:0:19535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2a89 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.867832:0:19535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40030800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521529.867836:0:19535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2a89 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.867857:0:19535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2a89 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.867869:0:19535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8fef74b1b700) 00010000:00010000:2.0:1788521529.867873:0:19535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521529.867878:0:19535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2a89 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.867935:0:19535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2a89 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788521529.867951:0:19535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000061feeec5 reply state 0000000069de327e transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d2a90 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.867964:0:19535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d2a90 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.867971:0:19535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8fef44f4ff00) 00010000:00010000:2.0:1788521529.867973:0:19535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788521529.867976:0:19535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788521529.868016:0:19535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3000/0x411dd0ee4d2d2a82 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedad9 expref: 15 pid: 19535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.868032:0:19535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030c00/0x411dd0ee4d2d2a97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedad9 expref: 14 pid: 19535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.868039:0:19535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fef44f4f500) 00010000:00010000:2.0:1788521529.868041:0:19535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788521529.868043:0:19535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef40030c00, rc 0) 00000100:00100000:2.0:1788521529.868107:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130bc563-236a-43ec-a1a1-1e1e641e5bc7+15:15637:x1875400201472000:12345-192.168.203.41@tcp:101:bash.0 Request processed in 10497us (10764us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788521529.868115:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 37 00000100:00100000:1.0:1788521529.879313:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521529.879429:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201472256 00000100:00100000:2.0:1788521529.879442:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201472256 00000100:00100000:2.0:1788521529.879515:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 38 00000100:00100000:2.0:1788521529.879526:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+15:15637:x1875400201472256:12345-192.168.203.41@tcp:101:bash.0 00010000:00010000:2.0:1788521529.879557:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521529.879586:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2aa5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eedae0 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.879682:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031a00/0x411dd0ee4d2d2aac lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.879699:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031a00/0x411dd0ee4d2d2aac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.879711:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031a00/0x411dd0ee4d2d2aac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521529.879775:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788521529.879780:0:17199:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788521529.879805:0:17199:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031a00/0x411dd0ee4d2d2aac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.880036:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031a00/0x411dd0ee4d2d2aac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.880084:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2aa5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedae0 expref: 17 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.880133:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031a00/0x411dd0ee4d2d2aac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedae0 expref: 16 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521529.880143:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fef44f4f500) 00010000:00010000:2.0:1788521529.880147:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521529.880151:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef40031a00, rc 0) 00000100:00100000:2.0:1788521529.880279:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+16:15637:x1875400201472256:12345-192.168.203.41@tcp:101:bash.0 Request processed in 753us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521529.880287:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 38 00000100:00100000:3.0:1788521529.883193:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521529.883852:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201472512 00000100:00100000:2.0:1788521529.883866:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201472512 00000100:00100000:2.0:1788521529.885306:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 5 00000100:00100000:2.0:1788521529.885336:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+16:15637:x1875400201472512:12345-192.168.203.41@tcp:35:bash.0 00000100:00100000:2.0:1788521529.885756:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+17:15637:x1875400201472512:12345-192.168.203.41@tcp:35:bash.0 Request processed in 434us (2576us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788521529.885765:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 5 00000100:00100000:2.0:1788521529.989220:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521529.989610:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201472768 00000100:00100000:3.0:1788521529.989624:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201472768 00000100:00100000:3.0:1788521529.989752:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 39 00000100:00100000:3.0:1788521529.989764:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef75282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+17:15647:x1875400201472768:12345-192.168.203.41@tcp:101:lfs.0 00010000:00010000:3.0:1788521529.989806:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521529.989944:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2ab3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eedae7 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521529.990089:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788521529.990294:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2ab3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedae7 expref: 19 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.990313:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fef44f4f300) 00010000:00010000:3.0:1788521529.990318:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788521529.990342:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2ab3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedae7 expref: 19 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521529.990360:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef6d7b7200, rc 0) 00000100:00100000:3.0:1788521529.990501:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef75282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+18:15647:x1875400201472768:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 738us (1295us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788521529.990509:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 39 00000100:00100000:1.0:1788521529.994581:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521529.994670:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201473024 00000100:00100000:2.0:1788521529.994683:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201473024 00000100:00100000:2.0:1788521529.994783:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 6 00000100:00100000:2.0:1788521529.994933:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+18:15647:x1875400201473024:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:2.0:1788521529.995292:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+19:15647:x1875400201473024:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 363us (725us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788521529.995301:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 6 00000100:00100000:0.0:1788521530.038804:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521530.039455:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201473280 00000100:00100000:1.0:1788521530.039469:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201473280 00000100:00100000:1.0:1788521530.039568:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 40 00000100:00100000:1.0:1788521530.039582:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7f0e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+19:15650:x1875400201473280:12345-192.168.203.41@tcp:101:lfs.0 00000100:00080000:2.0:1788521530.039658:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788521530.039741:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521530.039780:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c95600/0x411dd0ee4d2d2ac1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eedaee expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.040110:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c94200/0x411dd0ee4d2d2ac8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.040129:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c94200/0x411dd0ee4d2d2ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.040331:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c94200/0x411dd0ee4d2d2ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521530.040348:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788521530.040501:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c95600/0x411dd0ee4d2d2ac1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedaee expref: 22 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.040523:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c94200/0x411dd0ee4d2d2ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedaee expref: 21 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.040533:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fef44f4f500) 00010000:00010000:1.0:1788521530.040537:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521530.040541:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef71c94200, rc 0) 00000100:00100000:1.0:1788521530.040750:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7f0e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+21:15650:x1875400201473280:12345-192.168.203.41@tcp:101:lfs.0 Request processed in 1169us (1961us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788521530.040760:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 40 00000100:00100000:0.0:1788521530.047776:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521530.048938:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521530.049038:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201473408 00000100:00100000:3.0:1788521530.049050:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201473408 00000100:00100000:3.0:1788521530.049142:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 41 00000100:00100000:3.0:1788521530.049154:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130bc563-236a-43ec-a1a1-1e1e641e5bc7+21:15650:x1875400201473408:12345-192.168.203.41@tcp:54:lfs.0 00010000:00010000:3.0:1788521530.049253:0:19535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2ad6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.049274:0:19535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.049288:0:19535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.049339:0:19535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.049347:0:19535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2ad6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.049354:0:19535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2ad6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.049360:0:19535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7200 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521530.049365:0:19535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2ad6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.049383:0:19535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2ad6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.049399:0:19535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fef44f4f500) 00010000:00010000:3.0:1788521530.049402:0:19535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788521530.049408:0:19535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2ad6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.049415:0:19535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2ad6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521530.049508:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130bc563-236a-43ec-a1a1-1e1e641e5bc7+21:15650:x1875400201473408:12345-192.168.203.41@tcp:54:lfs.0 Request processed in 355us (1747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521530.049517:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 41 00000100:00100000:1.0:1788521530.050339:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201473536 00000100:00100000:1.0:1788521530.050352:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201473536 00000100:00100000:1.0:1788521530.050420:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 0 00000100:00100000:1.0:1788521530.050430:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef75221c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+21:2394:x1875400201473536:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521530.050445:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521530.050468:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c94200/0x411dd0ee4d2d2ac8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedaee expref: 21 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.050487:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fef44f4f500) 00010000:00010000:1.0:1788521530.050492:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521530.050580:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef75221c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+20:2394:x1875400201473536:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 150us (1648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521530.050588:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 0 00000100:00100000:3.0:1788521530.053193:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521530.053283:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201473792 00000100:00100000:2.0:1788521530.053293:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201473792 00000100:00100000:2.0:1788521530.053353:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 7 00000100:00100000:2.0:1788521530.053364:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+20:15650:x1875400201473792:12345-192.168.203.41@tcp:35:lfs.0 00000100:00100000:2.0:1788521530.053641:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+21:15650:x1875400201473792:12345-192.168.203.41@tcp:35:lfs.0 Request processed in 278us (460us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788521530.053649:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 7 00000040:00080000:3.0:1788521530.189621:0:17953:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788521530.319988:0:17234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788521530.358708:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521530.359061:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201474048 00000100:00100000:0.0:1788521530.359144:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201474048 00000100:00100000:0.0:1788521530.359291:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 42 00000100:00100000:0.0:1788521530.359305:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+21:15681:x1875400201474048:12345-192.168.203.41@tcp:101:cat.0 00010000:00010000:0.0:1788521530.359361:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521530.359389:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410200/0x411dd0ee4d2d2add lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eedaf5 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.359538:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411000/0x411dd0ee4d2d2ae4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.359555:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411000/0x411dd0ee4d2d2ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.359571:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411000/0x411dd0ee4d2d2ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521530.359585:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788521530.359738:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410200/0x411dd0ee4d2d2add lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedaf5 expref: 24 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.359762:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411000/0x411dd0ee4d2d2ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedaf5 expref: 23 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.359773:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fef44f4f500) 00010000:00010000:0.0:1788521530.359777:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788521530.359781:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411000, rc 0) 00000100:00100000:0.0:1788521530.360184:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+23:15681:x1875400201474048:12345-192.168.203.41@tcp:101:cat.0 Request processed in 880us (1483us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1788521530.360193:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 42 00000100:00100000:0.0:1788521530.365417:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521530.365520:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201474304 00000100:00100000:2.0:1788521530.365533:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201474304 00000100:00100000:2.0:1788521530.365609:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 8 00000100:00100000:2.0:1788521530.365622:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef75221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+23:15681:x1875400201474304:12345-192.168.203.41@tcp:35:cat.0 00000100:00100000:2.0:1788521530.366196:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef75221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+24:15681:x1875400201474304:12345-192.168.203.41@tcp:35:cat.0 Request processed in 574us (790us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788521530.366206:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 8 00000100:00100000:3.0:1788521530.367443:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521530.367661:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201474432 00000100:00100000:0.0:1788521530.367672:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201474432 00000100:00100000:0.0:1788521530.367776:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 1 00000100:00100000:0.0:1788521530.367789:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+24:2394:x1875400201474432:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521530.367808:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521530.367839:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411000/0x411dd0ee4d2d2ae4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedaf5 expref: 24 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.367862:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fef44f4f500) 00010000:00010000:0.0:1788521530.367868:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521530.367960:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+23:2394:x1875400201474432:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 175us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521530.367968:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 1 00000100:00100000:3.0:1788521530.447025:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521530.447214:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201474688 00000100:00100000:2.0:1788521530.447229:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201474688 00000100:00100000:2.0:1788521530.447309:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 43 00000100:00100000:2.0:1788521530.447320:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130bc563-236a-43ec-a1a1-1e1e641e5bc7+23:15687:x1875400201474688:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:2.0:1788521530.447353:0:19535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521530.447381:0:19535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2af2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eedafc expref: -99 pid: 19535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.447532:0:19535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030200/0x411dd0ee4d2d2af9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.447549:0:19535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030c00/0x411dd0ee4d2d2a97 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedad9 expref: 24 pid: 19535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.447575:0:19535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031a00/0x411dd0ee4d2d2aac lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedae0 expref: 24 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.447585:0:19535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030200/0x411dd0ee4d2d2af9 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.447629:0:19535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031a00/0x411dd0ee4d2d2aac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedae0 expref: 24 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.447645:0:19535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031a00/0x411dd0ee4d2d2aac lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedae0 expref: 24 pid: 17199 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521530.447661:0:19535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef75281c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19535:1875400222530304:192.168.203.41@tcp:104: 00010000:00010000:2.0:1788521530.447767:0:19535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030c00/0x411dd0ee4d2d2a97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedad9 expref: 24 pid: 19535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.447777:0:19535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030c00/0x411dd0ee4d2d2a97 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedad9 expref: 24 pid: 19535 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521530.447786:0:19535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef75281880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19535:1875400222530432:192.168.203.41@tcp:104: 00000100:00100000:2.0:1788521530.447826:0:19535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef50e2dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521530.465843:0:19535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef75281c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19535:1875400222530304:192.168.203.41@tcp:104: 00000100:00100000:3.0:1788521530.469835:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521530.470019:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521530.470137:0:19535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef75281880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19535:1875400222530432:192.168.203.41@tcp:104: 00010000:00010000:2.0:1788521530.470177:0:19535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030200/0x411dd0ee4d2d2af9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521530.478048:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201474816 00000100:00100000:1.0:1788521530.478083:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201474816 00010000:00010000:1.0:1788521530.478160:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031a00/0x411dd0ee4d2d2aac lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedae0 expref: 25 pid: 17199 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521530.478389:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201474944 00000100:00100000:1.0:1788521530.478394:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201474944 00010000:00010000:1.0:1788521530.478412:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030c00/0x411dd0ee4d2d2a97 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedad9 expref: 26 pid: 19535 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521530.478462:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 17 00000100:00100000:0.0:1788521530.478488:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+26:2395:x1875400201474816:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521530.478507:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521530.478517:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031a00/0x411dd0ee4d2d2aac lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedae0 expref: 26 pid: 17199 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.478596:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031a00/0x411dd0ee4d2d2aac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedae0 expref: 26 pid: 17199 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.478627:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031a00/0x411dd0ee4d2d2aac lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedae0 expref: 26 pid: 17199 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.478663:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fef44f4f500) 00010000:00010000:0.0:1788521530.478669:0:17186:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030200/0x411dd0ee4d2d2af9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.478710:0:17186:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030200/0x411dd0ee4d2d2af9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.478718:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521530.478811:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+25:2395:x1875400201474816:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 328us (8990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521530.478819:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 17 00000100:00100000:0.0:1788521530.478844:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 18 00000100:00100000:0.0:1788521530.478852:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7effe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+24:2396:x1875400201474944:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521530.478860:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521530.478866:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030c00/0x411dd0ee4d2d2a97 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedad9 expref: 24 pid: 19535 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.478876:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030c00/0x411dd0ee4d2d2a97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedad9 expref: 24 pid: 19535 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.478935:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030c00/0x411dd0ee4d2d2a97 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedad9 expref: 24 pid: 19535 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.478947:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fef44f4f500) 00010000:00010000:0.0:1788521530.478951:0:17186:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030200/0x411dd0ee4d2d2af9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.478959:0:17186:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030200/0x411dd0ee4d2d2af9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.478969:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030200/0x411dd0ee4d2d2af9 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.479010:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521530.479034:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7effe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+23:2396:x1875400201474944:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 183us (9015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521530.479042:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 18 00010000:00010000:1.0:1788521530.479393:0:19535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030200/0x411dd0ee4d2d2af9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.479403:0:19535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030200/0x411dd0ee4d2d2af9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521530.479428:0:19535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788521530.479801:0:19535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2af2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedafc expref: 24 pid: 19535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.479822:0:19535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030200/0x411dd0ee4d2d2af9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedafc expref: 23 pid: 19535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.479831:0:19535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fef44f4f500) 00010000:00010000:1.0:1788521530.479833:0:19535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788521530.479836:0:19535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef40030200, rc 0) 00000100:00100000:1.0:1788521530.479877:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130bc563-236a-43ec-a1a1-1e1e641e5bc7+23:15687:x1875400201474688:12345-192.168.203.41@tcp:101:dd.0 Request processed in 32560us (32868us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788521530.479932:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 43 00000100:00100000:1.0:1788521530.485860:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521530.485988:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201475072 00000100:00100000:2.0:1788521530.486000:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201475072 00000100:00100000:2.0:1788521530.486090:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 44 00000100:00100000:2.0:1788521530.486103:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+23:15687:x1875400201475072:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:2.0:1788521530.486134:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521530.486162:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030400/0x411dd0ee4d2d2b07 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eedb03 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.486207:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030600/0x411dd0ee4d2d2b0e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.486225:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030600/0x411dd0ee4d2d2b0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.486238:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030600/0x411dd0ee4d2d2b0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.486397:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030400/0x411dd0ee4d2d2b07 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb03 expref: 25 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.486420:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030600/0x411dd0ee4d2d2b0e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb03 expref: 24 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.486430:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fef44f4f500) 00010000:00010000:2.0:1788521530.486434:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788521530.486438:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef40030600, rc 0) 00000100:00100000:2.0:1788521530.486708:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+24:15687:x1875400201475072:12345-192.168.203.41@tcp:101:dd.0 Request processed in 606us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521530.486729:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 44 00000100:00100000:3.0:1788521530.495755:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521530.495932:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201475328 00000100:00100000:2.0:1788521530.495945:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201475328 00000100:00100000:2.0:1788521530.496017:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 45 00000100:00100000:2.0:1788521530.496028:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+24:15687:x1875400201475328:12345-192.168.203.41@tcp:36:dd.0 00010000:00010000:2.0:1788521530.496350:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030400/0x411dd0ee4d2d2b15 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.496374:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030400/0x411dd0ee4d2d2b15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.496389:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030400/0x411dd0ee4d2d2b15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521530.496444:0:17200:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788521530.496468:0:17200:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b108576a reply state 00000000a052106f transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030400/0x411dd0ee4d2d2b15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.496484:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030400/0x411dd0ee4d2d2b15 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.496492:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fef44f4f500) 00010000:00010000:2.0:1788521530.496495:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788521530.496500:0:17200:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788521530.496619:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+27:15687:x1875400201475328:12345-192.168.203.41@tcp:36:dd.0 Request processed in 591us (878us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788521530.496629:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 45 00000020:00080000:2.0:1788521530.496635:0:17200:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788521530.501199:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521530.501371:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201475456 00000100:00100000:0.0:1788521530.501385:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201475456 00000100:00100000:0.0:1788521530.501463:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 46 00000100:00100000:0.0:1788521530.501475:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+27:15687:x1875400201475456:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1788521530.501677:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521530.501709:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411200/0x411dd0ee4d2d2b1c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eedb0a expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.501787:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411200/0x411dd0ee4d2d2b1c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb0a expref: 28 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.501805:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411200/0x411dd0ee4d2d2b1c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb0a expref: 28 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.501946:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fef44f4f500) 00010000:00010000:0.0:1788521530.501951:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788521530.501955:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411200, rc 0) 00000100:00100000:0.0:1788521530.502038:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+28:15687:x1875400201475456:12345-192.168.203.41@tcp:101:dd.0 Request processed in 564us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521530.502046:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 46 00000100:00100000:1.0:1788521530.531637:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521530.532061:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201475712 00000100:00100000:0.0:1788521530.532074:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201475712 00000100:00100000:0.0:1788521530.532179:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 2 00000100:00100000:0.0:1788521530.532201:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+28:15687:x1875400201475712:12345-192.168.203.41@tcp:103:dd.0 00010000:00010000:0.0:1788521530.532222:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521530.532257:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411200/0x411dd0ee4d2d2b1c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb0a expref: 28 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.532280:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fef44f4f500) 00010000:00010000:0.0:1788521530.532286:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521530.532360:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+27:15687:x1875400201475712:12345-192.168.203.41@tcp:103:dd.0 Request processed in 172us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521530.532376:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 2 00000100:00100000:3.0:1788521530.536650:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521530.536835:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201475840 00000100:00100000:1.0:1788521530.536849:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201475840 00000100:00100000:1.0:1788521530.536969:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 47 00000100:00100000:1.0:1788521530.536982:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef44fc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130bc563-236a-43ec-a1a1-1e1e641e5bc7+27:15687:x1875400201475840:12345-192.168.203.41@tcp:58:dd.0 00010000:00010000:1.0:1788521530.537129:0:19535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c95600/0x411dd0ee4d2d2b23 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.537151:0:19535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c95600/0x411dd0ee4d2d2b23 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.537167:0:19535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c95600/0x411dd0ee4d2d2b23 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788521530.540236:0:19535:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788521530.548934:0:19535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788521530.549734:0:19535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788521530.549963:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef44fc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130bc563-236a-43ec-a1a1-1e1e641e5bc7+27:15687:x1875400201475840:12345-192.168.203.41@tcp:58:dd.0 Request processed in 12975us (13321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521530.549978:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 47 00000100:00100000:3.0:1788521530.558199:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521530.558306:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201475968 00000100:00100000:0.0:1788521530.558318:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201475968 00000100:00100000:0.0:1788521530.558395:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 48 00000100:00100000:0.0:1788521530.558407:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58340a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+27:15687:x1875400201475968:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:0.0:1788521530.558435:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521530.558463:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411200/0x411dd0ee4d2d2b2a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eedb11 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.558539:0:17199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c95600/0x411dd0ee4d2d2b23 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.558573:0:17199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411200/0x411dd0ee4d2d2b2a lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb11 expref: 28 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.558597:0:17199:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c95600/0x411dd0ee4d2d2b23 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.558613:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411200/0x411dd0ee4d2d2b2a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb11 expref: 28 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.558629:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fef44f4f500) 00010000:00010000:0.0:1788521530.558633:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788521530.558638:0:17199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411200/0x411dd0ee4d2d2b2a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb11 expref: 28 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.558646:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411200, rc 0) 00000100:00100000:0.0:1788521530.558728:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58340a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+28:15687:x1875400201475968:12345-192.168.203.41@tcp:101:dd.0 Request processed in 323us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521530.558736:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 48 00010000:00010000:2.0:1788521530.830177:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521531.022083:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788521531.022119:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef75221c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222530560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521531.022240:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521531.022310:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222530560 00000100:00100000:3.0:1788521531.022321:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222530560 00000100:00100000:3.0:1788521531.022408:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788521531.022422:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58341500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222530560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788521531.022460:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788521531.022525:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58341500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222530560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521531.022533:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788521531.022556:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521531.022612:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef75221c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222530560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788521531.022836:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788521531.022847:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4321ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222530816:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788521531.022912:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521531.023339:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222530816 00000100:00100000:3.0:1788521531.023348:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222530816 00000100:00100000:2.0:1788521531.023521:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521531.023548:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef75220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222530688:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788521531.023596:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521531.023644:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222530688 00000100:00100000:2.0:1788521531.023648:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222530688 00000100:00100000:2.0:1788521531.023688:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788521531.023697:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef75281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222530688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788521531.023717:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788521531.023758:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef75281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222530688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521531.023766:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788521531.023806:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521531.023849:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef75220e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222530688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788521531.023971:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788521531.023981:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222530816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788521531.024013:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788521531.024079:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222530816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521531.024086:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788521531.024844:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4321ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222530816:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788521531.342991:0:17234:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788521531.343004:0:17234:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788521531.343038:0:17234:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788521531.343061:0:17234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788521531.343242:0:17234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58342a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17234:1875400222530944:192.168.203.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788521531.343366:0:17234:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee410b3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521531.351332:0:17234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58342a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17234:1875400222530944:192.168.203.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788521531.356533:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521531.356766:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201476096 00000100:00100000:2.0:1788521531.356788:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201476096 00000100:00100000:2.0:1788521531.356878:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 49 00000100:00100000:2.0:1788521531.356921:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58342d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+28:15689:x1875400201476096:12345-192.168.203.41@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788521531.356967:0:17200:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788521531.357131:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58342d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+28:15689:x1875400201476096:12345-192.168.203.41@tcp:53:lhsmtool_posix.0 Request processed in 213us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521531.357140:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 49 00000100:00100000:3.0:1788521531.367638:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521531.367806:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201476224 00000100:00100000:2.0:1788521531.367828:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201476224 00000100:00100000:2.0:1788521531.367937:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 50 00000100:00100000:2.0:1788521531.367950:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58340380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+28:15689:x1875400201476224:12345-192.168.203.41@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788521531.368105:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2b31 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.368135:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2b31 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.368154:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2b31 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.368176:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031800/0x411dd0ee4d2d2b38 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.368184:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031800/0x411dd0ee4d2d2b38 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.368191:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031800/0x411dd0ee4d2d2b38 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.368224:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2b3f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.368233:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2b3f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.368240:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2b3f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521531.368303:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788521531.368308:0:17201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788521531.368325:0:17201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2b3f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.368338:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2b31 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.368354:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2b31 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.368372:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2b31 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.368379:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40031e00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521531.368384:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2b31 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.368393:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2b31 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.368408:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fef51db3e00) 00010000:00010000:2.0:1788521531.368411:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521531.368418:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2b31 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.368425:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2b31 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.368452:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031800/0x411dd0ee4d2d2b38 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.368458:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031800/0x411dd0ee4d2d2b38 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.368463:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031800/0x411dd0ee4d2d2b38 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.368479:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40031800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521531.368489:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031800/0x411dd0ee4d2d2b38 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.368496:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031800/0x411dd0ee4d2d2b38 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.368503:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8fef44f4f800) 00010000:00010000:2.0:1788521531.368506:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521531.368509:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031800/0x411dd0ee4d2d2b38 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.368514:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031800/0x411dd0ee4d2d2b38 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.368533:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2b3f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.368539:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2b3f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.368545:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2b3f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.368550:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40030800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:2.0:1788521531.368553:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2b3f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.368559:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2b3f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.368566:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fef44f4f500) 00010000:00010000:2.0:1788521531.368569:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521531.368578:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2b3f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.368585:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2b3f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521531.368685:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58340380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+28:15689:x1875400201476224:12345-192.168.203.41@tcp:34:lhsmtool_posix.0 Request processed in 736us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521531.368694:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 50 00000100:00100000:1.0:1788521531.371033:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521531.371424:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201476480 00000100:00100000:3.0:1788521531.371438:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201476480 00000100:00100000:0.0:1788521531.371804:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 51 00000100:00100000:0.0:1788521531.371826:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+28:15689:x1875400201476480:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788521531.371854:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521531.371880:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411400/0x411dd0ee4d2d2b46 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eedb18 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.372053:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411000/0x411dd0ee4d2d2b4d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.372093:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411000/0x411dd0ee4d2d2b4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.372106:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411000/0x411dd0ee4d2d2b4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521531.372122:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788521531.372233:0:17200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411000/0x411dd0ee4d2d2b4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.372242:0:17200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411000/0x411dd0ee4d2d2b4d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.372250:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411000/0x411dd0ee4d2d2b4d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.372257:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42411000 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521531.372263:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411000/0x411dd0ee4d2d2b4d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.372271:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411000/0x411dd0ee4d2d2b4d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.372287:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fef44f4f500) 00010000:00010000:0.0:1788521531.372290:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788521531.372296:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411000/0x411dd0ee4d2d2b4d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.372303:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411000/0x411dd0ee4d2d2b4d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.372363:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411400/0x411dd0ee4d2d2b46 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb18 expref: 30 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.372382:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fef51db3e00) 00010000:00010000:0.0:1788521531.372385:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788521531.372389:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411400/0x411dd0ee4d2d2b46 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb18 expref: 30 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.372400:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411400, rc 0) 00000100:00100000:0.0:1788521531.372793:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+29:15689:x1875400201476480:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 967us (1772us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1788521531.372802:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 51 00000100:00100000:3.0:1788521531.383055:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521531.383172:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201476608 00000100:00100000:0.0:1788521531.383185:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201476608 00000100:00100000:0.0:1788521531.383268:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 52 00000100:00100000:0.0:1788521531.383282:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58343800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+29:15689:x1875400201476608:12345-192.168.203.41@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788521531.383332:0:17199:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788521531.383508:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58343800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+29:15689:x1875400201476608:12345-192.168.203.41@tcp:53:lhsmtool_posix.0 Request processed in 220us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521531.383517:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 52 00000100:00100000:3.0:1788521531.386768:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521531.386931:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201476864 00000100:00100000:0.0:1788521531.386944:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201476864 00000100:00100000:0.0:1788521531.387020:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 53 00000100:00100000:0.0:1788521531.387032:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58343480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+29:15689:x1875400201476864:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788521531.387068:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521531.387096:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411400/0x411dd0ee4d2d2b5b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eedb1f expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788521531.387643:0:17200:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =28 00000004:00080000:0.0:1788521531.387651:0:17200:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+28 in llog 00000004:00080000:0.0:1788521531.387675:0:17200:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:0.0:1788521531.387859:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411000/0x411dd0ee4d2d2b62 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.387877:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411000/0x411dd0ee4d2d2b62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.387926:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411000/0x411dd0ee4d2d2b62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.387997:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411400/0x411dd0ee4d2d2b5b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb1f expref: 32 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.388020:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411000/0x411dd0ee4d2d2b62 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb1f expref: 31 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.388029:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fef74b1bc00) 00010000:00010000:0.0:1788521531.388033:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788521531.388037:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42411000, rc 0) 00000100:00100000:0.0:1788521531.388134:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58343480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+31:15689:x1875400201476864:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 1104us (1380us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1788521531.388143:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 53 00000100:00100000:1.0:1788521531.398323:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521531.398523:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201477120 00000100:00100000:0.0:1788521531.398536:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201477120 00000100:00100000:0.0:1788521531.398610:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 54 00000100:00100000:0.0:1788521531.398621:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+31:15689:x1875400201477120:12345-192.168.203.41@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788521531.398715:0:17199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521531.398751:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411000/0x411dd0ee4d2d2b62 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb1f expref: 31 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.398777:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fef74b1bc00) 00010000:00010000:0.0:1788521531.398793:0:17199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521531.398830:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410200/0x411dd0ee4d2d2b70 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.398848:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410200/0x411dd0ee4d2d2b70 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.398860:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410200/0x411dd0ee4d2d2b70 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.399735:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410e00/0x411dd0ee4d2d2b77 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x25e7b27b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.399760:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410e00/0x411dd0ee4d2d2b77 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x25e7b27b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.399775:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410e00/0x411dd0ee4d2d2b77 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x25e7b27b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.399832:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410200/0x411dd0ee4d2d2b70 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.399838:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410200/0x411dd0ee4d2d2b70 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.399845:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410200/0x411dd0ee4d2d2b70 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.399864:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410200 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521531.399869:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410200/0x411dd0ee4d2d2b70 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.399877:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410200/0x411dd0ee4d2d2b70 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.399913:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8fef74b1b700) 00010000:00010000:0.0:1788521531.399916:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521531.399920:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410200/0x411dd0ee4d2d2b70 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.399926:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410200/0x411dd0ee4d2d2b70 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.399941:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410e00/0x411dd0ee4d2d2b77 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x25e7b27b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.399947:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410e00/0x411dd0ee4d2d2b77 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x25e7b27b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.399953:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410e00/0x411dd0ee4d2d2b77 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x25e7b27b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.399957:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410e00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521531.399959:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410e00/0x411dd0ee4d2d2b77 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x25e7b27b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.399964:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410e00/0x411dd0ee4d2d2b77 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x25e7b27b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.399981:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x25e7b27b (ffff8fef74b1bd00) 00010000:00010000:0.0:1788521531.399983:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521531.399986:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410e00/0x411dd0ee4d2d2b77 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x25e7b27b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.399992:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410e00/0x411dd0ee4d2d2b77 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x25e7b27b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521531.400183:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+30:15689:x1875400201477120:12345-192.168.203.41@tcp:36:lhsmtool_posix.0 Request processed in 1557us (1868us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788521531.400266:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 54 00000100:00100000:3.0:1788521531.410698:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521531.410921:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201477248 00000100:00100000:2.0:1788521531.410936:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201477248 00000100:00100000:2.0:1788521531.411015:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 55 00000100:00100000:2.0:1788521531.411028:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+30:15689:x1875400201477248:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521531.411065:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521531.411097:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2b7e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eedb26 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.411143:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031800/0x411dd0ee4d2d2b85 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.411161:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031800/0x411dd0ee4d2d2b85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.411175:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031800/0x411dd0ee4d2d2b85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.411332:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2b7e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb26 expref: 32 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.411355:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031800/0x411dd0ee4d2d2b85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb26 expref: 31 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.411384:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fef44f4f800) 00010000:00010000:2.0:1788521531.411388:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788521531.411393:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef40031800, rc 0) 00000100:00100000:2.0:1788521531.411472:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+31:15689:x1875400201477248:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 446us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521531.411480:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 55 00000100:00100000:3.0:1788521531.418060:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521531.418187:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201477504 00000100:00100000:2.0:1788521531.418201:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201477504 00000100:00100000:2.0:1788521531.418269:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 56 00000100:00100000:2.0:1788521531.418281:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+31:15689:x1875400201477504:12345-192.168.203.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788521531.418388:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2b8c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.418409:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2b8c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.418434:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2b8c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788521531.418651:0:17201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1788521531.418662:0:17201:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 581484777245ns, next at 582484774604ns, rc = 0 00000004:00010000:2.0:1788521531.418719:0:17201:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d1cbb4f reply state 000000008972e2e3 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2b8c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.418735:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2b8c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.418744:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fef44f4f800) 00010000:00010000:2.0:1788521531.418765:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788521531.418770:0:17201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788521531.418939:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+33:15689:x1875400201477504:12345-192.168.203.41@tcp:36:lhsmtool_posix.0 Request processed in 659us (902us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788521531.418947:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 56 00000100:00100000:1.0:1788521531.424029:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521531.424634:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201477632 00000100:00100000:2.0:1788521531.424648:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201477632 00000100:00100000:2.0:1788521531.424726:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 57 00000100:00100000:2.0:1788521531.424739:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+33:15689:x1875400201477632:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521531.424775:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521531.424816:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2b93 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eedb2d expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.424956:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2b93 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb2d expref: 34 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.424975:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2b93 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb2d expref: 34 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.424998:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fef44f4f800) 00010000:00010000:2.0:1788521531.425002:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788521531.425007:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef40030800, rc 0) 00000100:00100000:2.0:1788521531.425095:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+34:15689:x1875400201477632:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 359us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521531.425103:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 57 00000100:00100000:3.0:1788521531.429571:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521531.432296:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201477760 00000100:00100000:2.0:1788521531.432317:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201477760 00000100:00100000:2.0:1788521531.432446:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 23 00000100:00100000:2.0:1788521531.432477:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58342680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+5:2395:x1875400201477760:12345-192.168.203.41@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788521531.432798:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58342680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+6:2395:x1875400201477760:12345-192.168.203.41@tcp:2:lhsmtool_posix.0 Request processed in 324us (3241us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788521531.432818:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 23 00000100:00080000:3.0:1788521531.434229:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521531.436995:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521531.437222:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201478016 00000100:00100000:1.0:1788521531.437235:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201478016 00000100:00100000:1.0:1788521531.437312:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 9 00000100:00100000:1.0:1788521531.437325:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef75223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+34:15689:x1875400201478016:12345-192.168.203.41@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788521531.437644:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef75223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+35:15689:x1875400201478016:12345-192.168.203.41@tcp:35:lhsmtool_posix.0 Request processed in 321us (662us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1788521531.437672:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 9 00000100:00100000:1.0:1788521531.440513:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521531.440697:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201478272 00000100:00100000:2.0:1788521531.440710:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201478272 00000100:00100000:2.0:1788521531.440789:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 58 00000100:00100000:2.0:1788521531.440800:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4321ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+35:15689:x1875400201478272:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788521531.440988:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4321ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+35:15689:x1875400201478272:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 Request processed in 189us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521531.440996:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 58 00000100:00100000:3.0:1788521531.443781:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521531.444076:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201478400 00000100:00100000:2.0:1788521531.444091:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201478400 00000100:00100000:2.0:1788521531.444167:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 59 00000100:00100000:2.0:1788521531.444179:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58341c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+35:15689:x1875400201478400:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521531.444205:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521531.444235:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030c00/0x411dd0ee4d2d2b9a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eedb34 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.444363:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031a00/0x411dd0ee4d2d2ba1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.444393:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031a00/0x411dd0ee4d2d2ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.444407:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031a00/0x411dd0ee4d2d2ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521531.444478:0:17200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788521531.444503:0:17200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031a00/0x411dd0ee4d2d2ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.444534:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030c00/0x411dd0ee4d2d2b9a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb34 expref: 37 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.444558:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031a00/0x411dd0ee4d2d2ba1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb34 expref: 36 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.444569:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fef44f4f800) 00010000:00010000:2.0:1788521531.444572:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788521531.444577:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef40031a00, rc 0) 00000100:00100000:2.0:1788521531.444761:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58341c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+36:15689:x1875400201478400:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 581us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521531.444769:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 59 00000100:00100000:3.0:1788521531.448277:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521531.448380:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201478528 00000100:00100000:0.0:1788521531.448391:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201478528 00000100:00100000:0.0:1788521531.448457:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 24 00000100:00100000:0.0:1788521531.448468:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58340e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+6:2396:x1875400201478528:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788521531.448493:0:18707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521531.448522:0:18707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000283203ce/0x411dd0ee4d2d2ba8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eedb3b expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788521531.448555:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9aac3a, blocks: 0x0 00010000:00010000:0.0:1788521531.448582:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=581s v=(0 0) 00010000:00010000:0.0:1788521531.448587:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521531.448598:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000283203ce/0x411dd0ee4d2d2ba8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb3b expref: 7 pid: 18707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.448621:0:18707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000283203ce/0x411dd0ee4d2d2ba8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb3b expref: 7 pid: 18707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.448652:0:18707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fee42410200, rc 0) 00000100:00100000:0.0:1788521531.448721:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58340e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+7:2396:x1875400201478528:12345-192.168.203.41@tcp:101:lhsmtool_posix.0 Request processed in 255us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521531.448728:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 24 00000100:00100000:2.0:1788521531.452647:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521531.452779:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201478784 00000100:00100000:1.0:1788521531.452792:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201478784 00000100:00100000:1.0:1788521531.453062:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 60 00000100:00100000:1.0:1788521531.453075:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef75281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+36:15689:x1875400201478784:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788521531.453218:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef75281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+36:15689:x1875400201478784:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 Request processed in 146us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521531.453226:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 60 00000100:00100000:3.0:1788521531.455484:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521531.456091:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201478912 00000100:00100000:0.0:1788521531.456105:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201478912 00000100:00100000:0.0:1788521531.456182:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 61 00000100:00100000:0.0:1788521531.456192:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+36:15689:x1875400201478912:12345-192.168.203.41@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788521531.458519:0:17179:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1788521531.458538:0:17179:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788521531.458640:0:17179:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:0.0:1788521531.458759:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d29e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.458774:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d29e1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.458783:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d29e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.458790:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b6800 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521531.458796:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d29e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.458814:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d29e1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.458837:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8fef7656a500) 00010000:00010000:0.0:1788521531.458841:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521531.458847:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d29e1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.458872:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6800/0x411dd0ee4d2d29e1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.458918:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d29e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.458926:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d29e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.458932:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d29e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.458937:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521531.458940:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d29e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.458946:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d29e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.458954:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8fef74b1b700) 00010000:00010000:0.0:1788521531.458956:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521531.458959:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d29e8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.458965:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42410600/0x411dd0ee4d2d29e8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.458979:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d2a90 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.458984:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d2a90 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.458995:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d2a90 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.459001:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40030e00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521531.459004:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d2a90 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.459010:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d2a90 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.459017:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8fef44f4ff00) 00010000:00010000:0.0:1788521531.459019:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521531.459022:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d2a90 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.459027:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d2a90 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.459051:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030400/0x411dd0ee4d2d2b15 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.459057:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030400/0x411dd0ee4d2d2b15 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.459062:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030400/0x411dd0ee4d2d2b15 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.459247:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40030400 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521531.459251:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030400/0x411dd0ee4d2d2b15 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.459267:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030400/0x411dd0ee4d2d2b15 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.459277:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fef44f4f500) 00010000:00010000:0.0:1788521531.459279:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521531.459282:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030400/0x411dd0ee4d2d2b15 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.459287:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030400/0x411dd0ee4d2d2b15 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.459300:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2b8c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.459306:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2b8c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.459312:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2b8c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.459316:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40031e00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:0.0:1788521531.459319:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2b8c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.459324:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2b8c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.459330:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fef44f4f800) 00010000:00010000:0.0:1788521531.459332:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788521531.459335:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2b8c lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.459349:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2b8c lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521531.459601:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+15:15689:x1875400201478912:12345-192.168.203.41@tcp:44:lhsmtool_posix.0 Request processed in 3402us (4123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521531.459612:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 61 00000100:00100000:1.0:1788521531.459817:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee4359aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222531072:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788521531.459901:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521531.459967:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222531072 00000100:00100000:1.0:1788521531.459976:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222531072 00000100:00100000:1.0:1788521531.460019:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788521531.460027:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222531072:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788521531.460183:0:18704:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788521531.460189:0:18704:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788521531.460192:0:18704:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788521531.460194:0:18704:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788521530 -> 1788521530 00002000:00010000:1.0:1788521531.460196:0:18704:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788521531.460231:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875400222531072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 204us (349us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788521531.460238:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:1.0:1788521531.460285:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fee4359aa00/2, rc 0, transno 8589934596 00000100:00100000:1.0:1788521531.460291:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee4359aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222531072:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1788521531.462642:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3e00/0x411dd0ee4d2d2a35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.462663:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3e00/0x411dd0ee4d2d2a35 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.462672:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3e00/0x411dd0ee4d2d2a35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.462679:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef457f3e00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521531.462684:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3e00/0x411dd0ee4d2d2a35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.462693:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3e00/0x411dd0ee4d2d2a35 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.462713:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8fef74b1b700) 00010000:00010000:3.0:1788521531.462716:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788521531.462721:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3e00/0x411dd0ee4d2d2a35 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.462743:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef457f3e00/0x411dd0ee4d2d2a35 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521531.470633:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521531.470738:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201479040 00000100:00100000:1.0:1788521531.470750:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201479040 00000100:00100000:1.0:1788521531.470835:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 26 00000100:00100000:1.0:1788521531.470848:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef75220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+7:2395:x1875400201479040:12345-192.168.203.41@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788521531.471010:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef75220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+7:2395:x1875400201479040:12345-192.168.203.41@tcp:16:lhsmtool_posix.0 Request processed in 165us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521531.471017:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 26 00000100:00100000:1.0:1788521531.473524:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521531.473613:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201479296 00000100:00100000:3.0:1788521531.473624:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201479296 00000100:00100000:3.0:1788521531.473694:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 62 00000100:00100000:3.0:1788521531.473705:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130bc563-236a-43ec-a1a1-1e1e641e5bc7+15:15689:x1875400201479296:12345-192.168.203.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788521531.473775:0:19535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521531.473817:0:19535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031a00/0x411dd0ee4d2d2ba1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb34 expref: 15 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.473849:0:19535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fef44f4f800) 00010000:00010000:3.0:1788521531.473855:0:19535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788521531.473917:0:19535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6400/0x411dd0ee4d2d2baf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.473933:0:19535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6400/0x411dd0ee4d2d2baf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.473944:0:19535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6400/0x411dd0ee4d2d2baf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788521531.474107:0:19535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000035b4caa4 reply state 00000000680449cb transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6400/0x411dd0ee4d2d2baf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.474121:0:19535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b6400/0x411dd0ee4d2d2baf lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.474128:0:19535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fef44f4f800) 00010000:00010000:3.0:1788521531.474147:0:19535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788521531.474151:0:19535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788521531.474280:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130bc563-236a-43ec-a1a1-1e1e641e5bc7+16:15689:x1875400201479296:12345-192.168.203.41@tcp:36:lhsmtool_posix.0 Request processed in 577us (770us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788521531.474288:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 62 00000100:00100000:3.0:1788521531.476777:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521531.476873:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201479424 00000100:00100000:1.0:1788521531.476922:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201479424 00000100:00100000:1.0:1788521531.476990:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 27 00000100:00100000:1.0:1788521531.477003:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58340000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+7:2396:x1875400201479424:12345-192.168.203.41@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788521531.477198:0:18704:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788521531.477202:0:18704:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788521529 00002000:00010000:1.0:1788521531.477205:0:18704:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788521529 00002000:00010000:1.0:1788521531.477208:0:18704:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788521530 -> 1788521529 00002000:00010000:1.0:1788521531.477211:0:18704:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788521531.477281:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58340000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+8:2396:x1875400201479424:12345-192.168.203.41@tcp:2:lhsmtool_posix.0 Request processed in 281us (517us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788521531.477289:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 27 00000100:00100000:0.0:1788521531.482251:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521531.482383:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201479552 00000100:00100000:1.0:1788521531.482398:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201479552 00000100:00100000:1.0:1788521531.482477:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 28 00000100:00100000:1.0:1788521531.482489:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef75220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+8:2396:x1875400201479552:12345-192.168.203.41@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788521531.482545:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9dd113e/0x411dd0ee4d2d2bb6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521531.482582:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521531.482587:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521531.482594:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9dd113e/0x411dd0ee4d2d2bb6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521531.482611:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9dd113e/0x411dd0ee4d2d2bb6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521531.482643:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d9dd113e/0x411dd0ee4d2d2bb6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521531.482652:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9dd113e/0x411dd0ee4d2d2bb6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521531.482661:0:18707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9dd113e/0x411dd0ee4d2d2bb6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521531.482669:0:18707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef71c94800 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:1.0:1788521531.482674:0:18707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9dd113e/0x411dd0ee4d2d2bb6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521531.482684:0:18707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9dd113e/0x411dd0ee4d2d2bb6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521531.482701:0:18707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9dd113e/0x411dd0ee4d2d2bb6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521531.482715:0:18707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9dd113e/0x411dd0ee4d2d2bb6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521531.482816:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef75220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+8:2396:x1875400201479552:12345-192.168.203.41@tcp:1:lhsmtool_posix.0 Request processed in 330us (2158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521531.482824:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 28 00000100:00100000:0.0:1788521531.485321:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521531.485473:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201479808 00000100:00100000:2.0:1788521531.485484:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201479808 00000100:00100000:2.0:1788521531.485550:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 63 00000100:00100000:2.0:1788521531.485562:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef75221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+16:15689:x1875400201479808:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788521531.485671:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030c00/0x411dd0ee4d2d2bbd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.485718:0:17201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030600/0x411dd0ee4d2d2b0e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb03 expref: 16 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.485731:0:17201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030c00/0x411dd0ee4d2d2bbd lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.485775:0:17201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030600/0x411dd0ee4d2d2b0e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb03 expref: 16 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.485791:0:17201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030600/0x411dd0ee4d2d2b0e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb03 expref: 16 pid: 17201 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521531.485820:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef75280e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17201:1875400222531200:192.168.203.41@tcp:104: 00000100:00100000:2.0:1788521531.485953:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef50e2dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521531.491755:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521531.492075:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef75280e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17201:1875400222531200:192.168.203.41@tcp:104: 00010000:00010000:2.0:1788521531.492113:0:17201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030c00/0x411dd0ee4d2d2bbd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521531.492248:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201479936 00000100:00100000:0.0:1788521531.492258:0:18731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201479936 00010000:00010000:0.0:1788521531.492308:0:18731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030600/0x411dd0ee4d2d2b0e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb03 expref: 17 pid: 17201 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521531.492352:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 19 00000100:00100000:0.0:1788521531.492373:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58343100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:130bc563-236a-43ec-a1a1-1e1e641e5bc7+17:2395:x1875400201479936:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521531.492392:0:18731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521531.492399:0:18731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030600/0x411dd0ee4d2d2b0e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb03 expref: 17 pid: 17201 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.492412:0:18731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030600/0x411dd0ee4d2d2b0e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb03 expref: 17 pid: 17201 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.492439:0:18731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030600/0x411dd0ee4d2d2b0e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb03 expref: 17 pid: 17201 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.492459:0:18731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fef44f4f500) 00010000:00010000:0.0:1788521531.492483:0:18731:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411200/0x411dd0ee4d2d2b2a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb11 expref: 16 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.492493:0:18731:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030c00/0x411dd0ee4d2d2bbd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.492502:0:18731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030c00/0x411dd0ee4d2d2bbd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.492510:0:18731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030c00/0x411dd0ee4d2d2bbd lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.492545:0:18731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521531.492648:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58343100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:130bc563-236a-43ec-a1a1-1e1e641e5bc7+16:2395:x1875400201479936:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 286us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521531.492656:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 19 00010000:00010000:3.0:1788521531.492770:0:17201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030c00/0x411dd0ee4d2d2bbd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.492778:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030c00/0x411dd0ee4d2d2bbd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.493100:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2bc4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.493114:0:17201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2b93 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb2d expref: 16 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.493123:0:17201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2bc4 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.493160:0:17201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2b93 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb2d expref: 16 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.493177:0:17201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2b93 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb2d expref: 16 pid: 17200 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521531.493193:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58341180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17201:1875400222531328:192.168.203.41@tcp:104: 00000100:00100000:3.0:1788521531.493264:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee410b3900 going to sleep for 11 seconds 00000100:00100000:1.0:1788521531.502844:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521531.502961:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201480064 00000100:00100000:0.0:1788521531.502974:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201480064 00010000:00010000:0.0:1788521531.503033:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2b93 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb2d expref: 17 pid: 17200 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521531.503097:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 20 00000100:00100000:0.0:1788521531.503110:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+17:2395:x1875400201480064:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521531.503130:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521531.503139:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2b93 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb2d expref: 17 pid: 17200 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.503155:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2b93 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb2d expref: 17 pid: 17200 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.503209:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fef44f4f800) 00010000:00010000:0.0:1788521531.503215:0:17186:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2bc4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.503238:0:17186:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2bc4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.503248:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2bc4 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.503272:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521531.503463:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+17:2395:x1875400201480064:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 354us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521531.503472:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 20 00010000:00010000:3.0:1788521531.505129:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030800/0x411dd0ee4d2d2b93 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb2d expref: 16 pid: 17200 timeout: 681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521531.505160:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58341180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17201:1875400222531328:192.168.203.41@tcp:104: 00010000:00010000:3.0:1788521531.505193:0:17201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2bc4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.505205:0:17201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2bc4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.505212:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2bc4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788521531.505384:0:17201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1788521531.505523:0:17201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1788521531.505563:0:17201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1788521531.505659:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58341180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17201:1875400222531456:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788521531.505734:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521531.505777:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee410b3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788521531.506072:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222531456 00000100:00100000:1.0:1788521531.506081:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222531456 00000100:00100000:1.0:1788521531.506146:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788521531.506157:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58341f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17201:x1875400222531456:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788521531.506270:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58341f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17201:x1875400222531456:12345-0@lo:1000:mdt00_002.0 Request processed in 114us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521531.506279:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788521531.506670:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58341180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17201:1875400222531456:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788521531.506870:0:17201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1788521531.506951:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58341180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17201:1875400222531584:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788521531.506992:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521531.507015:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee410b3600 going to sleep for 11 seconds 00000100:00100000:1.0:1788521531.507135:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222531584 00000100:00100000:1.0:1788521531.507142:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222531584 00000100:00100000:1.0:1788521531.507182:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788521531.507190:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17201:x1875400222531584:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788521531.507322:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17201:x1875400222531584:12345-0@lo:1000:mdt00_002.0 Request processed in 132us (330us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1788521531.507329:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788521531.507554:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58341180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17201:1875400222531584:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788521531.507595:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2bc4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.507605:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2bc4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.507629:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2bc4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.507635:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7200 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521531.507640:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2bc4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.507649:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2bc4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.507668:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fef44f4f800) 00010000:00010000:3.0:1788521531.507671:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788521531.507677:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2bc4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.507684:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7200/0x411dd0ee4d2d2bc4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.507722:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c95600/0x411dd0ee4d2d2b23 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.507728:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c95600/0x411dd0ee4d2d2b23 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.507733:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c95600/0x411dd0ee4d2d2b23 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.507738:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef71c95600 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521531.507740:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c95600/0x411dd0ee4d2d2b23 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.507754:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c95600/0x411dd0ee4d2d2b23 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.507764:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fef44f4f500) 00010000:00010000:3.0:1788521531.507767:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788521531.507775:0:17201:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411200/0x411dd0ee4d2d2b2a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb11 expref: 19 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.507787:0:17201:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411200/0x411dd0ee4d2d2b2a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb11 expref: 19 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.507796:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411200/0x411dd0ee4d2d2b2a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb11 expref: 19 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.507868:0:17201:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fee42411200/0x411dd0ee4d2d2b2a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb11 expref: 19 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521531.507880:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef58342a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17201:1875400222531712:192.168.203.41@tcp:105: 00000100:00100000:3.0:1788521531.507987:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fee410b3540 going to sleep for 11 seconds 00000100:00100000:1.0:1788521531.511173:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521531.511289:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef58342a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17201:1875400222531712:192.168.203.41@tcp:105: 00010000:00010000:3.0:1788521531.511331:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c95600/0x411dd0ee4d2d2b23 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.511344:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef71c95600/0x411dd0ee4d2d2b23 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.511401:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7e00/0x411dd0ee4d2d2bcb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.511437:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7e00/0x411dd0ee4d2d2bcb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.511451:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7e00/0x411dd0ee4d2d2bcb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.511464:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7e00/0x411dd0ee4d2d2bcb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.511471:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7e00/0x411dd0ee4d2d2bcb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.511478:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7e00/0x411dd0ee4d2d2bcb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.511485:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef6d7b7e00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521531.511491:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7e00/0x411dd0ee4d2d2bcb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.511499:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7e00/0x411dd0ee4d2d2bcb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.511512:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fef44f4f500) 00010000:00010000:3.0:1788521531.511515:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521531.511520:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7e00/0x411dd0ee4d2d2bcb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.511525:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef6d7b7e00/0x411dd0ee4d2d2bcb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.511536:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030c00/0x411dd0ee4d2d2bbd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.511548:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030c00/0x411dd0ee4d2d2bbd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.511555:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030c00/0x411dd0ee4d2d2bbd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.511560:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40030c00 already unused, calling callback (ffffffffc19634f0) 00010000:00010000:3.0:1788521531.511563:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030c00/0x411dd0ee4d2d2bbd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.511569:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030c00/0x411dd0ee4d2d2bbd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.511578:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fef44f4f500) 00010000:00010000:3.0:1788521531.511580:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788521531.511583:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030c00/0x411dd0ee4d2d2bbd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.511589:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030c00/0x411dd0ee4d2d2bbd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521531.511824:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef75221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+19:15689:x1875400201479808:12345-192.168.203.41@tcp:57:lhsmtool_posix.0 Request processed in 26245us (26496us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1788521531.511837:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 63 00000020:00080000:3.0:1788521531.511846:0:17201:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788521531.513853:0:17234:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788521531.513864:0:17234:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788521531.513923:0:17234:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788521531.513931:0:17234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788521531.515136:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521531.515779:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201480192 00000100:00100000:2.0:1788521531.515794:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201480192 00000100:00100000:2.0:1788521531.515858:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201480448 00000100:00100000:2.0:1788521531.515862:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201480448 00000100:00100000:2.0:1788521531.515905:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 10 00000100:00100000:2.0:1788521531.515917:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7aa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+20:15687:x1875400201480192:12345-192.168.203.41@tcp:49:dd.0 00000100:00100000:2.0:1788521531.516265:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7aa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+20:15687:x1875400201480192:12345-192.168.203.41@tcp:49:dd.0 Request processed in 348us (5104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521531.516291:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 10 00000100:00100000:2.0:1788521531.516350:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 11 00000100:00100000:2.0:1788521531.516358:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43c66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+19:15689:x1875400201480448:12345-192.168.203.41@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788521531.516723:0:17203:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788521531.516764:0:17203:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1788521531.516865:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2bd2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.516959:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2bd2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.516974:0:17203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2bd2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.516985:0:17203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2bd2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.516992:0:17203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2bd2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.516999:0:17203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2bd2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.517290:0:17203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788521531.517384:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43c66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:130bc563-236a-43ec-a1a1-1e1e641e5bc7+21:15689:x1875400201480448:12345-192.168.203.41@tcp:35:lhsmtool_posix.0 Request processed in 1024us (2255us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788521531.517393:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 11 00000020:00080000:2.0:1788521531.517398:0:17203:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788521531.523736:0:20227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521531.523756:0:20227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2bd2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521531.523789:0:20227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40031e00 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:1.0:1788521531.523795:0:20227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2bd2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521531.523818:0:20227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2bd2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521531.523843:0:20227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fef44f4f800) 00010000:00010000:1.0:1788521531.523846:0:20227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788521531.523852:0:20227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2bd2 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521531.523858:0:20227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40031e00/0x411dd0ee4d2d2bd2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.524027:0:20227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521531.524038:0:20227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521531.524040:0:20227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521531.524621:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:2.0:1788521531.524703:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201480576 00000100:00100000:2.0:1788521531.524716:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201480576 00000100:00100000:2.0:1788521531.524786:0:19535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 64 00000100:00100000:2.0:1788521531.524798:0:19535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef75223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130bc563-236a-43ec-a1a1-1e1e641e5bc7+21:15687:x1875400201480576:12345-192.168.203.41@tcp:101:dd.0 00010000:00010000:2.0:1788521531.524833:0:19535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521531.524859:0:19535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030400/0x411dd0ee4d2d2bd9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64dd99be98eedb42 expref: -99 pid: 19535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.524921:0:19535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d2be0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.524948:0:19535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d2be0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.524962:0:19535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d2be0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.525399:0:19535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030400/0x411dd0ee4d2d2bd9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb42 expref: 23 pid: 19535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.525423:0:19535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fef40030e00/0x411dd0ee4d2d2be0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb42 expref: 22 pid: 19535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.525433:0:19535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fef44f4f500) 00010000:00010000:2.0:1788521531.525436:0:19535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788521531.525441:0:19535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fef40030e00, rc 0) 00000100:00100000:2.0:1788521531.525528:0:19535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef75223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:130bc563-236a-43ec-a1a1-1e1e641e5bc7+22:15687:x1875400201480576:12345-192.168.203.41@tcp:101:dd.0 Request processed in 731us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521531.525546:0:19535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 64 00000100:00100000:3.0:1788521531.533205:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef715a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222531840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788521531.533307:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521531.533467:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222531840 00000100:00100000:1.0:1788521531.533478:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222531840 00000100:00100000:1.0:1788521531.533545:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788521531.533557:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222531840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788521531.533603:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788521531.533656:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222531840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521531.533663:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788521531.533791:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef715a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222531840:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788521531.678129:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521531.678214:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:0.0:1788521531.678396:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201480704 00000100:00100000:0.0:1788521531.678409:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201480704 00000100:00100000:0.0:1788521531.678505:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201480832 00000100:00100000:0.0:1788521531.678509:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201480832 00000100:00100000:0.0:1788521531.678535:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 0 00000100:00100000:0.0:1788521531.678547:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+9:2394:x1875400201480704:12345-192.168.203.41@tcp:4:dd.0 00010000:00010000:0.0:1788521531.678590:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c79b1790/0x411dd0ee4d2d2be7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.678641:0:18710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000283203ce/0x411dd0ee4d2d2ba8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb3b expref: 9 pid: 18707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.678651:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521531.678656:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521531.678662:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c79b1790/0x411dd0ee4d2d2be7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.678707:0:18710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000283203ce/0x411dd0ee4d2d2ba8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb3b expref: 9 pid: 18707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521531.678724:0:18710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000283203ce/0x411dd0ee4d2d2ba8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb3b expref: 9 pid: 18707 timeout: 681 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521531.678742:0:18710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef75221500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:18710:1875400222531968:192.168.203.41@tcp:104: 00000100:00100000:0.0:1788521531.678922:0:18710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8fef71d5b300 going to sleep for 11 seconds 00000100:00100000:0.0:1788521531.681946:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:3.0:1788521531.682230:0:18710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef75221500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:18710:1875400222531968:192.168.203.41@tcp:104: 00010000:00010000:3.0:1788521531.682279:0:18710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c79b1790/0x411dd0ee4d2d2be7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521531.682643:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201480960 00000100:00100000:2.0:1788521531.682653:0:18731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201480960 00010000:00010000:2.0:1788521531.682699:0:18731:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000283203ce/0x411dd0ee4d2d2ba8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb3b expref: 10 pid: 18707 timeout: 681 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521531.682752:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 21 00000100:00100000:2.0:1788521531.682763:0:18731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef75222d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:130bc563-236a-43ec-a1a1-1e1e641e5bc7+10:2396:x1875400201480960:12345-192.168.203.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521531.682784:0:18731:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521531.682875:0:18731:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000283203ce/0x411dd0ee4d2d2ba8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb3b expref: 10 pid: 18707 timeout: 681 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.682926:0:18731:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000283203ce/0x411dd0ee4d2d2ba8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb3b expref: 10 pid: 18707 timeout: 681 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.682955:0:18731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000283203ce/0x411dd0ee4d2d2ba8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.41@tcp remote: 0x64dd99be98eedb3b expref: 10 pid: 18707 timeout: 681 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.682976:0:18731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521531.682981:0:18731:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521531.682988:0:18731:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c79b1790/0x411dd0ee4d2d2be7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.683000:0:18731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c79b1790/0x411dd0ee4d2d2be7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.683111:0:18731:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521531.683188:0:18731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef75222d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:130bc563-236a-43ec-a1a1-1e1e641e5bc7+9:2396:x1875400201480960:12345-192.168.203.41@tcp:103:ldlm_bl.0 Request processed in 426us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521531.683197:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 21 00010000:00010000:3.0:1788521531.685039:0:18710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c79b1790/0x411dd0ee4d2d2be7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.689343:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c79b1790/0x411dd0ee4d2d2be7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788521531.800879:0:18701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:0.0:1788521531.800921:0:18701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:3.0:1788521531.806756:0:18710:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:3.0:1788521531.806766:0:18710:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1788521529 -> 1788521531 00002000:00010000:3.0:1788521531.806769:0:18710:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788521529 -> 1788521531 00002000:00010000:3.0:1788521531.806771:0:18710:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:3.0:1788521531.806790:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c79b1790/0x411dd0ee4d2d2be7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.806803:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c79b1790/0x411dd0ee4d2d2be7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.807585:0:18710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c79b1790/0x411dd0ee4d2d2be7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.807593:0:18710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fee42410800 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:3.0:1788521531.807598:0:18710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c79b1790/0x411dd0ee4d2d2be7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.807608:0:18710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c79b1790/0x411dd0ee4d2d2be7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.807649:0:18710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c79b1790/0x411dd0ee4d2d2be7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.807658:0:18710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c79b1790/0x411dd0ee4d2d2be7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521531.809394:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+6:2394:x1875400201480704:12345-192.168.203.41@tcp:4:dd.0 Request processed in 130837us (131269us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788521531.809415:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 0 00000100:00100000:2.0:1788521531.809462:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 1 00000100:00100000:2.0:1788521531.809477:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef715a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+5:2393:x1875400201480832:12345-192.168.203.41@tcp:4:dd.0 00002000:00010000:2.0:1788521531.809529:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 4194304, mtime: 0x6a9aac3b, atime: 0x6a9aac39, ctime: 0x6a9aac3b, blocks: 0x2000 00010000:00010000:2.0:1788521531.809539:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3e1913a/0x411dd0ee4d2d2bee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.809554:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=581s v=(0 0) 00010000:00010000:2.0:1788521531.809559:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521531.809565:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3e1913a/0x411dd0ee4d2d2bee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.809579:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3e1913a/0x411dd0ee4d2d2bee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521531.855535:0:20226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788521531.889644:0:18701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:2.0:1788521531.890740:0:18710:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1788521531.890763:0:18710:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1788521531.890787:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3e1913a/0x411dd0ee4d2d2bee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.890824:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3e1913a/0x411dd0ee4d2d2bee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.890833:0:18710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3e1913a/0x411dd0ee4d2d2bee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.890841:0:18710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fef40030800 already unused, calling callback (ffffffffc0d354f0) 00010000:00010000:2.0:1788521531.890847:0:18710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3e1913a/0x411dd0ee4d2d2bee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.890858:0:18710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3e1913a/0x411dd0ee4d2d2bee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.891126:0:18710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3e1913a/0x411dd0ee4d2d2bee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521531.891138:0:18710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3e1913a/0x411dd0ee4d2d2bee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521531.891275:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef715a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+5:2393:x1875400201480832:12345-192.168.203.41@tcp:4:dd.0 Request processed in 81798us (213055us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788521531.891288:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 1 00000100:00100000:2.0:1788521532.557150:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef75280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222532096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521532.557256:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521532.557280:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43df2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222532480:0@lo:400:kworker.0 00000100:00100000:2.0:1788521532.557316:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222532608:0@lo:400:kworker.0 00000100:00100000:3.0:1788521532.557323:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521532.557348:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222532992:0@lo:400:kworker.0 00000100:00100000:2.0:1788521532.557372:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521532.557389:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43df2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3645:1875400222532224:0@lo:400:kworker.0 00000100:00100000:2.0:1788521532.557405:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43df2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222533120:0@lo:400:kworker.0 00000100:00100000:1.0:1788521532.557487:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222532480 00000100:00100000:1.0:1788521532.557497:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222532480 00000100:00100000:1.0:1788521532.557560:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222532608 00000100:00100000:1.0:1788521532.557564:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222532608 00000100:00100000:1.0:1788521532.557616:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788521532.557628:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222532480:12345-0@lo:400:kworker.0 00000040:00080000:0.0:1788521532.557782:0:17234:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788521532.557788:0:17234:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788521532.557811:0:17234:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788521532.557817:0:17234:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788521532.557919:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788521532.557936:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef75280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222532608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521532.559567:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521532.559609:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875400222533632:0@lo:400:kworker.0 00000100:00100000:2.0:1788521532.559643:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521532.559709:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222532096 00000100:00100000:2.0:1788521532.559717:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222532096 00000100:00100000:2.0:1788521532.559763:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788521532.559772:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef75283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875400222532096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788521532.559805:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788521532.559848:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef75283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875400222532096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (2593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521532.559855:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788521532.559881:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222533632 00000100:00100000:2.0:1788521532.559898:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222533632 00000100:00100000:2.0:1788521532.559932:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788521532.559937:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef75281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875400222533632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521532.559968:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef75281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875400222533632:12345-0@lo:400:kworker.0 Request processed in 31us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521532.559974:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788521532.560017:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3644:1875400222533632:0@lo:400:kworker.0 00000100:00100000:2.0:1788521532.560049:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef75280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222532096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521532.560108:0:19185:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788521532.560117:0:19185:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1788521532.560137:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222532352:0@lo:400:kworker.0 00000100:00100000:2.0:1788521532.560437:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521532.560469:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222532864:0@lo:400:kworker.0 00000100:00100000:2.0:1788521532.560492:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521532.560512:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875400222533376:0@lo:400:kworker.0 00000100:00100000:2.0:1788521532.560532:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521532.560547:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fef75220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222533888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788521532.560567:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521532.560596:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521532.560613:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222533504:0@lo:400:kworker.0 00000100:00100000:2.0:1788521532.560631:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521532.560655:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222533888 00000100:00100000:2.0:1788521532.560658:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222533888 00000100:00100000:2.0:1788521532.560682:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788521532.560687:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef75281500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222533888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788521532.560702:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788521532.560730:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef75281500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222533888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521532.560736:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788521532.560771:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fef75220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222533888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788521532.560790:0:19535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222533376 00000100:00100000:2.0:1788521532.560793:0:19535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222533376 00000100:00100000:2.0:1788521532.560824:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222533504 00000100:00100000:2.0:1788521532.560827:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222533504 00000100:00100000:2.0:1788521532.560846:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788521532.560853:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef75283800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875400222533376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521532.561499:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef75283800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875400222533376:12345-0@lo:400:kworker.0 Request processed in 642us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521532.561518:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788521532.561535:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788521532.561542:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef75282300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222533504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521532.564523:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521532.564626:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222532352 00000100:00100000:3.0:1788521532.564638:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222532352 00000100:00100000:3.0:1788521532.564708:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222532864 00000100:00100000:3.0:1788521532.564712:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222532864 00000100:00100000:3.0:1788521532.564734:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788521532.564744:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef75280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222532352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521532.564865:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef75280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875400222532352:12345-0@lo:400:kworker.0 Request processed in 121us (4615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521532.564873:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788521532.564920:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788521532.564928:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef75283100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222532864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521532.565266:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef75283100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875400222532864:12345-0@lo:400:kworker.0 Request processed in 33us (4466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521532.565295:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1788521532.565337:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788521532.565344:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788521532.565349:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788521532.565390:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43df1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222532736:0@lo:400:kworker.0 00000100:00100000:3.0:1788521532.565439:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521532.565457:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222533248:0@lo:400:kworker.0 00000100:00100000:3.0:1788521532.565482:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521532.565495:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8fee43df1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222533760:0@lo:400:kworker.0 00000100:00100000:3.0:1788521532.565517:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521532.565583:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222532736 00000100:00100000:3.0:1788521532.565589:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222532736 00000100:00100000:3.0:1788521532.565624:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222533248 00000100:00100000:3.0:1788521532.565627:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222533248 00000100:00100000:3.0:1788521532.565639:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222533760 00000100:00100000:3.0:1788521532.565641:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222533760 00000100:00100000:3.0:1788521532.565670:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788521532.565677:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222532736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521532.565718:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875400222532736:12345-0@lo:400:kworker.0 Request processed in 42us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521532.565726:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788521532.565739:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788521532.565745:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222533248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521532.565836:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875400222533248:12345-0@lo:400:kworker.0 Request processed in 91us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521532.565843:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788521532.565866:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788521532.565872:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222533760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521532.566101:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875400222533760:12345-0@lo:400:kworker.0 Request processed in 228us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521532.566109:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1788521532.566125:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788521532.566162:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43df1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875400222532736:0@lo:400:kworker.0 00000100:00100000:3.0:1788521532.566175:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875400222533248:0@lo:400:kworker.0 00010000:00080000:3.0:1788521532.566188:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43df1180 x1875400222533760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521532.566198:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43df1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3645:1875400222533760:0@lo:400:kworker.0 00000100:00100000:3.0:1788521532.566356:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3646:1875400222532352:0@lo:400:kworker.0 00000100:00100000:3.0:1788521532.566370:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43df0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3646:1875400222532864:0@lo:400:kworker.0 00000100:00100000:3.0:1788521532.566383:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3646:1875400222533376:0@lo:400:kworker.0 00000100:00100000:3.0:1788521532.566436:0:18706:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788521532.566447:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222533120 00000100:00100000:3.0:1788521532.566452:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222533120 00000100:00100000:3.0:1788521532.566473:0:18706:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788521532.566478:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222532992 00000100:00100000:3.0:1788521532.566480:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222532992 00000100:00100000:3.0:1788521532.566491:0:18706:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788521532.566497:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788521532.566503:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef75280a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222533120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521532.566549:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef75280a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875400222533120:12345-0@lo:400:kworker.0 Request processed in 46us (6991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521532.566569:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788521532.566581:0:18706:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788521532.566586:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788521532.566592:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef75282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222532992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521532.566630:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef75282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875400222532992:12345-0@lo:400:kworker.0 Request processed in 38us (6033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521532.566636:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788521532.572642:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43df0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3643:1875400222532992:0@lo:400:kworker.0 00000100:00100000:3.0:1788521532.572705:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43df2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3644:1875400222533120:0@lo:400:kworker.0 00000100:00100000:3.0:1788521532.573859:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400222532224 00000100:00100000:3.0:1788521532.573873:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400222532224 00000100:00100000:1.0:1788521532.577500:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788521532.577533:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:3645:x1875400222532224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521532.578000:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43df2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:94dd3513-7bc4-4d8b-8448-a7d8a70716ce:3645:1875400222532224:0@lo:400:kworker.0 00000100:00100000:3.0:1788521532.578092:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3644:1875400222532608:0@lo:400:kworker.0 00000100:00100000:1.0:1788521532.580327:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94dd3513-7bc4-4d8b-8448-a7d8a70716ce+24:3645:x1875400222532224:12345-0@lo:400:kworker.0 Request processed in 2796us (15801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521532.580346:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788521532.580478:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875400222532480:12345-0@lo:400:kworker.0 Request processed in 22853us (23155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521532.580489:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788521532.580544:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:1.0:1788521532.580551:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fee4359aa00, transno 8589934596 00000004:00080000:1.0:1788521532.580564:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:1.0:1788521532.580591:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43df2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3643:1875400222532480:0@lo:400:kworker.0 00000100:00100000:0.0:1788521532.588414:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef75280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875400222532608:12345-0@lo:400:kworker.0 Request processed in 30462us (31025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521532.588565:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788521532.589394:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef75282300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875400222533504:12345-0@lo:400:kworker.0 Request processed in 27846us (28754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521532.589407:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1788521532.589545:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8fee43df0000 x1875400222533504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521532.589564:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8fee43df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3643:1875400222533504:0@lo:400:kworker.0 00010000:00010000:1.0:1788521532.881615:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788521533.641402:0:20378:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1788521533.901269:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521534.054004:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521534.054059:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521534.054096:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521534.054136:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521534.054157:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521534.054176:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521534.054193:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521534.054210:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521534.054253:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.41@tcp (source: 12345-192.168.203.41@tcp) 00000100:00100000:1.0:1788521534.054290:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201481600 00000100:00100000:1.0:1788521534.054303:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201481600 00000100:00100000:2.0:1788521534.054432:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201482112 00000100:00100000:2.0:1788521534.054436:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201482112 00000100:00100000:0.0:1788521534.054500:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201481088 00000100:00100000:0.0:1788521534.054505:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201481088 00000100:00100000:0.0:1788521534.054551:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 167 00000100:00100000:0.0:1788521534.054563:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef7a7a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+13:2395:x1875400201481088:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521534.054653:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef7a7a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd8ede77-4a8a-40f5-a75d-31d60b0f4d28+13:2395:x1875400201481088:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 92us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521534.054661:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 167 00000100:00100000:1.0:1788521534.054982:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201481472 00000100:00100000:1.0:1788521534.054987:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201481472 00000100:00100000:0.0:1788521534.055038:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201481984 00000100:00100000:0.0:1788521534.055042:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201481984 00000100:00100000:3.0:1788521534.055107:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201481344 00000100:00100000:3.0:1788521534.055111:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201481344 00000100:00100000:3.0:1788521534.055139:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201481856 00000100:00100000:3.0:1788521534.055142:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201481856 00000100:00100000:3.0:1788521534.055155:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201481216 00000100:00100000:3.0:1788521534.055158:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201481216 00000100:00100000:3.0:1788521534.055170:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400201481728 00000100:00100000:3.0:1788521534.055172:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400201481728 00000100:00100000:3.0:1788521534.055184:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 64 00000100:00100000:3.0:1788521534.055190:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee4359aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+5:2395:x1875400201481344:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521534.055233:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee4359aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+5:2395:x1875400201481344:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 44us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521534.055250:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 64 00000100:00100000:3.0:1788521534.055265:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 65 00000100:00100000:3.0:1788521534.055270:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+5:2395:x1875400201481856:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521534.055297:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+5:2395:x1875400201481856:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 27us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521534.055302:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 65 00000100:00100000:3.0:1788521534.055311:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 66 00000100:00100000:3.0:1788521534.055315:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+22:2395:x1875400201481216:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521534.055339:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:130bc563-236a-43ec-a1a1-1e1e641e5bc7+22:2395:x1875400201481216:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 24us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521534.055355:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 66 00000100:00100000:3.0:1788521534.055365:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 67 00000100:00100000:3.0:1788521534.055370:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+6:2395:x1875400201481728:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521534.055391:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+6:2395:x1875400201481728:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 22us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521534.055396:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 67 00000100:00100000:3.0:1788521534.055419:0:19185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 28 00000100:00100000:3.0:1788521534.055424:0:19185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fef58341180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:130bc563-236a-43ec-a1a1-1e1e641e5bc7+5:2395:x1875400201481600:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:3.0:1788521534.055450:0:19185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fef58341180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:130bc563-236a-43ec-a1a1-1e1e641e5bc7+5:2395:x1875400201481600:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 26us (1353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521534.055455:0:19185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 28 00000100:00100000:2.0:1788521534.058401:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 29 00000100:00100000:2.0:1788521534.058435:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+5:2395:x1875400201482112:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:2.0:1788521534.058615:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+5:2395:x1875400201482112:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 198us (4455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521534.058624:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 29 00000100:00100000:1.0:1788521534.059423:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 30 00000100:00100000:1.0:1788521534.059440:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee43e2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+5:2395:x1875400201481472:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:1.0:1788521534.059493:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee43e2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:130bc563-236a-43ec-a1a1-1e1e641e5bc7+5:2395:x1875400201481472:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 60us (5298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521534.059500:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 30 00000100:00080000:1.0:1788521534.061267:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788521534.061278:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788521534.061282:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788521534.061285:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788521534.061431:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.41@tcp, seq: 31 00000100:00100000:0.0:1788521534.061452:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fee436ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+5:2395:x1875400201481984:12345-192.168.203.41@tcp:400:kworker.0 00000100:00100000:0.0:1788521534.061540:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fee436ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f42285c1-7e18-4c56-9a31-6c5ebfa3d451+5:2395:x1875400201481984:12345-192.168.203.41@tcp:400:kworker.0 Request processed in 100us (7286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521534.061548:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.41@tcp, seq: 31 00010000:00010000:2.0:1788521534.931093:0:20227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 43276 lines, 43276 kept, 0 dropped, 0 bad.